GeekPress

Technology news, shaken not stirred...

Monday, February 19, 2024

About robots.txt

"The text file that runs the internet"

Posted by Paul Hsieh at 1:02 AM

Newer Post Older Post Home

Technology news, shaken not stirred...

Front page
RSS Feed
E-mail Paul

Twitter: PaulHsieh

Diana's blogs:
NoodleFood/Comments
Modern Paleo/MP Blog
Politics Without God

My Health Care writing:
Paul's Articles/OpEds
FIRM blog

The Big Kahunas:
InstaPundit
PajamasMedia
Volokh Conspiracy
Kottke
Boing Boing
Hot Air

Meta sites:
MetaFilter
Four Short Links
Stellar IO
TheNextWeb Shareables
Arts & Letters Daily
SciTech Daily
Digg Science/Technology
Plastic
kuro5hin
memepool
RealClearTechnology
Found on the Web
Waxy Links
Dark Roasted Blend
Look At This...

Worthwhile weblogs:
Marginal Revolution
The Fly Bottle
Virginia Postrel
Cynical-C
Neatorama
Now That's Nifty
Mental floss
Michael Williams
Jason Crawford
Fun With Gravity
Wolf Files

Science & Technology:
Techdirt
Tech Central Station
Good Morning SV
Digital Daily
Wired
Ars Technica
New Scientist
Nature News
Physorg
Technology Review
Scientific American
Maximizing Progress
SlashDot
LiveScience
Cosmic Log
Clicked
Transterrestrial Musings
Neuroworld
DefenseTech
Schneier on Security
Slate Science/Tech
InternetCases
Politech
FuturePundit
Futurehead
Derek Lowe
The Speculist
Technovelgy
inkycircus
Respectful Insolence
Physics arXiv
Royal Pingdom
Singularity Hub
Taste of Tomorrow

Gadgets and Gaming:
Gizmodo
Engadget
Medgadget
The Gadgeteer
Future Sack

Humor & offbeat:
Day By Day
BBspot
xkcd
Fark
Strange Maps
Cool Infographics
Snopes
Straight Dope
Stupid Criminals
Dave Barry
Obscure Store
Onion
ScrappleFace
Specious Report

Objectivists:
Principles In Practice
Ari Armstrong
Free Colorado
Gus Van Horn
Flibbertigibbet
Spark a Synapse
Rule of Reason
Galileo Blogs
Francisco Gutierrez
Haight Speech
Crucible and Column
A Blog By Tod

Radiology:
Sumer Radiology
MSK/Ortho MRI
Not Totally Rad
StatRead

Politics:
Strategy Page
Radley Balko
Belmont Club
Drudge Report
Reason
Right Wing News
Lileks
WSJ-OpJ: Best of the Web
Eject!Eject!Eject!
Eric Raymond

Retired:
USS Clueless
Cox and Forkum
Hanah Metchis Volokh
Gravity Lens

Old Archive:
03/2000 - 03/2001

Blog Archive

▼ 2024 (169)
- May (8)
- April (44)
- March (35)
- February (39)
- January (43)

► 2023 (474)
- December (40)
- November (36)
- October (41)
- September (32)
- August (47)
- July (40)
- June (43)
- May (43)
- April (32)
- March (47)
- February (41)
- January (32)

► 2022 (478)
- December (36)
- November (39)
- October (39)
- September (25)
- August (46)
- July (41)
- June (43)
- May (43)
- April (40)
- March (47)
- February (40)
- January (39)

► 2021 (456)
- December (25)
- November (37)
- October (36)
- September (35)
- August (47)
- July (33)
- June (43)
- May (42)
- April (40)
- March (45)
- February (39)
- January (34)

► 2020 (550)
- December (44)
- November (37)
- October (44)
- September (43)
- August (32)
- July (37)
- June (49)
- May (40)
- April (47)
- March (51)
- February (59)
- January (67)

► 2019 (726)
- December (58)
- November (56)
- October (66)
- September (63)
- August (61)
- July (58)
- June (63)
- May (57)
- April (56)
- March (65)
- February (60)
- January (63)

► 2018 (678)
- December (55)
- November (59)
- October (64)
- September (58)
- August (66)
- July (66)
- June (38)
- May (34)
- April (57)
- March (66)
- February (60)
- January (55)

► 2017 (726)
- December (57)
- November (52)
- October (69)
- September (59)
- August (63)
- July (66)
- June (60)
- May (67)
- April (56)
- March (58)
- February (59)
- January (60)

► 2016 (886)
- December (59)
- November (54)
- October (69)
- September (71)
- August (76)
- July (69)
- June (85)
- May (81)
- April (64)
- March (90)
- February (87)
- January (81)

► 2015 (990)
- December (84)
- November (85)
- October (88)
- September (88)
- August (95)
- July (82)
- June (87)
- May (45)
- April (77)
- March (89)
- February (84)
- January (86)

► 2014 (984)
- December (80)
- November (85)
- October (85)
- September (87)
- August (83)
- July (91)
- June (92)
- May (80)
- April (88)
- March (69)
- February (58)
- January (86)

► 2013 (1021)
- December (91)
- November (78)
- October (83)
- September (86)
- August (89)
- July (93)
- June (80)
- May (87)
- April (86)
- March (66)
- February (82)
- January (100)

► 2012 (1129)
- December (83)
- November (89)
- October (103)
- September (95)
- August (99)
- July (99)
- June (89)
- May (95)
- April (95)
- March (94)
- February (89)
- January (99)

► 2011 (1146)
- December (82)
- November (95)
- October (94)
- September (92)
- August (100)
- July (96)
- June (104)
- May (98)
- April (93)
- March (99)
- February (95)
- January (98)

► 2010 (1102)
- December (97)
- November (86)
- October (95)
- September (93)
- August (102)
- July (87)
- June (95)
- May (86)
- April (84)
- March (94)
- February (87)
- January (96)

► 2009 (1097)
- December (106)
- November (99)
- October (101)
- September (92)
- August (90)
- July (92)
- June (84)
- May (52)
- April (102)
- March (102)
- February (86)
- January (91)

► 2008 (1088)
- December (68)
- November (88)
- October (94)
- September (96)
- August (82)
- July (98)
- June (96)
- May (94)
- April (102)
- March (94)
- February (86)
- January (90)

► 2007 (995)
- December (73)
- November (80)
- October (78)
- September (88)
- August (76)
- July (84)
- June (87)
- May (78)
- April (93)
- March (99)
- February (73)
- January (86)

► 2006 (997)
- December (59)
- November (81)
- October (98)
- September (83)
- August (88)
- July (70)
- June (70)
- May (60)
- April (97)
- March (107)
- February (87)
- January (97)

► 2005 (1013)
- December (85)
- November (88)
- October (82)
- September (90)
- August (93)
- July (76)
- June (93)
- May (58)
- April (87)
- March (94)
- February (85)
- January (82)

► 2004 (1090)
- December (99)
- November (95)
- October (85)
- September (86)
- August (105)
- July (79)
- June (93)
- May (42)
- April (111)
- March (121)
- February (99)
- January (75)

► 2003 (1236)
- December (105)
- November (93)
- October (95)
- September (88)
- August (103)
- July (100)
- June (87)
- May (114)
- April (113)
- March (100)
- February (99)
- January (139)

► 2002 (1246)
- December (107)
- November (113)
- October (144)
- September (116)
- August (137)
- July (110)
- June (141)
- May (156)
- April (141)
- March (81)