Robots.txt Search Improvements
Submitted by Bryan on June 5, 2008 - 7:50pm
Gadgetopia: "Google, Yahoo, and Microsoft have gotten together and actually agreed on extensions to the REP — the Robots Exclusion Protocol, otherwise known as your robots.txt file."



Recent comments
11 hours 49 min ago
11 hours 53 min ago
18 hours 36 min ago
1 day 6 hours ago
2 days 32 min ago
2 days 7 hours ago
2 days 9 hours ago
3 days 3 hours ago
4 days 39 min ago
4 days 13 hours ago