http://www.robotstxt.org - jeeves[1] 50% -

http://www.google.com/robots.txt - jeeves[3] 30% -

http://www.searchtools.com/robots/robots-txt.html - jeeves[6] 30% -

http://www.robotstxt.org/wc/norobots.html - jeeves[2] 25% -

Robots exclusion standard - Wikipedia, the free encyclopedia robots.txt" was then popularized with the advent of AltaVista, and ... The robots.txt patterns are matched by simple substring comparisons, so care should be ... http://en.wikipedia.org/wiki/Robots_exclusion_stan ... - yahoo[4] 23% -

Robots.txt Information Information on the robots.txt and how it effects your website. Also includes a free robots.txt generator http://www.robotstxt.ca - yahoo[6] 20% -

http://www.javascriptkit.com/howto/robots.shtml - jeeves[4] 18% -

Robots.txt Generator - McAnerin International Inc. robots.txt generator designed by an SEO for public use. Includes tutorial. ... The robots.txt is a very simple text file that is placed on your root directory. ... http://www.mcanerin.com/EN/search-engine/robots-tx ... - yahoo[10] 15% -

http://www.sxw.org.uk/computing/robots/check.html - jeeves[5] 15% -

Robots.txt Tutorial Generate effective robots.txt files that help ensure Google and other search engines are crawling and indexing your site properly. http://tools.seobook.com/robots-txt - yahoo[12] 13% -