Posts Tagged ‘robots.txt’

robots.txt validator (checker)

Wednesday, July 16th, 2008

I created a robots.txt but was not sure whether the syntax was correct or not. I searched and found this nice online tool that checks the validity of robots.txt file: http://tool.motoricerca.info/robots-checker.phtml Very easy to use.