Google's Gary Illyes highlights robots.txt file's error tolerance and unexpected features as it marks 30 years of aiding web crawling and SEO. Review your robots.txt ...
Results that may be inaccessible to you are currently showing.
Hide inaccessible results
Feedback