Introduction to robots.txt
robots.txt
Google's introduction to robots.txt. The old robots.txt tester in Search Console was retired; use these docs and the robots.txt report in Search Console instead.
robots.txt
Google's introduction to robots.txt. The old robots.txt tester in Search Console was retired; use these docs and the robots.txt report in Search Console instead.