Back
robots.txt
How Google interprets robots.txt syntax, including user-agent, allow, disallow and sitemap lines.