Back
RFC 9309
robots.txt
Open official help
The official Robots Exclusion Protocol RFC that documents robots.txt for the web.
Built by Rohan ยท 2026