Crawling and indexing
Google Search Central
Documentation for how Google crawls and indexes pages, including sitemaps, robots.txt and canonical URLs.
Google Search Central
Documentation for how Google crawls and indexes pages, including sitemaps, robots.txt and canonical URLs.