When to use it
Generate a starter sitemap for a small site or a bounded sample of a larger site.
Crawl a small same-site sample and generate an XML sitemap from reachable HTML pages.
Only public web targets are accepted. Private and reserved network ranges are blocked.
Generate a starter sitemap for a small site or a bounded sample of a larger site.
Bounded crawl: the private build caps pages and bytes to prevent abusive crawling.