From sitemap to URL list
Enter a domain or a sitemap URL. If you enter a domain, we read robots.txt for Sitemap: lines and fall back to /sitemap.xml. We then walk every sitemap index into its child sitemaps, including gzip-compressed ones and plain text sitemaps, and collect each page URL once. The order follows the sitemaps: files in the order they’re listed, URLs in the order they appear.
You can filter the list by any text (/blog/, .pdf, a product id), copy the filtered URLs, or download a CSV with lastmod, changefreq, priority and the sitemap file each URL came from.
What people use it for
- Migrations. Save the full URL list before a redesign, then map each old URL to its new one for redirects. After launch, the sitemap compare tool shows what changed.
- Content audits. Pull every blog URL into a spreadsheet next to Search Console data and decide what to update, merge or remove.
- Competitor research. A competitor’s sitemap is a public list of the pages they want indexed. Filter by folder to see how many comparison, integration or template pages they have.
- Bulk checks. Feed the list into other tools, or submit changed URLs through the IndexNow tester.
Honest counting
Sites often list a sitemap index in robots.txt and each of its child sitemaps too. Counted naively, every URL appears twice. We read each file once, whether it’s listed in robots.txt, in an index or both, and count each URL once across all files. If a listed sitemap redirects to one we already read, it isn’t counted again either.