Free tool
Sitemap checker
Enter a website or a sitemap address. The checker finds the sitemap (from robots.txt or /sitemap.xml), counts its URLs, opens the first child sitemaps of an index, and flags what the sitemap protocol does not allow: missing or relative URLs, unescaped characters, duplicates, URLs on other hosts and malformed lastmod dates.
What the sitemap protocol asks for
Limits
One sitemap may list at most 50,000 URLs and be at most 50 MB uncompressed. Larger sites split their URLs over several sitemaps and list them in a sitemap index.
Absolute, escaped URLs
Every <loc> is a full https:// address, written with XML escaping: & for &. A raw & makes the file invalid XML.
Same host
A sitemap lists URLs on its own host. URLs on another host are ignored unless that host's robots.txt points to the sitemap.
lastmod
Optional, in W3C date format (2026-11-19 or with a time and zone). Crawlers use it to decide what to fetch again, so it should change only when the page does.
Questions
Where does the checker look for the sitemap?
At the address you give when it looks like a sitemap; otherwise at the first Sitemap: line in the site's robots.txt, then at /sitemap.xml.
Are duplicates always a problem?
In a page sitemap, yes: each URL should appear once. Image and video sitemaps sometimes repeat a page once per image, which crawlers tolerate.
Does it read gzip sitemaps?
Yes, .xml.gz files are decompressed before checking.
More free tools
-
Website data checker
Enter a URL to see the JSON-LD, embedded JSON, feeds, sitemap, robots.txt rules and llms.txt a crawler finds there.
-
JSON to CSV converter
Paste an API response or NDJSON; nested fields become columns and you download a spreadsheet-ready CSV.
-
JSON Schema generator
Paste sample records to get a JSON Schema, TypeScript interfaces and Pydantic models that cover every record.
-
robots.txt tester
Load or paste a robots.txt, pick a crawler and see whether each URL is allowed, with the rule and line that decides it.
-
llms.txt generator
Enter a site to get a draft llms.txt from its home page, sitemap and page titles, ready to edit and publish.
-
Shopify store to CSV
Enter a Shopify store or collection to download its public products as CSV, one row per product or per variant.
Need the data itself, on a schedule?
CleanedWeb turns a website into a maintained REST API that returns structured records, with a versioned schema and repairs when the site changes.