CleanedWeb

Free tool

Sitemap checker

Enter a website or a sitemap address. The checker finds the sitemap (from robots.txt or /sitemap.xml), counts its URLs, opens the first child sitemaps of an index, and flags what the sitemap protocol does not allow: missing or relative URLs, unescaped characters, duplicates, URLs on other hosts and malformed lastmod dates.

Checks the sitemap and up to five child sitemaps. Files over 6 MB are checked in part.

What the sitemap protocol asks for

Limits

One sitemap may list at most 50,000 URLs and be at most 50 MB uncompressed. Larger sites split their URLs over several sitemaps and list them in a sitemap index.

Absolute, escaped URLs

Every <loc> is a full https:// address, written with XML escaping: &amp; for &. A raw & makes the file invalid XML.

Same host

A sitemap lists URLs on its own host. URLs on another host are ignored unless that host's robots.txt points to the sitemap.

lastmod

Optional, in W3C date format (2026-11-19 or with a time and zone). Crawlers use it to decide what to fetch again, so it should change only when the page does.

Questions

Where does the checker look for the sitemap?

At the address you give when it looks like a sitemap; otherwise at the first Sitemap: line in the site's robots.txt, then at /sitemap.xml.

Are duplicates always a problem?

In a page sitemap, yes: each URL should appear once. Image and video sitemaps sometimes repeat a page once per image, which crawlers tolerate.

Does it read gzip sitemaps?

Yes, .xml.gz files are decompressed before checking.

More free tools

All free tools

Need the data itself, on a schedule?

CleanedWeb turns a website into a maintained REST API that returns structured records, with a versioned schema and repairs when the site changes.