ListMySaaSListMySaaS

Sitemap & robots checker · /tools/sitemap-checker

Sitemap checker and validator, plus robots.txt

Paste any domain to fetch /robots.txt, probe /sitemap.xml (and sitemap indexes), parse every URL, and surface parser errors before search engines see them.

Enter a domain above to check its sitemap and robots.txt.

The sitemap checker fetches robots.txt and the XML sitemaps a site declares. It counts URLs, reads lastmod, and reports parser errors before a crawler hits a broken file.

Paste a domain. The tool looks at robots.txt, the usual sitemap paths, and any sitemap listed in robots.txt, then follows sitemap indexes a few levels deep.

How it works

  1. Step 1

    Enter a domain

    Type the root domain with or without https. We check robots.txt and the sitemap URLs it names.

  2. Step 2

    We fetch and parse

    Each sitemap is read as a URL set or an index. Child sitemaps are followed to a safe depth.

  3. Step 3

    See the audit

    You get URL counts, lastmod coverage, parser errors, and the robots.txt groups.

FAQ

Why is there a URL cap?
The checker stops after a safe number of URLs so one huge file cannot stall the request. Large sites should use a sitemap index of smaller files.
Will you find sitemap_index.xml?
Yes. The usual sitemap paths are checked, plus any Sitemap line in robots.txt.
What does an unknown robots.txt line mean?
A line that is not a common directive such as User-agent, Allow, Disallow, or Sitemap. Many crawlers ignore those extra lines.

More free SEO tools