Scan at scaleSites with a broken sitemap
Sites with a broken sitemap
A site-wide report: one row per host, over the sitemap rows the crawl emitted.
What this report returns
A sitemap lets crawlers and agents enumerate a site's URLs without following every link.
These sites serve one that can't be fully used: a file that doesn't parse (malformed XML, or a .gz that won't decompress) yields nothing, a URL declared as a sitemap that serves another kind of document entirely (a site pointing Sitemap: at its llms.txt) yields nothing either though the file itself may be perfectly valid, a root element that does not declare the sitemaps.org 0.9 namespace (absent, or the https:// near-miss) is not recognised as a sitemap at all, relative <loc> entries are dropped, entries outside what the sitemap covers (its protocol, host, port or directory) are ignored, and a file over 50,000 URLs / 50 MB is truncated.
How to fix it. Repair the flagged defect: point every Sitemap: declaration at a real sitemap or drop it, declare xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" on the root, with http and not https, make every <loc> an absolute URL inside the sitemap's own scope, and split oversized files via a <sitemapindex>.
Spec: the sitemaps.org 0.9 protocol.
The columns it shows
Every defect this technology can carry is a column in the grid, worst first, so nothing is hidden behind a filter you have to know to apply.
- Host
host - Sitemap Valid
sitemapValid - Sitemap Findings
sitemapFindings - Sitemap URL Count
sitemapUrlCount - Sitemap Bytes
sitemapBytes - Sitemap Relative Loc Samples
sitemapRelativeLocSamples - Sitemap Cross-Host Entry Samples
sitemapCrossHostLocSamples - Sitemap Out-Of-Directory Entry Samples
sitemapOutOfDirectoryLocSamples - Sitemap Conformance Issue Detected
sitemapConformanceIssueDetected - Sitemap Empty Document
sitemapEmptyDocument - Sitemap Malformed XML
sitemapMalformedXml - Sitemap Wrong Document Type
sitemapWrongDocumentType - Sitemap Missing Namespace
sitemapMissingNamespace - Sitemap Relative Locs
sitemapRelativeLocs - Sitemap Lists Another Host
sitemapCrossHostLocs - Sitemap Too Large
sitemapTooLarge - Sitemap Lists Above Its Directory
sitemapOutOfDirectoryLocs - Sitemap Partially Assessed
sitemapPartiallyAssessed
About XML sitemap
The URL inventory agents and crawlers use for discovery.
Read how XML sitemap is checked, including the specification it is validated against and a worked correct and broken example.
Running it
This report ships in the Lumar agent-readiness container and appears on any project it is linked to, on every crawl. See the whole set, or check a single URL with the scanner on this site, which runs the same code with no account.