Publish an XML sitemap and list it in robots.txt
A sitemap is a file that lists the pages you want found. It helps crawlers discover pages, especially new or poorly linked ones. It does not make a page rank or get cited. Standard hygiene for search; its effect on AI citations is unproven.
Why it matters
A sitemap lists the pages you want found, so search engines can discover new or poorly linked pages. Google says it helps crawling but doesn't guarantee pages get crawled or indexed. We found no study showing it changes whether AI answers cite you, so the free check doesn't grade it. It's cheap, standard hygiene.
How to fix
-
Turn on your platform's sitemap. Many build one for you: WordPress has published one at
/wp-sitemap.xmlsince version 5.5, and Next.js builds one fromapp/sitemap.ts. Check your CMS or framework docs for its sitemap setting or plugin. -
List your key pages with full, canonical URLs (the main address of each page), and leave out pages set to noindex or that redirect:
<?xml version="1.0" encoding="UTF-8"?> <urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9"> <url> <loc>https://www.example.com/</loc> <lastmod>2026-10-20</lastmod> </url> <url> <loc>https://www.example.com/pricing</loc> </url> </urlset> -
Keep each file under 50,000 URLs and 50MB. For bigger sites, split it and use a sitemap index (
<sitemapindex>). -
List it in robots.txt with a full URL:
Sitemap: https://www.example.com/sitemap.xml -
Open the sitemap URL in a browser. It should load as XML, not your 404 page or a login screen.
-
Optional: submit it in Google Search Console (Sitemaps report) and Bing Webmaster Tools to see any errors.
How to check it worked: run the free check again. The "Your sitemap" row should read "Your sitemap loads and lists {n} pages."
What the free check looks for
- Look for a Sitemap: line in robots.txt first, then try /sitemap.xml.
- Check the file loads (HTTP status under 400) and is well-formed XML with a <urlset> or <sitemapindex> root.
- Count the <url> or <sitemap> entries. A gzip sitemap is noted but not opened.
- Missing or invalid shows as Watch. It is Not graded and never counts toward your fixes.
Caveats
- — Google says a sitemap helps it find pages, but does not guarantee they are crawled or indexed.
- — We found no study showing a sitemap changes AI citations. Treat it as hygiene.
- — Our check is a simple well-formedness test, not a full schema validator.
Studies and docs
2016
The sitemap protocol: <urlset> with <url><loc>, optional <lastmod>. Each file up to 50,000 URLs and 50MB uncompressed. You can point to a sitemap with a "Sitemap:" line in robots.txt.
2026
Use absolute, canonical URLs, UTF-8 and the 50MB / 50,000 URL limit. Submit through Search Console or by listing the sitemap in robots.txt.
2026
Search engines read a sitemap to crawl your site more efficiently. It helps them discover URLs, but does not guarantee that every item is crawled and indexed.
2022
Section 2.2.4: crawlers MAY interpret records that are not part of the robots.txt protocol, for example Sitemaps.
See what AI agents can find on your site
Our free AI visibility check shows whether AI agents can reach, read and quote your site, with each fix graded by evidence. There's no overall score, and no one can promise citations.
Free. No password.