RankEcho

Crawling and indexing

What is an XML sitemap?

An XML sitemap is a file listing the URLs you want crawled, each with an optional lastmod date. Crawlers find it in robots.txt or when you submit it in Search Console or Bing Webmaster Tools. It helps them find new and changed pages; it does not make them index anything.

How to read it

List only canonical, indexable URLs that return 200. A sitemap full of redirects, 404s or noindex pages teaches crawlers to trust it less.

Declare it in robots.txt with a Sitemap: line, so every crawler can find it, not only the search engines you submitted it to.

Example from rankecho.io

GPTBot read the sitemap 92 times

In 30 days, ClaudeBot read rankecho.io's sitemaps 199 times, GPTBot 92 times and Googlebot 15 times.

AI crawlers lean on sitemaps to find pages, so keeping the sitemap complete matters to them as much as to Google.

Source: rankecho.io's Cloudflare logs, verified requests only, 17 October to 15 November 2026.

Questions people ask

What is an XML sitemap?

An XML sitemap is a file listing the URLs you want crawled, each with an optional lastmod date. Crawlers find it in robots.txt or when you submit it in Search Console or Bing Webmaster Tools. It helps them find new and changed pages; it does not make them index anything.

Do I need a sitemap?

Small, well-linked sites can do without, but a sitemap costs little and helps new pages get found sooner.

How big can a sitemap be?

Up to 50,000 URLs or 50 MB uncompressed per file. Larger sites use a sitemap index pointing to several files.

Related terms

Read more on rankecho.io

See it on your own site

RankEcho reads your Search Console data and asks AI assistants whether they cite you, then shows each of these numbers for your pages. The audit is free.

Definition and example checked 2026-11-16.