AI crawler
What is Amazonbot?
Amazonbot crawls pages to improve Amazon's products and services, such as Alexa answers. Amazon says the content may be used to train its AI models. Amazonbot respects robots.txt.
- Operator
- Amazon
- What it does
- Collects pages for AI training
- robots.txt token
Amazonbot- Verified on rankecho.io, 30 days
- 5,914 requests
What Amazonbot did on rankecho.io
From 17 October to 15 November 2026, Cloudflare verified 5,914 requests from Amazonbot, on 30 of the 30 days. It fetched 1,776 different pages, read robots.txt 1 time, sitemaps 1 time and llms.txt 1 time. 87 of its requests got an error status (4xx or 5xx).
- Verified requests
| Date | Verified requests |
|---|---|
| Oct 17 | 330 |
| Oct 18 | 340 |
| Oct 19 | 130 |
| Oct 20 | 90 |
| Oct 21 | 30 |
| Oct 22 | 140 |
| Oct 23 | 300 |
| Oct 24 | 330 |
| Oct 25 | 221 |
| Oct 26 | 243 |
| Oct 27 | 137 |
| Oct 28 | 179 |
| Oct 29 | 134 |
| Oct 30 | 105 |
| Oct 31 | 256 |
| Nov 1 | 239 |
| Nov 2 | 269 |
| Nov 3 | 250 |
| Nov 4 | 220 |
| Nov 5 | 289 |
| Nov 6 | 233 |
| Nov 7 | 139 |
| Nov 8 | 199 |
| Nov 9 | 240 |
| Nov 10 | 174 |
| Nov 11 | 129 |
| Nov 12 | 143 |
| Nov 13 | 139 |
| Nov 14 | 150 |
| Nov 15 | 136 |
| Path | Requests |
|---|---|
/ | 54 |
/benchmark/proactivate.net | 22 |
/benchmark/mundotrip.com | 14 |
/benchmark/integritylash.com | 14 |
/benchmark/primerica.com | 14 |
Also in those days, 29 requests used Amazonbot's user agent without Cloudflare verifying it, and 17 of those asked for secret files such as /.env or compose.yml, which no real crawler needs.
Source: rankecho.io's Cloudflare logs, visitor requests only, queried 2026-11-16. Cloudflare sampled 1,430 of the verified requests, so those counts are estimates.
How many sites block Amazonbot
2 of 13 sites whose robots.txt RankEcho read in audits from 3 November 2026 to 16 November 2026 block Amazonbot from the whole site. The sample is small and grows with every audit, so read it as a first look rather than a rate for the web.
Amazonbot respects robots.txt. Blocking it keeps your pages out of Amazon's crawl, including any use for training.
Allow Amazonbot
User-agent: Amazonbot Allow: /
Block Amazonbot
User-agent: Amazonbot Disallow: /
Put the lines in the robots.txt file at the root of your domain. A more specific group for Amazonbot replaces the rules under User-agent: * for that crawler.
How to check a visit is really Amazonbot
Run a reverse DNS lookup on the IP: it should end in crawl.amazonbot.amazon, and a forward lookup should return the same IP.
Source: Amazon: Amazonbot.
Questions about Amazonbot
What is Amazonbot?
Amazonbot crawls pages to improve Amazon's products and services, such as Alexa answers. Amazon says the content may be used to train its AI models.
Should I block Amazonbot?
Amazonbot respects robots.txt. Blocking it keeps your pages out of Amazon's crawl, including any use for training.
How do I know a visit is really from Amazonbot?
Run a reverse DNS lookup on the IP: it should end in crawl.amazonbot.amazon, and a forward lookup should return the same IP.
How often does Amazonbot visit a site?
On rankecho.io, Amazonbot made 5,914 Cloudflare-verified requests from 17 October to 15 November 2026, on 30 of the 30 days. Your site will differ with its size and how often it changes.
How many sites block Amazonbot?
2 of the 13 sites whose robots.txt RankEcho read in audits from 3 November 2026 to 16 November 2026 block Amazonbot from the whole site. It is a small sample, so read it as a first look, not a web-wide rate.
Related crawlers
Check what your robots.txt allows
The free crawler policy check reads your robots.txt and says which AI crawlers it lets in. A free audit also asks ChatGPT, Perplexity and Gemini whether they cite you, and marks a missing answer as crawler access when a crawler is blocked.
Facts checked 2026-11-16 against Amazon's documentation. Log numbers from 17 October to 15 November 2026. Read our crawler log study for the method.
