Search engine crawler
What is Bingbot?
Bingbot crawls pages for Bing search, which also supplies Microsoft Copilot's web answers and other services that use Bing's index. Blocking Bingbot removes your pages from Bing and the answers built on its index, including Copilot.
- Operator
- Microsoft
- What it does
- Search engine crawler
- robots.txt token
bingbot- Verified on rankecho.io, 30 days
- 1,423 requests
What Bingbot did on rankecho.io
From 17 October to 15 November 2026, Cloudflare verified 1,423 requests from Bingbot, on 28 of the 30 days. It fetched 637 different pages, read robots.txt 45 times, sitemaps 101 times and llms.txt 0 times. 105 of its requests got an error status (4xx or 5xx).
- Verified requests
| Date | Verified requests |
|---|---|
| Oct 17 | 20 |
| Oct 18 | 60 |
| Oct 19 | 30 |
| Oct 20 | 60 |
| Oct 21 | 0 |
| Oct 22 | 0 |
| Oct 23 | 30 |
| Oct 24 | 42 |
| Oct 25 | 23 |
| Oct 26 | 31 |
| Oct 27 | 41 |
| Oct 28 | 56 |
| Oct 29 | 55 |
| Oct 30 | 63 |
| Oct 31 | 73 |
| Nov 1 | 59 |
| Nov 2 | 67 |
| Nov 3 | 65 |
| Nov 4 | 62 |
| Nov 5 | 66 |
| Nov 6 | 44 |
| Nov 7 | 200 |
| Nov 8 | 42 |
| Nov 9 | 34 |
| Nov 10 | 27 |
| Nov 11 | 28 |
| Nov 12 | 25 |
| Nov 13 | 32 |
| Nov 14 | 51 |
| Nov 15 | 37 |
| Path | Requests |
|---|---|
/ | 94 |
/benchmark/krauszersfoodliquordeli.gotoliquorstore.com | 19 |
/learn/llm-seo | 19 |
/engines/copilot-visibility | 18 |
/methodology | 16 |
Also in those days, 24 requests used Bingbot's user agent without Cloudflare verifying it, and 18 of those asked for secret files such as /.env or compose.yml, which no real crawler needs.
Source: rankecho.io's Cloudflare logs, visitor requests only, queried 2026-11-16. Cloudflare sampled 210 of the verified requests, so those counts are estimates.
How many sites block Bingbot
1 of 13 sites whose robots.txt RankEcho read in audits from 3 November 2026 to 16 November 2026 block Bingbot from the whole site. The sample is small and grows with every audit, so read it as a first look rather than a rate for the web.
Blocking Bingbot removes your pages from Bing and the answers built on its index, including Copilot. Many AI answers draw on Bing, so most sites should allow it.
Allow Bingbot
User-agent: bingbot Allow: /
Block Bingbot
User-agent: bingbot Disallow: /
Put the lines in the robots.txt file at the root of your domain. A more specific group for bingbot replaces the rules under User-agent: * for that crawler.
How to check a visit is really Bingbot
Run a reverse DNS lookup on the IP: it should end in search.msn.com, and a forward lookup should return the same IP. Bing Webmaster Tools also has a Verify Bingbot tool.
Source: Bing: Which crawlers does Bing use?.
Questions about Bingbot
What is Bingbot?
Bingbot crawls pages for Bing search, which also supplies Microsoft Copilot's web answers and other services that use Bing's index.
Should I block Bingbot?
Blocking Bingbot removes your pages from Bing and the answers built on its index, including Copilot. Many AI answers draw on Bing, so most sites should allow it.
How do I know a visit is really from Bingbot?
Run a reverse DNS lookup on the IP: it should end in search.msn.com, and a forward lookup should return the same IP. Bing Webmaster Tools also has a Verify Bingbot tool.
How often does Bingbot visit a site?
On rankecho.io, Bingbot made 1,423 Cloudflare-verified requests from 17 October to 15 November 2026, on 28 of the 30 days. Your site will differ with its size and how often it changes.
How many sites block Bingbot?
1 of the 13 sites whose robots.txt RankEcho read in audits from 3 November 2026 to 16 November 2026 block Bingbot from the whole site. It is a small sample, so read it as a first look, not a web-wide rate.
Related crawlers
Check what your robots.txt allows
The free crawler policy check reads your robots.txt and says which AI crawlers it lets in. A free audit also asks ChatGPT, Perplexity and Gemini whether they cite you, and marks a missing answer as crawler access when a crawler is blocked.
Facts checked 2026-11-16 against Microsoft's documentation. Log numbers from 17 October to 15 November 2026. Read our crawler log study for the method.
