Crawlers
Every search engine, AI model and SEO tool that reads this site, across the website, the API and the image CDN. Updated every hour.
Scoped to api.mangabaka.org · every host
Requests
333k
Served
1.7 GB
Providers
28
Share of bots
8.1%
By what they are for
- AI Crawler 176k 393 MB
- Monitoring & Analytics 63.3k 85.9 MB
- AI search 37.8k 217 MB
- Search engines 36.0k 368 MB
- Page Preview 19.0k 56.8 MB
- Security 739 17.8 MB
- AI assistant 185 600 MB
- SEO tooling 162 1.8 MB
- Advertising & Marketing 21 395 KB
- Other 17 122 KB
AI Crawler are 53% of automated traffic.
Which provider hits it
- Meta 152k 519 MB
- Anthropic 82.0k 165 MB
- DataDog 36.2k 49.2 MB
- Apple 31.4k 176 MB
- OpenAI 8.7k 37.4 MB
- Microsoft 8.5k 117 MB
- Reflection AI 5.6k 16.4 MB
- Baidu 4.9k 27.3 MB
- Yandex 1.4k 11.2 MB
- DuckDuckGo 715 3.4 MB
Meta is 46% of its requests.
What they take away
- atom 177k 366 MB
- json 142k 480 MB
- html 13.3k 69.0 MB
- txt 737 1000 KB
- empty 89 82.4 KB
- bin 31 826 MB
Images are 0% of requests and 0% of bytes.
What we answered
- 200 OK 311k 1.7 GB
- 403 refused 11.1k 66.5 MB
- 404 gone 7.6k 6.8 MB
- 301 moved 2.1k 2.2 MB
- 204 no content 177 219 KB
- 502 bad gateway 64 306 KB
- 304 unchanged 61 81.2 KB
- 401 42 38.0 KB
- 429 slow down 35 32.8 KB
- 206 partial 31 52.6 KB
5.7% of bot requests are refused or errored.
Who crawls us
By requests
Meta
AI Crawler
+143%
152k
519 MB 46%
Anthropic
AI Crawler
−49.2%
82.0k
165 MB 25%
DataDog
Monitoring & Analytics
−36.7%
36.2k
49.2 MB 11%
Apple
AI search
+152%
31.4k
176 MB 9.4%
OpenAI
AI Crawler
−71.9%
8.7k
37.4 MB 2.6%
Microsoft
Search engines
−3.8%
8.5k
117 MB 2.5%
Reflection AI
AI Crawler
−43.1%
5.6k
16.4 MB 1.7%
Baidu
Search engines
−6.6%
4.9k
27.3 MB 1.5%
Requests per day
api.mangabaka.orgBytes per day
api.mangabaka.orgCounts come from Cloudflare's edge across both zones, refreshed every hour. Only bots Cloudflare has verified are named, so anything claiming to be Googlebot without the network to prove it is left out. Our own monitoring is excluded.