Crawlers
Every search engine, AI model and SEO tool that reads this site, across the website, the API and the image CDN. Updated every hour.
Scoped to cdn.mangabaka.dev · every host
Requests
936k
Served
79.2 GB
Providers
28
Share of bots
23%
By what they are for
- AI Crawler 582k 43.8 GB
- Search engines 154k 16.4 GB
- SEO tooling 123k 9.0 GB
- AI search 56.0k 9.1 GB
- Archiver 14.8k 547 MB
- Page Preview 3.7k 284 MB
- Security 1.4k 68.2 MB
- AI assistant 86 3.8 MB
- Other 53 1.3 MB
- Webhooks 1 247 KB
AI Crawler are 62% of automated traffic.
Which provider hits it
- Meta 746k 56.6 GB
- Microsoft 40.5k 7.6 GB
- Apple 38.7k 6.3 GB
- Ahrefs 33.3k 4.1 GB
- Baidu 24.0k 363 MB
- OpenAI 23.0k 1.5 GB
- Anthropic 13.1k 1.1 GB
- Internet Archive 5.8k 218 MB
- Amazon 4.8k 1.2 GB
- DuckDuckGo 3.8k 66.2 MB
Meta is 80% of its requests.
What they take away
- jpeg 558k 23.6 GB
- webp 183k 30.3 GB
- png 106k 23.8 GB
- avif 84.5k 1.4 GB
- json 2.1k 2.1 MB
- empty 833 839 KB
- gif 680 14.9 MB
- txt 478 538 KB
- html 222 418 KB
Images are 100% of requests and 100% of bytes.
What we answered
- 200 OK 928k 79.1 GB
- 404 gone 5.8k 102 MB
- 206 partial 1.3k 10.2 MB
- 304 unchanged 684 839 KB
- 301 moved 192 198 KB
- 499 hung up 149 0 B
- 502 bad gateway 31 162 KB
- 530 7 59.2 KB
- 520 4 9.6 KB
- 403 refused 1 956 B
0.6% of bot requests are refused or errored.
Who crawls us
By requests
Meta
AI Crawler
+849%
746k
56.6 GB 80%
Microsoft
Search engines
−2.9%
40.5k
7.6 GB 4.3%
Apple
AI search
−81.9%
38.7k
6.3 GB 4.1%
Ahrefs
SEO tooling
+384%
33.3k
4.1 GB 3.6%
Baidu
Search engines
−4.7%
24.0k
363 MB 2.6%
OpenAI
AI Crawler
−64.7%
23.0k
1.5 GB 2.5%
Anthropic
AI Crawler
−6.8%
13.1k
1.1 GB 1.4%
Internet Archive
Archiver
−66.1%
5.8k
218 MB 0.6%
Requests per day
cdn.mangabaka.devBytes per day
cdn.mangabaka.devCounts come from Cloudflare's edge across both zones, refreshed every hour. Only bots Cloudflare has verified are named, so anything claiming to be Googlebot without the network to prove it is left out. Our own monitoring is excluded.