Crawlers
Every search engine, AI model and SEO tool that reads this site, across the website, the API and the image CDN. Updated every hour.
Scoped to mangabaka.org · every host
Requests
2.8M
Served
118 GB
Providers
55
Share of bots
68%
By what they are for
- AI Crawler 1.4M 55.5 GB
- Search engines 790k 39.1 GB
- AI search 244k 8.5 GB
- SEO tooling 211k 3.8 GB
- Monitoring & Analytics 58.1k 9.7 GB
- Page Preview 54.3k 927 MB
- Security 4.3k 102 MB
- AI assistant 3.2k 263 MB
- Archiver 2.2k 167 MB
- Accessibility 1.1k 39.9 MB
AI Crawler are 51% of automated traffic.
Which provider hits it
Meta is 49% of its requests.
What they take away
- html 2.3M 116 GB
- empty 417k 485 MB
- js 37.9k 1.2 GB
- css 12.4k 105 MB
- json 11.2k 36.2 MB
- svg 3.1k 39.9 MB
- txt 2.9k 4.5 MB
- png 2.8k 44.3 MB
- woff2 1.4k 61.6 MB
- xml 226 61.4 MB
Images are 0.2% of requests and 0.1% of bytes.
What we answered
- 200 OK 2.1M 116 GB
- 301 moved 394k 446 MB
- 403 refused 278k 1.0 GB
- 302 found 18.4k 20.9 MB
- 404 gone 6.8k 147 MB
- 308 slash 1.1k 915 KB
- 304 unchanged 1.1k 843 KB
- 499 hung up 1.0k 0 B
- 502 bad gateway 921 4.8 MB
- 530 98 683 KB
10% of bot requests are refused or errored.
Who crawls us
By requests
Meta
AI Crawler
+267%
1.4M
52.2 GB 49%
Anthropic
AI Crawler
+17.3%
568k
26.4 GB 21%
ExaSearchBot
Search engines
−32.1%
176k
9.6 GB 6.4%
Microsoft
Search engines
−8.0%
166k
7.2 GB 6.0%
Parallel
AI search
+123%
115k
2.7 GB 4.2%
Apple
AI search
+47.5%
89.9k
3.6 GB 3.3%
Ahrefs
SEO tooling
+317%
39.8k
73.3 MB 1.4%
Semrush
SEO tooling
−41.3%
35.4k
1.5 GB 1.3%
Requests per day
mangabaka.orgBytes per day
mangabaka.orgCounts come from Cloudflare's edge across both zones, refreshed every hour. Only bots Cloudflare has verified are named, so anything claiming to be Googlebot without the network to prove it is left out. Our own monitoring is excluded.