Crawlers
Every search engine, AI model and SEO tool that reads this site, across the website, the API and the image CDN. Updated every hour.
Scoped to images.mangabaka.dev · every host
Requests
50.7k
Served
43.1 GB
Providers
21
Share of bots
1.2%
By what they are for
- AI Crawler 28.5k 28.7 GB
- SEO tooling 15.5k 11.2 GB
- Search engines 2.9k 2.2 GB
- Page Preview 2.1k 42.1 MB
- AI search 1.0k 156 MB
- Archiver 506 542 MB
- Accessibility 118 135 MB
- Aggregator 56 60.4 MB
- Security 22 12.9 MB
- AI assistant 3 2.0 MB
AI Crawler are 56% of automated traffic.
Which provider hits it
- Meta 30.0k 26.2 GB
- Anthropic 5.6k 5.4 GB
- Semrush 4.0k 2.2 GB
- Reflection AI 3.8k 3.6 GB
- OpenAI 2.3k 2.2 GB
- Moz 2.0k 1.7 GB
- Parallel 820 7.4 MB
- Microsoft 614 561 MB
- Internet Archive 200 163 MB
- Ahrefs 174 150 MB
Meta is 59% of its requests.
What they take away
- jpeg 44.6k 38.4 GB
- html 2.7k 19.6 MB
- png 1.8k 4.2 GB
- webp 1.5k 439 MB
- empty 111 3.3 KB
Images are 94% of requests and 100% of bytes.
What we answered
- 200 OK 47.8k 43.1 GB
- 404 gone 2.6k 19.5 MB
- 301 moved 159 155 KB
- 499 hung up 108 0 B
- 304 unchanged 33 33.4 KB
5.3% of bot requests are refused or errored.
Who crawls us
By requests
Meta
AI Crawler
+1123%
30.0k
26.2 GB 59%
Anthropic
AI Crawler
−44.5%
5.6k
5.4 GB 11%
Semrush
SEO tooling
−3.6%
4.0k
2.2 GB 8.0%
Reflection AI
AI Crawler
−49.4%
3.8k
3.6 GB 7.5%
OpenAI
AI Crawler
−78.7%
2.3k
2.2 GB 4.6%
Moz
SEO tooling
−69.1%
2.0k
1.7 GB 4.0%
Parallel
AI search
+8.5%
820
7.4 MB 1.6%
Microsoft
Search engines
−40.2%
614
561 MB 1.2%
Requests per day
images.mangabaka.devBytes per day
images.mangabaka.devCounts come from Cloudflare's edge across both zones, refreshed every hour. Only bots Cloudflare has verified are named, so anything claiming to be Googlebot without the network to prove it is left out. Our own monitoring is excluded.