Discord Join our cozy Discord community to chat with like-minded people and stay up to date with MangaBaka (and get the BAKA server tag)

Crawlers

Every search engine, AI model and SEO tool that reads this site, across the website, the API and the image CDN. Updated every hour.

Submissions
Help
API
API Explorer
API Changelog
MCP
Database
Team
Crawlers

Scoped to mangabaka.org · every host

Requests
3.7M
Served
113 GB
Providers
42
Share of bots
61%
Help pay for it

By what they are for

  • AI Crawler 2.1M 58.4 GB
  • Search engines 1.3M 39.6 GB
  • AI search 140k 4.7 GB
  • SEO tooling 117k 2.4 GB
  • Monitoring & Analytics 59.9k 7.6 GB
  • Page Preview 23.7k 332 MB
  • Security 3.4k 86.7 MB
  • AI assistant 2.3k 75.0 MB
  • Archiver 963 31.9 MB
  • Accessibility 937 29.4 MB

AI Crawler are 56% of automated traffic.

Which provider hits it

Anthropic is 25% of its requests.

What they take away

  • html 3.2M 110 GB
  • empty 375k 375 MB
  • json 52.2k 145 MB
  • js 44.8k 2.1 GB
  • css 10.0k 69.2 MB
  • svg 8.8k 280 MB
  • png 2.6k 38.3 MB
  • txt 2.1k 3.9 MB
  • gz 238 190 MB
  • xml 237 89.7 MB

Images are 0.3% of requests and 0.3% of bytes.

What we answered

  • 200 OK 2.9M 111 GB
  • 301 moved 355k 341 MB
  • 403 refused 220k 1.2 GB
  • 404 gone 187k 358 MB
  • 308 slash 13.2k 10.6 MB
  • 302 found 4.8k 4.7 MB
  • 502 bad gateway 509 3.2 MB
  • 304 unchanged 506 399 KB
  • 499 hung up 209 0 B
  • 206 partial 91 371 KB

11% of bot requests are refused or errored.

Who crawls us

by requests
Anthropic
AI Crawler
+42.6%*
915k
24.8 GB 25%
Meta
AI Crawler
+347%*
752k
19.4 GB 20%
Yandex
Search engines
+271%*
689k
23.1 GB 19%
Microsoft
Search engines
+142%*
552k
15.8 GB 15%
OpenAI
AI Crawler
+491%*
371k
14.0 GB 10%
Apple
AI search
+1138%*
139k
4.7 GB 3.8%
Semrush
SEO tooling
+123%*
61.4k
2.0 GB 1.7%
DataDog
Monitoring & Analytics
+150%*
59.9k
7.6 GB 1.6%

Requests per day

mangabaka.org

Bytes per day

mangabaka.org

Counts come from Cloudflare's edge across both zones, refreshed every hour. Only bots Cloudflare has verified are named, so anything claiming to be Googlebot without the network to prove it is left out. Our own monitoring is excluded.