Discord Join our cozy Discord community to chat with like-minded people and stay up to date with MangaBaka (and get the BAKA server tag)

Crawlers

Every search engine, AI model and SEO tool that reads this site, across the website, the API and the image CDN. Updated every hour.

Submissions
Help
API
API Explorer
API Changelog
MCP
Database
Team
Crawlers

Scoped to cdn.mangabaka.dev · every host

Requests
1.3M
Served
68.2 GB
Providers
21
Share of bots
22%
Help pay for it

By what they are for

  • AI Crawler 1.3M 59.7 GB
  • Search engines 53.9k 7.9 GB
  • Archiver 5.2k 273 MB
  • SEO tooling 3.1k 188 MB
  • Page Preview 2.6k 59.4 MB
  • Security 980 25.5 MB
  • AI search 369 98.2 MB
  • AI assistant 139 2.5 MB
  • Other 22 437 KB
  • Webhooks 4 1.6 MB

AI Crawler are 95% of automated traffic.

Which provider hits it

Meta is 60% of its requests.

What they take away

  • txt 586k 566 MB
  • jpeg 371k 19.4 GB
  • avif 192k 3.2 GB
  • webp 118k 25.8 GB
  • png 69.0k 19.3 GB
  • json 6.3k 6.0 MB
  • empty 450 440 KB
  • gif 412 9.2 MB
  • html 77 332 KB

Images are 56% of requests and 99% of bytes.

What we answered

  • 200 OK 732k 63.8 GB
  • 403 refused 585k 565 MB
  • 206 partial 17.4k 3.8 GB
  • 502 bad gateway 4.1k 4.1 MB
  • 404 gone 3.4k 28.6 MB
  • 304 unchanged 357 440 KB
  • 499 hung up 93 0 B
  • 301 moved 34 32.1 KB

44% of bot requests are refused or errored.

Who crawls us

by requests
Meta
AI Crawler
+58.9%*
803k
35.2 GB 60%
Anthropic
AI Crawler
+961%*
217k
9.1 GB 16%
OpenAI
AI Crawler
+932%*
216k
11.3 GB 16%
Microsoft
Search engines
+163%*
46.5k
7.5 GB 3.5%
Amazon
AI Crawler
+420%*
44.1k
4.3 GB 3.3%
Internet Archive
Archiver
+779%*
5.2k
273 MB 0.4%
Ahrefs
SEO tooling
−85.5%*
2.4k
177 MB 0.2%
Google
Search engines
+434%*
1.9k
68.0 MB 0.1%

Requests per day

cdn.mangabaka.dev

Bytes per day

cdn.mangabaka.dev

Counts come from Cloudflare's edge across both zones, refreshed every hour. Only bots Cloudflare has verified are named, so anything claiming to be Googlebot without the network to prove it is left out. Our own monitoring is excluded.