Crawlers

Every search engine, AI model and SEO tool that reads this site, across the website, the API and the image CDN. Updated every hour.

Scoped to api.mangabaka.org · every host

Requests
910k
Served
4.3 GB
Providers
26
Share of bots
15%
Help pay for it

By what they are for

  • AI Crawler 552k 1.7 GB
  • Search engines 185k 795 MB
  • AI search 99.2k 999 MB
  • Monitoring & Analytics 65.7k 71.9 MB
  • Page Preview 5.5k 12.0 MB
  • AI assistant 1.2k 174 MB
  • Security 643 540 MB
  • SEO tooling 234 4.5 MB
  • Accessibility 31 214 KB
  • Archiver 9 57.3 KB

AI Crawler are 61% of automated traffic.

Which provider hits it

Anthropic is 23% of its requests.

What they take away

  • json 564k 3.0 GB
  • atom 324k 581 MB
  • html 21.3k 116 MB
  • txt 1.1k 1.6 MB
  • empty 97 21.0 KB
  • bin 69 569 MB

Images are 0% of requests and 0% of bytes.

What we answered

  • 200 OK 886k 4.1 GB
  • 403 refused 19.0k 114 MB
  • 301 moved 2.2k 2.3 MB
  • 404 gone 1.2k 1.0 MB
  • 429 slow down 889 782 KB
  • 204 no content 172 209 KB
  • 400 bad request 96 102 KB
  • 499 hung up 77 0 B
  • 503 unavailable 35 43.6 KB
  • 502 bad gateway 30 206 KB

2.3% of bot requests are refused or errored.

Who crawls us

by requests

Requests per day

api.mangabaka.org

Bytes per day

api.mangabaka.org

Counts come from Cloudflare's edge across both zones, refreshed every hour. Only bots Cloudflare has verified are named, so anything claiming to be Googlebot without the network to prove it is left out. Our own monitoring is excluded.