Crawlers

Every search engine, AI model and SEO tool that reads this site, across the website, the API and the image CDN. Updated every hour.

Anthropic

3 crawlers, 1.3M requests

Requests
1.3M
Served
35.0 GB
Share of bots
22%
Vs. previous period
+92.5%*

Its crawlers

by requests

Which host it hits

68% of its requests go to mangabaka.org.

What it takes away

  • html 886k 24.8 GB
  • atom 143k 245 MB
  • txt 102k 97.9 MB
  • jpeg 91.7k 4.3 GB
  • json 66.4k 163 MB
  • empty 29.4k 27.2 MB
  • png 19.3k 4.8 GB
  • webp 10.2k 483 MB
  • gif 138 3.5 MB
  • xml 95 108 KB

Images are 9.0% of its requests and 28% of its bytes.

What we answered

  • 200 OK 1.0M 34.7 GB
  • 404 gone 175k 162 MB
  • 403 refused 102k 97.4 MB
  • 301 moved 29.3k 27.2 MB
  • 429 slow down 424 369 KB
  • 502 bad gateway 128 878 KB
  • 302 found 42 39.7 KB
  • 499 hung up 32 0 B
  • 500 error 3 2.9 KB

21% of its requests are refused or errored.

What its crawlers are for

  • AI Crawler 1.3M 35.0 GB
  • AI assistant 50 1.0 MB
  • AI search 19 109 KB

Requests per day

2026-08-31 to 2026-09-06

Bytes per day

2026-08-31 to 2026-09-06