Crawlers

Every search engine, AI model and SEO tool that reads this site, across the website, the API and the image CDN. Updated every hour.

OpenAI

3 crawlers, 811k requests

Requests
811k
Served
25.7 GB
Share of bots
13%
Vs. previous period
+659%*

Its crawlers

by requests

Which host it hits

46% of its requests go to mangabaka.org.

What it takes away

  • html 366k 13.9 GB
  • txt 185k 176 MB
  • atom 152k 278 MB
  • jpeg 74.2k 5.8 GB
  • webp 12.9k 926 MB
  • png 10.8k 4.5 GB
  • empty 5.5k 5.4 MB
  • avif 4.1k 84.2 MB
  • js 254 10.2 MB
  • bin 30 7.4 MB

Images are 13% of its requests and 44% of its bytes.

What we answered

  • 200 OK 617k 25.4 GB
  • 403 refused 185k 176 MB
  • 301 moved 5.4k 5.3 MB
  • 404 gone 2.9k 72.1 MB
  • 302 found 90 85.3 KB
  • 502 bad gateway 32 219 KB
  • 499 hung up 12 0 B
  • 500 error 5 6.4 KB
  • 530 4 34.8 KB

23% of its requests are refused or errored.

What its crawlers are for

  • AI Crawler 802k 25.3 GB
  • Search engines 7.5k 322 MB
  • AI assistant 1.1k 46.3 MB

Requests per day

2026-08-31 to 2026-09-06

Bytes per day

2026-08-31 to 2026-09-06