Crawlers
Every search engine, AI model and SEO tool that reads this site, across the website, the API and the image CDN. Updated every hour.
Meta
4 crawlers, 2.3M requests
Requests
2.3M
Served
136 GB
Share of bots
56%
Vs. previous period
+347%
Its crawlers
By requests
Which host it hits
- mangabaka.org 1.4M 52.2 GB
- cdn.mangabaka.dev 746k 56.6 GB
- api.mangabaka.org 152k 519 MB
- images.mangabaka.dev 30.0k 26.2 GB
- ap-proxy.mangabaka.dev 3.0k 190 MB
- mangabaka.dev 2.4k 13.6 MB
- uploads.mangabaka.org 229 3.1 MB
- analytics.mangabaka.dev 188 2.1 MB
- www.mangabaka.org 116 119 KB
- api.mangabaka.dev 98 123 KB
59% of its requests go to mangabaka.org.
What it takes away
- html 1.1M 51.3 GB
- jpeg 521k 44.1 GB
- empty 227k 265 MB
- webp 106k 14.1 GB
- png 97.6k 24.0 GB
- atom 81.5k 160 MB
- json 66.5k 260 MB
- avif 49.7k 804 MB
- js 16.8k 506 MB
- css 5.6k 47.6 MB
Images are 34% of its requests and 61% of its bytes.
What we answered
- 200 OK 1.8M 134 GB
- 403 refused 265k 931 MB
- 301 moved 221k 250 MB
- 404 gone 17.3k 155 MB
- 302 found 6.4k 7.3 MB
- 304 unchanged 859 833 KB
- 206 partial 731 5.1 MB
- 308 slash 728 593 KB
- 502 bad gateway 383 2.2 MB
- 499 hung up 288 0 B
12% of its requests are refused or errored.
What its crawlers are for
- AI Crawler 1.4M 84.6 GB
- Search engines 448k 26.2 GB
- SEO tooling 226k 13.5 GB
- AI search 62.7k 5.1 GB
- Page Preview 53.5k 1.1 GB
- Monitoring & Analytics 51.6k 4.2 GB
- Archiver 10.6k 813 MB
- Security 2.4k 61.5 MB
- AI assistant 1.6k 117 MB
- Accessibility 458 74.7 MB