Crawlers
Every search engine, AI model and SEO tool that reads this site, across the website, the API and the image CDN. Updated every hour.
All providers Scoped to mangabaka.org · every host
Meta
4 crawlers, 1.5M requests
Requests
1.5M
Served
57.1 GB
Share of bots
34%
Vs. previous period
+267%
Its crawlers
By requests
What it takes away
- html 1.2M 56.1 GB
- empty 246k 286 MB
- js 17.9k 548 MB
- json 7.9k 26.8 MB
- css 5.8k 50.0 MB
- svg 1.6k 23.1 MB
- txt 1.5k 2.4 MB
- png 1.4k 22.9 MB
- woff2 624 28.2 MB
- xml 105 29.0 MB
Images are 0.2% of its requests and 0.1% of its bytes.
What we answered
- 200 OK 956k 55.9 GB
- 403 refused 260k 897 MB
- 301 moved 237k 269 MB
- 302 found 6.5k 7.5 MB
- 404 gone 2.0k 39.9 MB
- 308 slash 792 645 KB
- 304 unchanged 525 416 KB
- 502 bad gateway 423 2.4 MB
- 499 hung up 193 0 B
- 530 98 683 KB
18% of its requests are refused or errored.
What its crawlers are for
- AI Crawler 834k 28.9 GB
- Search engines 381k 18.4 GB
- SEO tooling 140k 1.8 GB
- AI search 42.7k 2.4 GB
- Page Preview 33.9k 829 MB
- Monitoring & Analytics 27.1k 4.6 GB
- Security 1.6k 35.4 MB
- AI assistant 1.6k 139 MB
- Archiver 1.3k 104 MB
- Accessibility 512 18.8 MB