Crawlers
Every search engine, AI model and SEO tool that reads this site, across the website, the API and the image CDN. Updated every hour.
ExaSearchBot
1 crawler, 176k requests
Requests
176k
Served
9.6 GB
Share of bots
4.2%
Vs. previous period
−38.4%
Its crawlers
By requests
What it takes away
- html 161k 9.5 GB
- empty 15.1k 16.6 MB
- md 115 134 KB
- txt 7 10.0 KB
Images are 0% of its requests and 0% of its bytes.
What we answered
- 200 OK 160k 9.5 GB
- 301 moved 14.6k 16.5 MB
- 499 hung up 395 0 B
- 502 bad gateway 115 134 KB
- 404 gone 110 2.8 MB
- 302 found 51 58.3 KB
- 308 slash 17 13.7 KB
- 500 error 2 284 KB
0.4% of its requests are refused or errored.
What its crawlers are for
- Search engines 176k 9.6 GB