Species index
Everything that has been through
One page per client. Identification is by User-Agent unless marked verified, which means forward and reverse DNS agreed — a self-declared name is a claim, not a fact, and the difference is marked everywhere it matters.
| Client | Operator | Kind | Purpose | robots.txt | Requests | IPs |
|---|---|---|---|---|---|---|
| curl | -- | agent | unknown | ignores | 106 | 3 |
| GPTBot | OpenAI | crawler | training | never read it | 31 | 2 |
| GoogleOther | crawler | unknown | never read it | 17 | 7 | |
| ClaudeBot | Anthropic | crawler | training | honours | 16 | 3 |
| Headless Chrome | -- | browser | unknown | never read it | 10 | 2 |
| Googlebot | crawler | search | honours | 5 | 5 | |
| OkHttp | -- | agent | unknown | insufficient data | 3 | 1 |
| OAI-SearchBot | OpenAI | crawler | search | insufficient data | 2 | 2 |
| PerplexityBot | Perplexity AI | crawler | search | insufficient data | 2 | 1 |
| python-requests | -- | agent | unknown | insufficient data | 2 | 1 |
| axios | -- | agent | unknown | insufficient data | 1 | 1 |
| bingbot | Microsoft | crawler | search | insufficient data | 1 | 1 |
| Bytespider | ByteDance | crawler | training | insufficient data | 1 | 1 |
On “verified”
Any client can send any User-Agent. A row is marked verified only when the connecting address resolves back to a hostname the operator publishes, and that hostname resolves forward to the same address. Everything else is recorded as a claim and displayed as one.