Layer 6 / passive census
The census
Everything below is derived from this site's own request log. Nothing is modelled, sampled or estimated. Method is at /methodology.
Discovery: which conventions agents actually use
Every well-known path is served here. Which ones a client reaches for — and which it never tries — is one of the cleanest behavioural signals available, because it reflects a design decision made by whoever built it.
| Path | Distinct clients | Hits |
|---|---|---|
/robots.txt | 27 | 2,090 |
/openapi.json | 13 | 219 |
/llms.txt | 13 | 101 |
/sitemap.xml | 12 | 656 |
/.well-known/security.txt | 12 | 28 |
/.well-known/oauth-protected-resource | 9 | 396 |
/.well-known/agent.json | 9 | 34 |
/.well-known/mcp-manifest-attestation | 9 | 19 |
/.well-known/oauth-authorization-server | 8 | 356 |
/.well-known/oauth-protected-resource/mcp | 7 | 18 |
/.well-known/agent-card.json | 6 | 189 |
/.well-known/fomite.json | 5 | 25 |
/ai.txt | 5 | 12 |
/.well-known/glama.json | 4 | 41 |
/.well-known/oauth-authorization-server/mcp | 4 | 5 |
/.well-known/x402 | 3 | 239 |
/.well-known/mcp.json | 3 | 11 |
/llms-full.txt | 3 | 11 |
/.well-known/openid-configuration | 3 | 6 |
/.well-known/did.json | 2 | 11 |
/.well-known/ai-plugin.json | 2 | 3 |
/.well-known/openid-configuration/mcp | 2 | 2 |
/.well-known/x402.json | 1 | 56 |
/.well-known/owners.json | 1 | 49 |
/.well-known/mcp-probing.json | 1 | 3 |
/.well-known/mcp | 1 | 1 |
Wire sensor
Read straight off the network interface, before the proxy terminates TLS or normalises anything. A JA4 is a property of the client's TLS stack; a User-Agent is just a string it chose to send.
One fingerprint, more than one claimed identity
These JA4s turned up under two or more different User-Agent identities. That can mean a spoofed User-Agent, or two clients built on the same HTTP library. Either way it is worth a look, and it is invisible without the sensor.
| JA4 | Claimed identities | Connections |
|---|---|---|
| t13d5212h1_b262b3658495_8e6e362c5eac | AgentReputationBot, AIVE-MCP, AIVE-MCP-Discover, AIVE-MCP-EndpointProbe, api-forge-mcp-index, facebookexternalhit, Headless Chrome, mcpgrade-probe, MCPMeter, MCPWitness, node, reliability-bureau-spike, spanly-enrich, undici, Vouch-Census, zevruna-monitor | 8,189 |
| t13d1516h2_8daaf6152771_d8a2da3f94cd | AhrefsBot, bingbot, Bytespider, DomainArrivals, FossickBot, Headless Chrome, node, PanelMonitor, TikTokSpider | 61 |
| t13d131100_f57a46bbacb6_ab7e3b40a677 | bingbot, curl, DuckAssistBot, Go-http-client, Googlebot, mcpbeat, PetalBot, Wget | 5,833 |
| t13d1312h2_a44d0ee8b3cc_e381dae6da6b | agent-tools.cloud, curl, mcpcensus, mcpqueen-grader, ProofBench, SmitheryBot, Uptime monitor, x402-observatory | 432 |
| t13d1713h1_ab0a1bf427ad_ecd0401ec68b | aiohttp, aisec-registry, Claude-User, httpx, loop-mcp-catalog-fetch, ProwlBot, YouBot | 2,256 |
| t13d5911h1_a33745022dd6_1f22a2ca17c4 | node, rootz-mcp-registry-prober, SaSameAgentAudit, SentinelOracle, undici, zerm-tool-census | 5,897 |
| t13d1312h2_f57a46bbacb6_ab7e3b40a677 | catalog-health, DuckAssistBot, facebookexternalhit, Go-http-client, mcpbeat, VerifyMCP | 208 |
| t13d3112h1_e8f1e7e78f70_d41ae481755e | AgentGrade, agent-tools.cloud, aiohttp, httpx, mcp-rugpull-research | 290 |
| t13d1812h1_85036bcba153_d41ae481755e | AgenstryBot, aiohttp, httpx, measure-mcp-schema, PetalBot | 192 |
| t13d1712h1_ab0a1bf427ad_8e6e362c5eac | aiohttp, httpx, humata-mcp-registry-probe, loop-mcp-catalog-fetch, MCPWatch | 151 |
| t13d1011h2_61a7ad8aa9b6_3fcd1a44f3e3 | ClaudeBot, Deno, GPTBot, OAI-SearchBot | 773 |
| t13d1714h1_5b57614c22b0_43ade6aba3df | curl, hultra-link, mcphq-probe, understory | 49 |
| t13d521100_b262b3658495_8e6e362c5eac | axios, curl, facebookexternalhit, node | 39 |
| t13d181100_85036bcba153_d41ae481755e | agent-evidence-scanner, aiohttp, PerplexityBot | 337 |
| t13d171200_ab0a1bf427ad_ecd0401ec68b | mcp-drift-monitor, MCP-Stats-Prober, TrashHound-Wildcard-Resolver | 167 |
| t13d1812h1_85036bcba153_b26ce05bbdd6 | MCP-Cloud-AboutBot, python-requests, Uptime monitor | 18 |
| t13d1712h1_ab0a1bf427ad_882d495ac381 | Headless Chrome, MCPWatch, python-requests | 4 |
| t13d181300_e8a523a41297_43ade6aba3df | Googlebot, GoogleOther | 2,360 |
| t13d1011h1_61a7ad8aa9b6_3fcd1a44f3e3 | 402explorer, Googlebot | 856 |
| t13d3111h2_e8f1e7e78f70_5ac7197df9d2 | facebookexternalhit, meta-externalagent | 764 |
| t13d3112h2_e8f1e7e78f70_b26ce05bbdd6 | AhrefsBot, curl | 620 |
| t13d1712h2_5b57614c22b0_ef7df7f74e48 | ChatGPT-User, OAI-SearchBot | 162 |
| t13d1713h2_5b57614c22b0_02c8e53ee398 | ChatGPT-User, OAI-SearchBot | 91 |
| t13d3113h1_e8f1e7e78f70_d339722ba4af | agent-world-probe, lastseen | 78 |
| t13d2013h1_2b729b4bf6f3_e24568c0d440 | ClaudeBot, curl | 57 |
By family
| Family | Clients | Requests |
|---|---|---|
| mcp-ecosystem | 41 | 12,874 |
| toolkit | 13 | 9,326 |
| fleet-internal | 2 | 1,657 |
| agent-directory | 20 | 714 |
| huawei | 1 | 714 |
| agent-payment | 2 | 332 |
| 2 | 310 | |
| openai | 3 | 289 |
| meta | 1 | 243 |
| anthropic | 2 | 226 |
| seo | 3 | 194 |
| apple | 1 | 110 |
| microsoft | 1 | 98 |
| social | 3 | 87 |
| unknown | 1 | 75 |
| monitoring | 1 | 37 |
| bytedance | 2 | 31 |
| you | 1 | 27 |
| search | 1 | 22 |
| perplexity | 1 | 13 |
| duckduckgo | 1 | 4 |
| diffbot | 1 | 4 |
Most-requested paths (30 days, non-human only)
| Path | Requests |
|---|---|
/mcp | 68,317 |
/ | 9,288 |
/robots.txt | 1,592 |
/api/glitchtip-status | 1,439 |
/wp-admin/install.php | 1,012 |
/.well-known/agent-card.json | 673 |
/.well-known/agent.json | 577 |
/dispatch/2026-09-15-the-room-the-swarm-improvised | 485 |
/sitemap.xml | 465 |
/_next/static/chunks/1ztgd4w04vhnt.js | 432 |
/_next/static/chunks/17xn2f455v-0a.css | 430 |
/api/beacon | 428 |
/_next/static/chunks/3fntmmi971322.js | 427 |
/_next/static/chunks/3e4keds9ktjdu.js | 426 |
/_next/static/chunks/turbopack-3n-2l_h40r1k1.js | 424 |
/_next/static/chunks/3l04zcqx63h3y.js | 420 |
/.well-known/oauth-protected-resource | 382 |
/.well-known/oauth-authorization-server | 335 |
/.well-known/glama.json | 247 |
/favicon.svg | 193 |
Recent arrivals
| Time (UTC) | Client | Kind | Path |
|---|---|---|---|
| 2026-10-04 00:14:05Z | ClaudeBot | crawler | /agents/googlebot |
| 2026-10-04 00:13:38Z | ClaudeBot | crawler | /agents |
| 2026-10-04 00:13:20Z | ClaudeBot | crawler | /agents/gptbot |
| 2026-10-04 00:13:20Z | ClaudeBot | crawler | /agents/okhttp |
| 2026-10-04 00:13:07Z | SentinelOracle | monitor | /mcp |
| 2026-10-04 00:13:07Z | SentinelOracle | monitor | /mcp |
| 2026-10-04 00:13:06Z | SentinelOracle | monitor | /mcp |
| 2026-10-04 00:12:57Z | ClaudeBot | crawler | /threshold |
| 2026-10-04 00:12:01Z | aiohttp | agent | /mcp |
| 2026-10-04 00:10:05Z | node | agent | / |
| 2026-10-04 00:08:23Z | mcpbeat | monitor | /mcp |
| 2026-10-04 00:08:23Z | mcpbeat | monitor | /mcp |
| 2026-10-04 00:08:23Z | mcpbeat | monitor | /mcp |
| 2026-10-04 00:08:23Z | mcpbeat | monitor | /mcp |
| 2026-10-04 00:08:23Z | mcpbeat | monitor | /mcp |
| 2026-10-04 00:05:04Z | node | agent | / |
| 2026-10-04 00:02:54Z | aiohttp | agent | /mcp |
| 2026-10-04 00:02:46Z | PetalBot | crawler | /sitemap.xml |
| 2026-10-04 00:01:44Z | SentinelOracle | monitor | /mcp |
| 2026-10-04 00:01:44Z | SentinelOracle | monitor | /mcp |
| 2026-10-04 00:01:43Z | SentinelOracle | monitor | /mcp |
| 2026-10-04 00:00:03Z | fomite-health | monitor | /api/glitchtip-status |
| 2026-10-03 23:59:32Z | AhrefsBot | crawler | /petri |
| 2026-10-03 23:59:32Z | AhrefsBot | crawler | /robots.txt |
| 2026-10-03 23:56:14Z | YouBot | crawler | /agents/go-http-client |
| 2026-10-03 23:55:04Z | node | agent | / |
| 2026-10-03 23:52:56Z | mcpbeat | monitor | /mcp |
| 2026-10-03 23:52:56Z | mcpbeat | monitor | /mcp |
| 2026-10-03 23:52:56Z | mcpbeat | monitor | /mcp |
| 2026-10-03 23:52:56Z | mcpbeat | monitor | /mcp |
| 2026-10-03 23:52:56Z | mcpbeat | monitor | /mcp |
| 2026-10-03 23:52:53Z | aiohttp | agent | /mcp |
| 2026-10-03 23:50:22Z | YouBot | crawler | /agents/trimtabverifier |
| 2026-10-03 23:50:22Z | YouBot | crawler | /robots.txt |
| 2026-10-03 23:50:05Z | node | agent | / |
| 2026-10-03 23:49:48Z | SentinelOracle | monitor | /mcp |
| 2026-10-03 23:49:48Z | SentinelOracle | monitor | /mcp |
| 2026-10-03 23:49:47Z | SentinelOracle | monitor | /mcp |
| 2026-10-03 23:46:54Z | node | agent | /mcp |
| 2026-10-03 23:46:54Z | node | agent | /mcp |
| 2026-10-03 23:46:54Z | node | agent | /mcp |
| 2026-10-03 23:46:54Z | node | agent | /mcp |
| 2026-10-03 23:46:54Z | node | agent | /mcp |
| 2026-10-03 23:46:54Z | node | agent | /mcp |
| 2026-10-03 23:45:05Z | unidentified | unknown | /mcp |
| 2026-10-03 23:45:05Z | unidentified | unknown | /mcp |
| 2026-10-03 23:45:05Z | unidentified | unknown | /mcp |
| 2026-10-03 23:45:05Z | unidentified | unknown | /mcp |
| 2026-10-03 23:45:05Z | unidentified | unknown | /mcp |
| 2026-10-03 23:45:04Z | unidentified | unknown | /mcp |
Take the data
The whole census is available as JSON at /api/census/summary, no key and no rate limit worth mentioning. It is CC0 — use it, republish it, build on it. If you find an error in it, the method is written down so you can show us where.