Layer 6 / passive census
The census
Everything below is derived from this site's own request log. Nothing is modelled, sampled or estimated. Method is at /methodology.
Discovery: which conventions agents actually use
Every well-known path is served here. Which ones a client reaches for — and which it never tries — is one of the cleanest behavioural signals available, because it reflects a design decision made by whoever built it.
| Path | Distinct clients | Hits |
|---|---|---|
/robots.txt | 34 | 3,429 |
/llms.txt | 18 | 321 |
/.well-known/security.txt | 18 | 50 |
/openapi.json | 17 | 416 |
/sitemap.xml | 16 | 1,224 |
/.well-known/mcp-manifest-attestation | 14 | 38 |
/.well-known/agent.json | 13 | 104 |
/.well-known/oauth-authorization-server | 12 | 427 |
/.well-known/oauth-protected-resource | 11 | 493 |
/llms-full.txt | 10 | 25 |
/.well-known/oauth-protected-resource/mcp | 8 | 60 |
/.well-known/agent-card.json | 6 | 365 |
/.well-known/openid-configuration | 6 | 19 |
/.well-known/glama.json | 5 | 43 |
/.well-known/fomite.json | 5 | 25 |
/ai.txt | 5 | 12 |
/.well-known/oauth-authorization-server/mcp | 4 | 5 |
/.well-known/x402 | 3 | 509 |
/.well-known/mcp.json | 3 | 14 |
/.well-known/ai-plugin.json | 3 | 4 |
/.well-known/did.json | 2 | 23 |
/.well-known/openid-configuration/mcp | 2 | 2 |
/.well-known/x402.json | 1 | 150 |
/.well-known/owners.json | 1 | 92 |
/.well-known/mcp-probing.json | 1 | 6 |
/.well-known/agent-skills/index.json | 1 | 1 |
/llms-full.txt): | 1 | 1 |
/.well-known/fomite.json): | 1 | 1 |
/.well-known/brick-blue.json | 1 | 1 |
/.well-known/mcp | 1 | 1 |
/.well-known/openai-apps-challenge | 1 | 1 |
Wire sensor
Read straight off the network interface, before the proxy terminates TLS or normalises anything. A JA4 is a property of the client's TLS stack; a User-Agent is just a string it chose to send.
One fingerprint, more than one claimed identity
These JA4s turned up under two or more different User-Agent identities. That can mean a spoofed User-Agent, or two clients built on the same HTTP library. Either way it is worth a look, and it is invisible without the sensor.
| JA4 | Claimed identities | Connections |
|---|---|---|
| t13d1312h2_a44d0ee8b3cc_e381dae6da6b | 402explorer, AgenstryBot, AgentAlmanac-Snapshot, agent-evidence-scanner, AgentIndexBot, agent-tools.cloud, agent-trust-index, agent-world-probe, AhrefsBot, aiohttp, aisec-registry, AIVE-MCP, AIVE-MCP-Discover, AIVE-MCP-EndpointProbe, Amazonbot, Applebot, axios, bingbot, Bytespider, catalog-health, CCBot, Censys, ChatGPT-User, ClaudeBot, Claude-SearchBot, Claude-User, cohere-ai, curl, DataForSeoBot, Deno, DuckAssistBot, facebookexternalhit, fomite-health, Go-http-client, Googlebot, GoogleOther, GPTBot, Headless Chrome, httpx, hultra-link, internet-measurement, lastseen, mcpbeat, mcpcensus, MCP-Cloud-AboutBot, mcphq-probe, MCPMeter, mcpqueen-grader, mcp-rugpull-research, mcp-scraper, MCP-Stats-Prober, MCPWatch, measure-mcp-schema, meta-externalagent, MJ12bot, node, OAI-SearchBot, OkHttp, Pandalytics, PanelMonitor, PerplexityBot, PetalBot, ProofBench, python-requests, reliability-bureau-spike, Scrapy, SemrushBot, SentinelOracle, serpstatbot, skillex-enrichment, spanly-enrich, toolpin-crawler, TrimtabVerifier, undici, Uptime monitor, utopian-foundry-probe, VerifyMCP, Vouch-Census, x402-observatory, YandexBot, YouBot | 53,016 |
| t13d1311h2_a44d0ee8b3cc_485d6013ba69 | 402explorer, AgentIndexBot, agent-tools.cloud, agent-world-probe, AhrefsBot, AIVE-MCP-Discover, AIVE-MCP-EndpointProbe, bingbot, fomite-health, Go-http-client, Googlebot, GPTBot, httpx, mcpbeat, mcpcensus, MJ12bot, node, OAI-SearchBot, PanelMonitor, PetalBot, ProofBench, python-requests, reliability-bureau-spike, SemrushBot, SentinelOracle, undici, Uptime monitor | 683 |
| t13d5212h1_b262b3658495_8e6e362c5eac | AIVE-MCP, AIVE-MCP-Discover, AIVE-MCP-EndpointProbe, api-forge-mcp-index, facebookexternalhit, Headless Chrome, mcpgrade-probe, MCPMeter, MCPWitness, node, reliability-bureau-spike, spanly-enrich, undici, Vouch-Census, zevruna-monitor | 10,964 |
| t13d1516h2_8daaf6152771_d8a2da3f94cd | AhrefsBot, bingbot, Bytespider, DomainArrivals, FossickBot, Headless Chrome, node, PanelMonitor, TikTokSpider | 72 |
| t13d131100_f57a46bbacb6_ab7e3b40a677 | bingbot, curl, DuckAssistBot, Googlebot, mcpbeat, PetalBot, Wget | 8,303 |
| t13d1713h1_ab0a1bf427ad_ecd0401ec68b | aiohttp, aisec-registry, Claude-User, httpx, loop-mcp-catalog-fetch, ProwlBot, YouBot | 3,306 |
| t13d5911h1_a33745022dd6_1f22a2ca17c4 | node, rootz-mcp-registry-prober, SaSameAgentAudit, SentinelOracle, undici, zerm-tool-census | 7,873 |
| t13d1312h2_f57a46bbacb6_ab7e3b40a677 | catalog-health, DuckAssistBot, facebookexternalhit, Go-http-client, mcpbeat, VerifyMCP | 314 |
| t13d1812h1_85036bcba153_d41ae481755e | AgenstryBot, aiohttp, httpx, measure-mcp-schema, PetalBot | 248 |
| t13d1712h1_ab0a1bf427ad_8e6e362c5eac | aiohttp, httpx, humata-mcp-registry-probe, loop-mcp-catalog-fetch, MCPWatch | 241 |
| t13d1011h2_61a7ad8aa9b6_3fcd1a44f3e3 | ClaudeBot, Deno, GPTBot, OAI-SearchBot | 1,026 |
| t13d3112h1_e8f1e7e78f70_d41ae481755e | agent-tools.cloud, aiohttp, httpx, mcp-rugpull-research | 372 |
| t13d181100_85036bcba153_d41ae481755e | agent-evidence-scanner, aiohttp, mcpcensus, PerplexityBot | 356 |
| t13d521100_b262b3658495_8e6e362c5eac | axios, curl, facebookexternalhit, node | 59 |
| t13d1714h1_5b57614c22b0_43ade6aba3df | curl, hultra-link, mcphq-probe, understory | 54 |
| t13d591000_a33745022dd6_1f22a2ca17c4 | axios, ClaudeBot, Uptime monitor | 1,542 |
| t13d171200_ab0a1bf427ad_ecd0401ec68b | mcp-drift-monitor, MCP-Stats-Prober, TrashHound-Wildcard-Resolver | 168 |
| t13d1812h1_85036bcba153_b26ce05bbdd6 | MCP-Cloud-AboutBot, python-requests, Uptime monitor | 16 |
| t13d1516h2_8daaf6152771_806a8c22fdea | AhrefsBot, Claude-User, Headless Chrome | 11 |
| t13d1712h1_ab0a1bf427ad_882d495ac381 | Headless Chrome, MCPWatch, python-requests | 4 |
| t13d181300_e8a523a41297_43ade6aba3df | Googlebot, GoogleOther | 2,515 |
| t13d1011h1_61a7ad8aa9b6_3fcd1a44f3e3 | 402explorer, Googlebot | 1,081 |
| t13d3112h2_e8f1e7e78f70_b26ce05bbdd6 | AhrefsBot, curl | 934 |
| t13d3111h2_e8f1e7e78f70_5ac7197df9d2 | facebookexternalhit, meta-externalagent | 797 |
| t13d1712h2_5b57614c22b0_ef7df7f74e48 | ChatGPT-User, OAI-SearchBot | 190 |
By family
| Family | Clients | Requests |
|---|---|---|
| mcp-ecosystem | 41 | 18,380 |
| toolkit | 13 | 8,618 |
| monitoring | 1 | 5,808 |
| fleet-internal | 2 | 1,638 |
| agent-directory | 20 | 1,216 |
| huawei | 1 | 949 |
| seo | 5 | 849 |
| openai | 3 | 787 |
| agent-payment | 2 | 425 |
| 2 | 359 | |
| anthropic | 3 | 232 |
| amazon | 1 | 176 |
| microsoft | 1 | 168 |
| apple | 1 | 148 |
| meta | 2 | 117 |
| social | 3 | 111 |
| unknown | 1 | 108 |
| bytedance | 2 | 72 |
| security | 2 | 65 |
| perplexity | 2 | 58 |
| you | 1 | 44 |
| search | 1 | 29 |
| duckduckgo | 1 | 29 |
| cohere | 1 | 9 |
| research | 1 | 9 |
| diffbot | 1 | 4 |
Most-requested paths (30 days, non-human only)
| Path | Requests |
|---|---|
/mcp | 69,294 |
/ | 40,781 |
/api/census/summary | 2,972 |
/api/wire | 2,867 |
/robots.txt | 1,478 |
/api/glitchtip-status | 1,440 |
/api/vault/stats | 978 |
/.well-known/agent.json | 639 |
/api/hello | 577 |
/.well-known/agent-card.json | 545 |
/api/beacon | 505 |
/api/vault/community_codes | 489 |
/llms.txt | 415 |
/sitemap.xml | 387 |
/wp-admin/install.php | 366 |
/.well-known/oauth-protected-resource | 294 |
/randomness | 279 |
/favicon.svg | 243 |
/openapi.json | 222 |
/.well-known/oauth-protected-resource/mcp | 216 |
Recent arrivals
| Time (UTC) | Client | Kind | Path |
|---|---|---|---|
| 2026-11-18 17:39:31Z | ClaudeBot | crawler | /threshold |
| 2026-11-18 17:39:15Z | Uptime monitor | scanner | / |
| 2026-11-18 17:37:15Z | Uptime monitor | scanner | / |
| 2026-11-18 17:37:11Z | unidentified | unknown | / |
| 2026-11-18 17:36:33Z | unidentified | unknown | /mcp |
| 2026-11-18 17:36:33Z | unidentified | unknown | /mcp |
| 2026-11-18 17:36:06Z | node | agent | / |
| 2026-11-18 17:35:15Z | Uptime monitor | scanner | / |
| 2026-11-18 17:33:26Z | ClaudeBot | crawler | / |
| 2026-11-18 17:33:25Z | ClaudeBot | crawler | /robots.txt |
| 2026-11-18 17:33:15Z | Uptime monitor | scanner | / |
| 2026-11-18 17:32:10Z | unidentified | unknown | / |
| 2026-11-18 17:31:15Z | Uptime monitor | scanner | / |
| 2026-11-18 17:31:06Z | node | agent | / |
| 2026-11-18 17:30:54Z | unidentified | unknown | /api/census/summary |
| 2026-11-18 17:30:52Z | SentinelOracle | monitor | /mcp |
| 2026-11-18 17:30:51Z | SentinelOracle | monitor | /mcp |
| 2026-11-18 17:30:51Z | SentinelOracle | monitor | /mcp |
| 2026-11-18 17:30:48Z | unidentified | unknown | /api/wire |
| 2026-11-18 17:30:03Z | fomite-health | monitor | /api/glitchtip-status |
| 2026-11-18 17:29:15Z | Uptime monitor | scanner | / |
| 2026-11-18 17:28:43Z | unidentified | unknown | /agents/internet-measurement |
| 2026-11-18 17:27:15Z | Uptime monitor | scanner | / |
| 2026-11-18 17:27:09Z | unidentified | unknown | / |
| 2026-11-18 17:26:40Z | node | agent | / |
| 2026-11-18 17:25:20Z | Uptime monitor | scanner | / |
| 2026-11-18 17:23:45Z | unidentified | unknown | /api/hello |
| 2026-11-18 17:23:40Z | unidentified | unknown | /wp-admin/install.php |
| 2026-11-18 17:23:16Z | Uptime monitor | scanner | / |
| 2026-11-18 17:22:20Z | unidentified | unknown | / |
| 2026-11-18 17:21:15Z | Uptime monitor | scanner | / |
| 2026-11-18 17:21:06Z | node | agent | / |
| 2026-11-18 17:20:34Z | unidentified | unknown | /mcp |
| 2026-11-18 17:20:34Z | unidentified | unknown | /mcp |
| 2026-11-18 17:20:34Z | unidentified | unknown | /mcp |
| 2026-11-18 17:20:18Z | PetalBot | crawler | /.well-known/mcp-manifest-attestation |
| 2026-11-18 17:19:38Z | mcpbeat | monitor | /mcp |
| 2026-11-18 17:19:38Z | mcpbeat | monitor | /mcp |
| 2026-11-18 17:19:38Z | mcpbeat | monitor | /mcp |
| 2026-11-18 17:19:38Z | mcpbeat | monitor | /mcp |
| 2026-11-18 17:19:38Z | mcpbeat | monitor | /mcp |
| 2026-11-18 17:19:15Z | Uptime monitor | scanner | / |
| 2026-11-18 17:18:54Z | PetalBot | crawler | /agents/agentalmanac |
| 2026-11-18 17:17:31Z | PetalBot | crawler | /agents/agentsure-mcpscan |
| 2026-11-18 17:17:15Z | Uptime monitor | scanner | / |
| 2026-11-18 17:17:10Z | unidentified | unknown | / |
| 2026-11-18 17:16:09Z | SentinelOracle | monitor | /mcp |
| 2026-11-18 17:16:09Z | SentinelOracle | monitor | /mcp |
| 2026-11-18 17:16:08Z | SentinelOracle | monitor | /mcp |
| 2026-11-18 17:16:08Z | PetalBot | crawler | /agents/ahrefsbot |
Take the data
The whole census is available as JSON at /api/census/summary, no key and no rate limit worth mentioning. It is CC0 — use it, republish it, build on it. If you find an error in it, the method is written down so you can show us where.