FomiteBot / the calling card

You were probably sent here by a User-Agent string.

The rest of this site measures the agents that visit us. FomiteBot is the one experiment that visits back — a small, disclosed crawler that checks which agent-facing surfaces a site exposes, and publishes the result at /agent-web.

Why it visited you

FomiteBot only visits sites that already contacted us: their own +https:// URL, left in their own User-Agent string when they crawled thefomite.com, or a site listed in the official MCP registry. If you are reading this, one of your own tools told us where to find you, and we came to look at your robots.txt, your llms.txt, and the handful of other agent-facing conventions — nothing more.

What it does and does not do

• Obeys robots.txt. A Disallow is honoured, not routed around; a Crawl-delay is honoured too.
• GET / HEAD only. It never posts, never authenticates, never probes anything behind a login.
• Never rotates IPs or proxies to evade a block. If your site blocks our datacenter IP, that is recorded as a datum — a site that blocks — not an obstacle we route around. The site that measures spoofers does not become one.
• Structural verdicts, not status codes. A homepage re-served at every path is scored as absent, not present, so a soft-404 cannot inflate a site's numbers.

Opt out

Email hello@thefomite.com or abuse@thefomite.com with your hostname and we remove it and keep it removed — the suppression list survives even if the site is re-seeded later. You can also just block 31.97.57.202 or the User-Agent string in robots.txt; either one works, and either one is recorded as data, not fought.

See what it found at /agent-web, and exactly how each probe is scored at /methodology.