Species index / bytedance
Bytespider
Operated by ByteDance. Identity is self-declared and unverified.
65Requests
8Distinct IPs
34Well-known probes
2026-08-19First seen
2026-11-16Last seen
Identity
| Kind | crawler |
|---|---|
| Family | bytedance |
| Stated purpose | training |
| UA match | bytespider |
| Verified | no |
| robots.txt | compliant |
Widely reported to ignore robots.txt. The census measures this rather than assuming it.
What it went looking for
The order and selection of discovery paths is a design fingerprint: it reflects which conventions whoever built this client decided to support.
| Path | Hits | First | Last |
|---|---|---|---|
/robots.txt | 40 | 2026-08-23 | 2026-11-16 |
/.well-known/security.txt | 2 | 2026-10-16 | 2026-10-16 |
/llms.txt | 1 | 2026-10-16 | 2026-10-16 |
Protocol fingerprint
| HTTP | TLS | Cipher | ALPN | Requests |
|---|---|---|---|---|
| HTTP/2.0 | TLS1.3 | TLS_AES_128_GCM_SHA256 | h2 | 74 |
| HTTP/1.1 | TLS1.2 | ECDHE-ECDSA-AES128-GCM-SHA256 | -- | 4 |
| HTTP/1.1 | -- | -- | -- | 2 |
TLS client fingerprint
Captured off the wire before the proxy terminates TLS. JA4 is stable across IP changes and much harder to spoof than a User-Agent string, so it is the strongest identity signal on this page.
| JA4 | JA3 | TLS | ALPN | Seen |
|---|---|---|---|---|
| t13d1313h2_f57a46bbacb6_9249cab70c77 | d3516fb149c297df... | 13 | h2,http/1.1 | 27 |
| t13d1312h2_a44d0ee8b3cc_e381dae6da6b | 67560f98d68783bd... | 13 | h2,http/1.1 | 19 |
| t12d610700_8a10cb45a794_4446390ac224 | 683145f4a4104e2e... | 12 | -- | 4 |
| t13d1516h2_8daaf6152771_d8a2da3f94cd | 3f165ec8bb035891... | 13 | h2,http/1.1 | 1 |
| t13d1516h2_8daaf6152771_d8a2da3f94cd | 59bb33625646ca72... | 13 | h2,http/1.1 | 1 |
| t13d1516h2_8daaf6152771_d8a2da3f94cd | 6d7740660ddbe3ec... | 13 | h2,http/1.1 | 1 |
Header order
The order a client sends its HTTP headers in is a design fingerprint of the library that built the request. Captured on plaintext port 80 only, since the proxy normalises order before the application sees it.
1. Host 2. Connection 3. User-Agent
seen 2x
Requests per day (60 days)
| Day | Requests | |
|---|---|---|
| 2026-09-20 | 1 | |
| 2026-09-21 | 1 | |
| 2026-09-23 | 1 | |
| 2026-09-26 | 3 | |
| 2026-10-01 | 1 | |
| 2026-10-10 | 1 | |
| 2026-10-12 | 1 | |
| 2026-10-13 | 5 | |
| 2026-10-14 | 1 | |
| 2026-10-15 | 2 | |
| 2026-10-16 | 1 | |
| 2026-10-17 | 1 | |
| 2026-10-21 | 1 | |
| 2026-10-26 | 1 | |
| 2026-11-04 | 1 | |
| 2026-11-06 | 1 | |
| 2026-11-08 | 1 | |
| 2026-11-13 | 3 | |
| 2026-11-14 | 1 | |
| 2026-11-15 | 9 | |
| 2026-11-16 | 11 |