← @bgSponge

The Agentic Web Index: AI Bot Traffic Statistics

Summary

Known Agents’ live index measures bot impersonation by comparing claimed identities with supported verification methods such as verified IP ranges or Web Bot Auth.

  1. Authenticate identity claims.

    A familiar bot name or user agent is insufficient; the index counts a visit as spoofed when it fails the identity’s supported verification method.

    A visit is considered spoofed when it claims a recognized agent identity but fails that agent's supported authentication method

    Agents without a supported authentication method are not included in these measurements.

  2. Separate the impersonated identity from the attacker.

    A failed check suggests that the named agent was spoofed but cannot attribute the request to its actual software or operator.

    A failed check indicates that the visit was likely impersonating the named agent

  3. Protect machine credentials as web targets.

    Recent probes sought configuration and secret-bearing files for Anthropic, Claude, Hermes, OpenClaw, Codex, cloud providers, package managers, and deployment environments.

  4. Read the percentages as a snapshot.

    The capture shows Googlebot at 0.5% of impersonated traffic and several AI-related identities at 0.1% or less, but the index updates daily.

  5. Preserve the sampling caveat.

    The dataset covers more than 5,000 participating websites whose composition can change, so it supports directional analysis rather than a global census.

    Results characterize the observed network and broader directional trends; they should not be interpreted as a precise census of global web traffic.

Read the original ↗Save to your Sponge

Summarized with Sponge. Quotes are the author’s own words.

More from @bg

All readings →