Googlebot crawls roughly five pages for every visitor it sends back. That ratio held for two decades. It was the deal.
Cloudflare's Q1 2026 data shows what replaced it. Anthropic's ClaudeBot crawls 20,583 pages for every single referral it returns to publishers. Meta-ExternalAgent, the second-highest-volume AI crawler on the web, returns zero referrals. Not a rounding error. Zero.
89.4% of all AI crawler traffic serves training or mixed purposes. Only 2.2% responds to an actual human query. The cooperative norm still exists on paper. The economics underneath it inverted quietly, and then all at once.
