How do AI agents show up in your website traffic?
AI agents can appear in website data in three different ways: as declared fetchers, as browser agents making interactive requests, or as sessions referred by an AI platform.
Latest
Topic
AI agents can appear in website data in three different ways: as declared fetchers, as browser agents making interactive requests, or as sessions referred by an AI platform.
Cloudflare AI Crawl Control lets website owners monitor AI crawler activity and create per-crawler allow or block policies for traffic passing through Cloudflare.
Search access logs for GPTBot, OAI-SearchBot, ChatGPT-User, PerplexityBot, Perplexity-User, ClaudeBot and Googlebot, but treat each match as a candidate rather than proof.
Coming soon
More reports in preparation