AI Bots

August 7, 2026

Unveiling good and bad behaviors on the Agentic Internet

Cloudflare is shifting bot mitigation from point-in-time Risk assessment to continuous Trust evaluation. Learn how new good and bad behaviors from bots and agents are assessed by our systems, including BotBase and Precursor and try out our Precursor Trace simulation to see how your own cursor movements would be assessed as human or bot.

August 4, 2026

Announcing Cloudflare Wallets: the programmable wallet for the agentic Internet

Cloudflare Wallets will provide AI agents with native payments and verifiable identity on the web. Using the x402 protocol, agents can autonomously purchase APIs and content within clear safety guardrails.

July 1, 2026

Making AI search smarter

Search is how we find nearly everything on the web creators, merchants, answers. AI is rewriting the rules, leaving creators caught between staying discoverable in an agentic era and getting paid for their work. Today we're launching two initiatives to help.

July 1, 2026

Your site, your rules: new AI traffic options for all customers

For our second Content Independence Day, were giving website owners finer options to manage AI traffic. Instead of a one-size-fits-all block, all customers can now easily distinguish and manage Search, Agent, and Training bots, alongside the new ability to protect ad-monetized pages.

July 1, 2026

Announcing the Monetization Gateway: charge for any resource behind Cloudflare via x402

We're opening the waitlist for our Monetization Gateway, which will allow you to charge for any web page, dataset, API, or MCP tool behind Cloudflare. The charges will settle in stablecoins over the x402 open protocol, with no payments stack of your own to build.

January 30, 2026

Googles AI advantage: why crawler separation is the only path to a fair Internet

Google's dual-purpose crawler creates an unfair AI advantage. To protect publishers and foster competition, the UKs Competition and Markets Authority must mandate crawler separation for search and AI.

October 30, 2025

Policy, privacy and post-quantum: anonymous credentials for everyone

The world is adopting anonymous credentials for digital privacy, but these systems are vulnerable to quantum computers. This post explores the cryptographic challenges and promising research paths toward building new, quantum-resistant credentials from the ground up.

October 24, 2025

Securing agentic commerce: helping AI Agents transact with Visa and Mastercard

Cloudflare is partnering with Visa and Mastercard to help secure the future of agentic commerce.

September 24, 2025

To build a better Internet in the age of AI, we need responsible AI bot principles. Heres our proposal.

We are proposingas starting pointsresponsible AI bot principles that emphasize transparency, accountability, and respect for content access and use preferences.

September 3, 2025

AI Week 2025: Recap

How do we embrace the power of AI without losing control? That was one of our big themes for AI Week 2025. Check out all of the products, partnerships, and features we announced.

August 28, 2025

The next step for content creators in working with AI bots: Introducing AI Crawl Control

Cloudflare launches AI Crawl Control (formerly AI Audit) and introduces easily customizable 402 HTTP responses.

August 28, 2025

The age of agents: cryptographically recognizing agent traffic

Cloudflare now lets websites and bot creators use Web Bot Auth to segment agents from verified bots, making it easier for customers to allow or disallow the many types of user and partner directed.

August 4, 2025

Perplexity is using stealth, undeclared crawlers to evade website no-crawl directives

Perplexity is repeatedly modifying their user agent and changing IPs and ASNs to hide their crawling activity, in direct conflict with explicit no-crawl preferences expressed by websites.

July 1, 2025

Content Independence Day: no AI crawl without compensation!

Its Content Independence Day: Cloudflare, along with a majority of the world's leading publishers and AI companies, is changing the default to block AI crawlers unless they pay creators for content.

July 1, 2025

Introducing pay per crawl: Enabling content owners to charge AI crawlers for access

Pay per crawl is a new feature to allow content creators to charge AI crawlers for access to their content.

July 1, 2025

Message Signatures are now part of our Verified Bots Program, simplifying bot authentication

Bots can start authenticating to Cloudflare using public key cryptography, preventing them from being spoofed and allowing origins to have confidence in their identity.

July 1, 2025

From Googlebot to GPTBot: whos crawling your site in 2025

From May 2024 to May 2025, crawler traffic rose 18%, with GPTBot growing 305% and Googlebot 96%.

May 15, 2025

Forget IPs: using cryptography to verify bot and agent traffic

Bots now browse like humans. We're proposing bots use cryptographic signatures so that website owners can verify their identity. Explanations and demonstration code can be found within the post.