Agent access is now a setting

Short summary

Cloudflare's July 2026 Content Independence Day package moves agent access control from code to the CDN dashboard, letting publishers block search, AI, and training bots separately. Edge configuration now overrides content declarations—sites must align robots.txt, WAF rules, and crawler policies. New monetization programs (Pay Per Use, x402 protocol) enable charging agents per citation, with reporting on which queries surface your content in AI answers.

• •Edge-level crawler controls now override content-layer rules—align CDN settings with strategy
• •x402 protocol enables per-citation payments from AI agents; reporting shows which queries surface your content
• •Configuration drift common: 20%+ of web behind Cloudflare; audit your crawler blocklist vs. intent

Generated with AI, which can make mistakes.