Cloudflare announces planned crawler defaults separating search, agent use and training

The archive provides Chinese and English research texts. Translations may be AI-assisted and may not yet have received independent human review. Consult the original-language sources alongside them.

Cloudflare announces planned 15 September defaults for specified customer groups: allow search but block training and agent access on advertising-supported pages, including mixed crawlers that do not separate purposes. Customers can change settings.

Source-page excerpt from “Cloudflare Allows the Agentic Internet to Flourish With a Simple Philosophy: Your Content, Your Rules”, captured on 1 October 2026. The original-language layout is retained; this is not a snapshot taken on the event date.
Source: Cloudflare; rights remain with the original holders.
Source · Cloudflare Allows the Agentic Internet to Flourish With a Simple Philosophy: Your Content, Your Rules ↗

Sources read · Research in progress

What changed

RESEARCH NOTE

Records the July announcement and scheduled date, not independently verified completion of deployment. No firewall or crawler settings on this archive were changed.

Editorial research question

Editorial interpretation: examines relationships between creative labour, permission and institutional responses in this record.

This is an editorial interpretation or question, separate from factual statements.

Evidence & sources

SRC-0416

New-defaults passage, lines 309–316, and dateline.

SRC-0416

Cloudflare Allows the Agentic Internet to Flourish With a Simple Philosophy: Your Content, Your Rules

Cloudflare · EN · 2026-07-01

Case

CASE-0002Cloudflare / AI crawler access controls

Cite this record

ANTI-AI ARCHIVE. “Cloudflare announces planned crawler defaults separating search, agent use and training.” evt-0346. Include this page’s URL and your access date when citing.