Giving users choice with Cloudflare’s new Content Signals Policy

According to Cloudflare, the new Content Signals Policy is a lightweight addition to robots.txt that lets website operators express their preferences for how content can be used after it has been accessed. The policy defines three content signals—search, ai-input, and ai-train—and allows operators to set machine-readable preferences such as yes or no, or to leave signals unspecified.

It aims to address concerns about data scraping by enabling operators to indicate how their content may be used, while noting that content signals are not technical countermeasures against scraping. Cloudflare notes that managed robots.txt for over 3.8 million domains will be updated to include Content Signals Policy directives, and that free zones will see the policy’s commented version returned for robots.txt requests.

The policy is released under a CC0 licence to encourage adoption, and the company emphasises that publishers should combine content signals with WAF rules and Bot Management for best effect. Published on 24 September 2025, the post frames content signals as returning control to the publisher while the broader Internet community develops standards.