Scan at scaleSites with invalid Content Signals
Sites with invalid Content Signals
A site-wide report: one row per host, over the access rows the crawl emitted.
What this report returns
Content Signals are Cloudflare's robots.txt extension for stating how AI may use your content: search, ai-input, and ai-train, each set to yes or no.
These sites declare signals that won't register: a value outside the vocabulary, a missing key or value, a signal outside any User-agent group, or the same key set to two different values.
How to fix it. Write each entry inside a User-agent group as key=value with documented values, e.g. Content-Signal: search=yes, ai-train=no. (AIPREF content-usage is a separate vocabulary, not scored here.)
The columns it shows
Every defect this technology can carry is a column in the grid, worst first, so nothing is hidden behind a filter you have to know to apply.
- Host
host - Content Signals Valid
contentSignalsValid - Content Signals Findings
contentSignalsFindings - Content Signal Declared Values
contentSignalDeclaredValues - Content Signal Unknown Value Samples
contentSignalUnknownValueSamples - Content Signal Outside Group
contentSignalOutsideGroup - Content Signal Conflicting
contentSignalConflicting - Content Signal Unknown Value
contentSignalUnknownValue - Content Signal Empty Key/Value
contentSignalEmptyKeyValue
About Content Signals
Cloudflare's robots.txt vocabulary for search, AI input and AI training.
Read how Content Signals is checked, including the specification it is validated against and a worked correct and broken example.
Running it
This report ships in the Lumar agent-readiness container and appears on any project it is linked to, on every crawl. See the whole set, or check a single URL with the scanner on this site, which runs the same code with no account.