← AI news

OpenAI will honor a shared robots.txt signal for AI training

OpenAISafety and rules
Who it's for
Website owners
Where it works
Robots.txt files

Key points

  • OpenAI will honor a shared signal
  • Sites state AI training preferences in robots.txt
  • Website owners gain more say over content

What happened

OpenAI says it will honor a shared robots.txt signal that website operators can use to state their preferences for AI training. Robots.txt is a short text file that tells automated crawlers which pages they may visit.

Why it matters

Website owners get one common way to say whether their pages may be used to train AI models. It gives them more say over their own content.

What to do

  • Watch for OpenAI's documentation on the signal's name
  • No change is needed yet
Source

Written with AI from the source above. If something looks off, the source is what counts.

Read next