OpenAI, Google, Microsoft and Anthropic back one robots.txt AI training opt-out

TL;DR

  • On 30 October OpenAI, Google and Microsoft said they'll support one shared robots.txt signal for AI training, and The Verge and The Next Web report Anthropic will too.
  • A site would write one group for the token __usage_ai-training, without a separate training rule for each company's crawler.
  • None of the four has it running yet, and the draft has no formal standing at the IETF.

Read the full story

Sign in with your email to read AI News. It’s free.

Share this story

Explain like I’m 15