OpenAI, Google, Microsoft, Anthropic back shared AI scraping opt-out

OpenAI, Google, Microsoft and Anthropic say they will honour a new standard that lets publishers opt out of AI training scraping across companies at once. The shared 'policy token', proposed at the IETF by Anthropic standards lead Kevin Kelley, sits in a site's robots.txt file. The firms say their crawlers will stay away from sites carrying it, instead of publishers setting preferences individually.