Copyright-ignoring AI scraper bots laugh at robots.txt so the IETF is trying to improve it
Recently formed AI Preferences Working Group has August deadline to develop ideas on how to tell crawlers to go away, or come for a feast The Internet Engineering Task Force has chartered a group it hopes will create a standard that lets content creators tell AI developers whether it's OK to use their work....