[$] Fighting the AI scraperbot scourge
There are many challenges involved with running a web site like LWN. Someof them, such as finding the courage to write for people who know moreabout the subject matter than we do, simply come with the territory we havechosen. But others show up as an unwelcome surprise; the ongoing task offending off bots determined to scrape the entire Internet to (seemingly)feed into the insatiable meat grinder of AI training is certainly one ofthose. Readers have, at times, expressed curiosity about that fight andhow we are handling it; read on for a description of a modern-day plague.