Article 6YJ9Y [$] Anubis sends AI scraperbots to a well-deserved fate

[$] Anubis sends AI scraperbots to a well-deserved fate

by
jzb
from LWN.net on (#6YJ9Y)

Few, if any, web sites or web-based services have gone unscathed bythe locust-like hordes of AI crawlers looking to consume (and thenre-consume) all of the world's content. The Anubis project is designed toprovide a first line of defense that blocks mindless bots-whilegranting real users access to sites without too much hassle. Anubis isa young project, not even a year old. However, its development ismoving quickly, and the project seems to be enjoying rapidadoption. The most recent release of Anubis, version1.20.0, includes a feature that many users have been interested insince the project launched: support for challenging clients withoutrequiring users to have JavaScript turned on.

External Content
Source RSS or Atom Feed
Feed Location http://lwn.net/headlines/rss
Feed Title LWN.net
Feed Link https://lwn.net/
Reply 0 comments