Article 6YHR8 Cloudflare wants Google to change its AI search crawling. Google likely won’t.

Cloudflare wants Google to change its AI search crawling. Google likely won’t.

by
Ashley Belanger
from Ars Technica - All content on (#6YHR8)

After Cloudflare started testing new features that would allow websites to block AI crawlers or require payment for scraping, the tech company immediately faced questions over the logistics of the plan.

In particular, website owners and SEO experts wanted to know how Cloudflare planned to block Google's bot from scraping sites to fuel AI overviews without risking blocking the same bot from crawling for valuable search engine placements.

Last week, a travel blogger raised questions about the blocking and so-called pay-per-crawl features and pushed Cloudflare CEO Matthew Prince to respond on X (formerly Twitter):

Read full article

Comments

External Content
Source RSS or Atom Feed
Feed Location http://feeds.arstechnica.com/arstechnica/index
Feed Title Ars Technica - All content
Feed Link https://arstechnica.com/
Reply 0 comments