Cloudflare’s AI Crawler Rules Can Block Googlebot

Cloudflare is updating its method of identifying and blocking AI crawlers, which may result in Googlebot being blocked on sites that prevent AI training. The company announced the update as part of its second Content Independence Day. The new controls let websites manage automated traffic based on three behaviors rather than a single “block AI

Read the full article

Published by searchenginejournal.com