Tag: cloudflare

  • The Free Ride for AI Crawlers Just Ended

    Up until now, if your site ran ads and an AI company’s bot came crawling through to gather training data, there wasn’t much stopping it by default. Cloudflare just changed that, and the change goes live today. Starting now, Cloudflare is defaulting to blocking what it calls mixed-use crawlers, bots that quietly blend regular search…