Tag: publishers

  • The Free Ride for AI Crawlers Just Ended

    Up until now, if your site ran ads and an AI company’s bot came crawling through to gather training data, there wasn’t much stopping it by default. Cloudflare just changed that, and the change goes live today. Starting now, Cloudflare is defaulting to blocking what it calls mixed-use crawlers, bots that quietly blend regular search…

  • Cloudflare just handed publishers the keys

    Cloudflare just handed publishers the keys

    Cloudflare gave site owners fine-grained control over how AI uses their content. Starting immediately, you can separate Search bots, Agent bots, and Training bots and handle each differently. Here’s what matters: if you run ads on a page, you can now block the bots that train on your writing but send no traffic back. Search…