TechPulse USA

Cloudflare Blocks AI Agents by Default — Web Shuts Its Door By TechPulse USA Newsroom | Oct. 18, 2026 Inside a Cloudflare office: the company's famous lava-lamp wall feeds its LavaRand encryption system. This month, Cloudflare — which sits in front of more than a fifth of the web — started blocking AI training and agent bots by default. Photo: HaeB / Wikimedia Commons, CC BY-SA 4.0. The entire AI agent economy was built on one quiet assumption: the open web would stay open. Agents need to read product pages, check prices, browse the news and fetch documents — the whole business model of the personal AI assistant depends on walking through doors that have been open for thirty years. This month, those doors started closing. Cloudflare, the infrastructure company sitting in front of more than a fifth of the web, flipped the default: AI agents and training crawlers are now blocked on ad-carrying pages unless a site owner explicitly lets them in. And the numbers say the lockout...

Photo: Meta's headquarters sign at 1 Hacker Way, Menlo Park. Nokia621 via Wikimedia Commons (CC BY-SA 4.0). Meta tried to quietly rewrite its commercial terms so that staying on Facebook, Instagram or WhatsApp for business would count as permission for Meta to crawl your website — and train its AI on whatever it found there. Newsrooms caught the clause within 48 hours. And now, in a Saturday-morning edit that The Verge first spotted, the AI-training wording has vanished from the document. Don't celebrate yet. The crawling authorisation — the automated software, the test credentials, the periodic re-crawls, the 30 October effective date — is all still there. Meta deleted one word, "train". It kept the whole machine. This is the platforms-versus-publishers fight entering its brazenest phase yet: the house tried to take the cut first, in the terms of service, and only retreated when lawyers called it "remarkable" to its face. The clause nobody was suppo...

By Daniel Rao London, October 17, 2026 The Guardian's chief executive and the Sun's publisher agree on precisely nothing — editorially, politically, morally — and on Friday they signed the same letter anyway. Anna Bateson of Guardian Media Group, Dominic Carter of the Sun, and six more of Britain's warring newspaper bosses put their names to a joint plea to Prime Minister Andy Burnham: back a new law that drags the internet's stealth bots into the light, forcing them to declare who runs them, how to reach them, and what they intend to do with the journalism they take. The target is Damian Hinds' Automated Online Software (Access and Transparency) Bill, a Private Members' Bill introduced in June that reached its second reading in Parliament on Friday, October 16. The industry wants the government to adopt it as its own — and the letter's closing argument is blunt: "The Hinds Bill is a modest fix." Modest, perhaps. But the signature list beneath ...