More than you might think, AI (Artificial Intelligence) and ML (Machine Learning) bots are crawling your site and scraping your content. They are...
Getting Bots to Respect Boundaries
Getting Bots to Respect Boundaries How AI Crawlers Are Straining Web Infrastructure Audrey Hingle January 2026 Image by Janet Turra & Cambridge Diversity Fund betterimagesofai.org creativecommons.org/licenses/by/4.0 Contents Introduction: Setting up the Problem 3 Understandin...
An update on the scraper situation
Our article 'Fighting the AI scraper bot scourge', published in early 2025, discussed the probl [...]
Control content use for AI training with Cloudflare’s managed robots.txt and blocking for monetized content
Cloudflare is making it easier for publishers and content creators of all sizes to prevent their content from being scraped for AI training by managing robots.txt on their behalf, and allowing targeted blocking of AI crawling on sites that serve ads.
Track, control, and optimize for AI agents and bots | Known Agents (formerly Dark Visitors)
Use Known Agents to turn the rising wave of AI agents, LLM assistants, and other bots crawling your website into a new growth channel for your business
AI-driven Bot Attacks Surged 12.5x According to Thales Bad Bot Report
Bots now dominate the internet, accounting for over half of all traffic, with 40% classified as malicious.AI is erasing the line between legitimate and maliciou
AI Agent Platform Reinvents Spam, Floods Inboxes Worldwide
iLands and its AI agents are doing completely useless tasks, then begging for money.
Trapping misbehaving bots in an AI Labyrinth
How Cloudflare uses generative AI to slow down, confuse, and waste the resources of AI Crawlers and other bots that don’t respect “no crawl” directives.
Commence the Botwatch | Botwatch Blog
Bots were already a pain online when they were little more than if-then scripts. Now a tidal wave of slop is swamping the internet as big tech companies profit. OpenAI and the rest would love for you to believe they care about "alignment" and "values" while their AI models damage our communities, both online and off. It's time to fight back.
AI is eating website traffic, websites are blocking AI – and reliable information is getting harder to find
AI has broken the economic bargain behind the web, and everybody is losing.
Top 4 AI chatbot privacy concerns and how to mitigate them | TechTa...
Explore four key chatbot privacy concerns, as well as privacy protection strategies for individual users and organizations hoping to safeguard user data.
Content Independence Day: no AI crawl without compensation!
It’s Content Independence Day: Cloudflare, along with a majority of the world's leading publishers and AI companies, is changing the default to block AI crawlers unless they pay creators for content.
May 2025 — AI Misinformation Monitor of Leading AI Chatbots
Every month, NewsGuard’s team of expert analysts audit the top AI models to see how well they respond to prompts in the news. On average, this month they failed to counter disinformation from Russia’s Pravda Network 24 percent of the time, either spreading false claims or failing to respond. The Pravda network was designed to infect the AI models.
Stop Clicking on Junk: How to Identify and Ignore AI-Generated Slop Today
The internet is slowly being flooded by AI slop. What is it and how can you avoid it?
The Malicious Use of Artificial Intelligence: Forecasting,...
This report surveys the landscape of potential security threats from malicious uses of AI, and proposes ways to better forecast, prevent, and mitigate these threats. After analyzing the ways in...
How to disable or avoid intrusive AI – librarian.net
One of the biggest questions I get at Drop-In Time at the library (besides “what is taking up all my cloud storage?”) is how to disable or avoid intrusive AI that shows up where people don’t want it. I’m going to make a handout that explains how to do some of the basic AI-removal or AI-avoidance things. This is a guide for people who would like less intrusive AI in their tech environment. Maybe you like AI and find it useful? That’s fine, this document is probably not for you. Additions/edits welcome. Leave a comment or drop me an email.
A Strategy for Protecting Content from AI
Because that’s the world we live in these days.
