An update on the scraper situation

AI Scraping Bots Are Breaking Open Libraries, Archives, and Museums

"This is a moment where that community feels collectively under threat and isn't sure what the process is for solving the problem.”

Aggressive AI scrapers are making it kinda suck to run wikis

Bots are currently scraping the internet for LLM training data at unprecedented rates[1][2][3], driving up costs and destabilizing public-facing websites. I want to talk about how this has been particularly difficult for wikis, and has gotten much worse in the last few months.

Ultimate Block List to Stop AI Bots | Perishable Press

More than you might think, AI (Artificial Intelligence) and ML (Machine Learning) bots are crawling your site and scraping your content. They are...

Getting Bots to Respect Boundaries

Getting Bots to Respect Boundaries How AI Crawlers Are Straining Web Infrastructure Audrey HingleJanuary 2026 Image by Janet Turra & Cambridge Diversity Fundbetterimagesofai.org creativecommons.org/licenses/by/4.0 Contents Introduction: Setting up the Problem 3 Understandin...

How AI bots quietly dismantle paywalls via web search

ChatGPT and other AI chatbots have figured out how to get around paywalls through "live" web search—and they're doing it systematically and quietly across major publications, new Digital Digging research reveals.

Commence the Botwatch | Botwatch Blog

Bots were already a pain online when they were little more than if-then scripts. Now a tidal wave of slop is swamping the internet as big tech companies profit. OpenAI and the rest would love for you to believe they care about "alignment" and "values" while their AI models damage our communities, both online and off. It's time to fight back.

Reddit sues Anthropic over AI scraping that retained users’ deleted posts

Amazon’s revamped Alexa at center of Reddit’s legal fight with Anthropic.

AI-driven Bot Attacks Surged 12.5x According to Thales Bad Bot Report

Bots now dominate the internet, accounting for over half of all traffic, with 40% classified as malicious.AI is erasing the line between legitimate and maliciou

Open source project contains hidden instruction for “AI” agents: delete my code

It’s no secret there’s a war going on inside the open source community, with people adopting “AI” on one side, and those that want nothing to do with it on the other. While the former are, by nature, using destructive tactics like mass website scraping, license washing, taking people’s creative works without permission, taking all the RAM and GPUs, and oh, destroying the planet, the latter have mostly stuck to fairly benign things like policies banning “AI” use, “AI” bot blockers, and the occasional honey pot mazes to trap “AI” crawlers.

"Build protocols, not platforms"

Exploring the 'Protocols, Not Platforms' paper alongside a curated digest of recent AI crawler policy shifts and developer experiments.

Exclusive: Multiple AI companies bypassing web standard to scrape publisher sites, licensing firm says

Multiple artificial intelligence companies are circumventing a common web standard used by publishers to block the scraping of their content for use in generative AI systems, content licensing startup TollBit has told publishers.

What is a bot? | Learning Center

An Internet bot is a software application that runs automated tasks over the Internet, ranging from helpful crawlers to malicious attackers.

Early rogue AI agent activity and attempts to hack found on urlquery.net

We found evidence on urlquery that AI agents were active earlier than previously reported and attempted hacks against public data providers.

From LinkedIn to Tailored Attack in 30 Minutes: How AI Accelerates Target Profiling for Cybercrime | TrendAI (US)

The industrialization of AI-driven OSINT has transformed individual digital footprints into machine-readable intelligence at scale, enabling attackers to operationalize personalized reconnaissance at volume.