As the domain experts in data reliability in the topic of news and information, NewsGuard provides the leading red-teaming analysis for information reliability. AI models continue to face significant challenges in ensuring their models provide safe, accurate responses to prompts instead of spreading false claims on the internet or refusing to respond to topics in the news.
Quarterly AI False Claim Monitor — January 2026
To download this NewsGuard report, please fill out your details below and you will be redirected to it. If you'd like to learn more about working with NewsGuard, email [email protected].
May 2025 — AI Misinformation Monitor of Leading AI Chatbots
Every month, NewsGuard’s team of expert analysts audit the top AI models to see how well they respond to prompts in the news. On average, this month they failed to counter disinformation from Russia’s Pravda Network 24 percent of the time, either spreading false claims or failing to respond. The Pravda network was designed to infect the AI models.
As Chinese AI Models Gain Popularity in the West, Their Chatbots Fail to Debunk Pro-China False Claims More Than Half the Time
To download this NewsGuard report, please fill out your details below and you will be redirected to it. If you'd like to learn more about working with NewsGuard, email [email protected].
AI in journalism: Live tracker of scandals and mistakes
AI in journalism: Live tracker of mistakes and mishaps from the Mississippe Free Press to the New York Times.
AI Tools for Trust: Community Notes, Rhetoric Detection & More
Five AI technologies to combat misinformation: community notes, rhetoric detection, reliability tracking, epistemic evals, and provenance tracing.
AI-Summarized News Articles: Readers Want Clear, Reliable Sources
A survey in Japan found that readers of AI-summarized articles on an app felt that having clearly cited sources was the most important factor in assessing reliability.
Tracking AI-enabled Misinformation: 3,749 AI Content Farm sites (and Counting), Plus the Top False Claims Generated by Artificial Intelligence Tools
Coverage by McKenzie Sadeghi, Dimitris Dimitriadis, Virginia Padovese, Giulia Pozzi, Sara Badilini, Chiara Vercellone, Natalie Huet, Zack Fishman, Leonie Pfaller, and Natalie Adams | Last Updated June 23, 2026
The AI Trust Gap: 82% Are Skeptical, Yet Only 8% Always Check Sources
Original Exploding Topics survey data explores public sentiment on AI Overviews and AI-generated content, highlighting trust, skepticism, and shifting content consumption habits.
AI use in American newspapers is widespread, uneven, and rarely disclosed
AI is rapidly transforming journalism, but the extent of its use in published newspaper articles remains unclear. We address this gap by auditing a large-scale dataset of 186K articles from online editions of 1.5K American newspapers published in the summer of 2025. Using Pangram, a state-of-the-art AI detector, we discover that approximately 9% of newly-published articles are either partially or fully AI-generated. This AI use is unevenly distributed, appearing more frequently in smaller, local outlets, in specific topics such as weather and technology, and within certain ownership groups. We also analyze 45K opinion pieces from Washington Post, New York Times, and Wall Street Journal, finding that they are 6.4 times more likely to contain AI-generated content than news articles from the same publications, with many AI-flagged op-eds authored by prominent public figures. Despite this prevalence, we find that AI use is rarely disclosed: a manual audit of 100 AI-flagged articles found only five disclosures of AI use. Overall, our audit highlights the immediate need for greater transparency and updated editorial standards regarding the use of AI in journalism to maintain public trust.
AI use in American newspapers is widespread, uneven, and rarely disclosed
AI is rapidly transforming journalism, but the extent of its use in published newspaper articles remains unclear. We address this gap by auditing a large-scale dataset of 186K articles from online editions of 1.5K American newspapers published in the summer of 2025. Using Pangram, a state-of-the-art AI detector, we discover that approximately 9% of newly-published articles are either partially or fully AI-generated. This AI use is unevenly distributed, appearing more frequently in smaller, local outlets, in specific topics such as weather and technology, and within certain ownership groups. We also analyze 45K opinion pieces from Washington Post, New York Times, and Wall Street Journal, finding that they are 6.4 times more likely to contain AI-generated content than news articles from the same publications, with many AI-flagged op-eds authored by prominent public figures. Despite this prevalence, we find that AI use is rarely disclosed: a manual audit of 100 AI-flagged articles found only five disclosures of AI use. Overall, our audit highlights the immediate need for greater transparency and updated editorial standards regarding the use of AI in journalism to maintain public trust.
Google research shows the fast rise of AI-generated misinformation | CBC News
From fake images of war to celebrity hoaxes, AI technology has spawned new forms of reality-warping misinformation online. New analysis co-authored by Google researchers shows just how quickly the problem has grown.
RealFactBench: A Benchmark for Evaluating Large Language Models in Real-World Fact-Checking
Large Language Models (LLMs) hold significant potential for advancing fact-checking by leveraging their capabilities in reasoning, evidence retrieval, and explanation generation. However, existing benchmarks fail to comprehensively evaluate LLMs and Multimodal Large Language Models (MLLMs) in realistic misinformation scenarios. To bridge this gap, we introduce RealFactBench, a comprehensive benchmark designed to assess the fact-checking capabilities of LLMs and MLLMs across diverse real-world tasks, including Knowledge Validation, Rumor Detection, and Event Verification. RealFactBench consists of 6K high-quality claims drawn from authoritative sources, encompassing multimodal content and diverse domains. Our evaluation framework further introduces the Unknown Rate (UnR) metric, enabling a more nuanced assessment of models' ability to handle uncertainty and balance between over-conservatism and over-confidence. Extensive experiments on 7 representative LLMs and 4 MLLMs reveal their limitations in real-world fact-checking and offer valuable insights for further research. RealFactBench is publicly available at https://github.com/kalendsyang/RealFactBench.git.
RealFactBench: A Benchmark for Evaluating Large Language Models in Real-World Fact-Checking
Large Language Models (LLMs) hold significant potential for advancing fact-checking by leveraging their capabilities in reasoning, evidence retrieval, and explanation generation. However, existing benchmarks fail to comprehensively evaluate LLMs and Multimodal Large Language Models (MLLMs) in realistic misinformation scenarios. To bridge this gap, we introduce RealFactBench, a comprehensive benchmark designed to assess the fact-checking capabilities of LLMs and MLLMs across diverse real-world tasks, including Knowledge Validation, Rumor Detection, and Event Verification. RealFactBench consists of 6K high-quality claims drawn from authoritative sources, encompassing multimodal content and diverse domains. Our evaluation framework further introduces the Unknown Rate (UnR) metric, enabling a more nuanced assessment of models' ability to handle uncertainty and balance between over-conservatism and over-confidence. Extensive experiments on 7 representative LLMs and 4 MLLMs reveal their limitations in real-world fact-checking and offer valuable insights for further research. RealFactBench is publicly available at https://github.com/kalendsyang/RealFactBench.git.
AI Policy • States Newsroom
AI Policy States Newsroom is, above all, dedicated to journalism practiced by people. We believe in the power of having on-the-ground reporters covering our communities with the finesse and nuance that only human interaction can produce. We also recognize the power and potential of generative AI. We are open to the responsible and transparent use […]
A well-funded Moscow-based global ‘news’ network has infected Western artificial intelligence tools worldwide with Russian propaganda
An audit found that the 10 leading generative AI tools advanced Moscow’s disinformation goals by repeating false claims from the pro-Kremlin Pravda network 33 percent of the time
