







158,059 papers, 554,670 citations, 872 verified errors followed through the literature. Half of the copied errors were still being copied 7 years later.
In defense of astrophysics
This post https://x.com/CJHandmer/status/2122609626588061816 has been making the rounds on X. The post claims to use Claude Opus 5.5 to identify 872 major errors in published astrophysics papers, described at https://science.caseyhandmer.com/physics/
Perspectives on Scientific Error 2027 · PSE9
Quotation errors in general science journals
Abstract. Due to the incremental nature of scientific discovery, scientific writing requires extensive referencing to the writings of others. The accuracy

Fabricated citations: an audit across 2·5 million biomedical papers
Scientific literature depends on the integrity of its references. Each reference implicitly asserts that a verifiable source exists and supports the claims being made. When references point to non-existent studies, readers, reviewers, and policy makers are unable to evaluate the evidence.

Fabricated citations: an audit across 2·5 million biomedical papers
Scientific literature depends on the integrity of its references. Each reference implicitly asserts that a verifiable source exists and supports the claims being made. When references point to non-existent studies, readers, reviewers, and policy makers are unable to evaluate the evidence.

Casey Handmer on Twitter / X
In my ongoing quest to find the limits of Opus 5.5, I directed it to audit my old scientific field, theoretical astrophysics. We indexed about 150,000 papers, audited 50,000 for issues, and did progressively more thorough checks on thousands more. We found nearly 1000 major… pic.twitter.com/VarvnTXohF— Casey Handmer (@CJHandmer) November 17, 2026
Quotation errors in general science journals
Due to the incremental nature of scientific discovery, scientific writing requires extensive referencing to the writings of others. The accuracy of this referencing is vital, yet errors do occur. These errors are called ‘quotation errors’. This paper presents the first assessment of quotation errors in high-impact general science journals. A total of 250 random citations were examined. The propositions being cited were compared with the referenced materials to verify whether the propositions could be substantiated by those materials. The study found a total error rate of 25%. This result tracks well with error rates found in similar studies in other academic fields. Additionally, several suggestions are offered that may help to decrease these errors and make similar studies more feasible in the future.

AI agents are checking the scientific literature — and spotting decades-old errors
The technology is proving adept at finding faults in decades-old papers and reference databases.

Science has been in a “replication crisis” for a decade. Have we learned anything?
Bad papers are still published. But some other things might be getting better.

Fraudulent citations, blamed on AI hallucinations, are becoming more common in research papers
“Fabricated” citations that do not reference real academic papers are spreading in the literature, polluting the public record of science, a new study found

Q&A from the slop trenches – GeoSpatial ML
We reviewed 22 ML conference submissions this summer. Fifteen had fabricated citations, hallucinated authors, or clear LLM slop, so we complain about that a bit, and release the paper references audit we now run.
Guest Post — When Errors Become Consensus: Science’s Self-Correction Can No Longer Keep Up - The Scholarly Kitchen
From 19th-century beef tea to paper mills and generative AI, the challenge is no longer detection alone; it is preventing bad claims from becoming embedded knowledge.

Is the scientific paper still a fraud?
How we write scientific papers does not reflect how we do science. Their formal structure infers a pre-ordained linear process rather than reflecting the messy creativity of research. This matters in the AI age because it masks the human in the process.
From Replication Rates to Replication Evidence: A Guest Editorial
Repeating original studies using existing data (reproducibility) or new data (replicability) is key to improving the credibility of scientific results. Here, we focus on replications, which can be…
Michael C. Frank on Twitter / X
New blog post: I used Claude to audit the reproducibility of every journal paper I've been an author on in the last five years. Our commitment to openness meant that the code and data were available, but there were some significant issues. 🧵https://t.co/O5pkxUM4Jx— Michael C. Frank (@mcxfrank) November 10, 2026