A correct formula can have an unverified origin, and a successful AI answer can hide a forbidden route. Those claims need different evidence.
Who earned the score? - Sensemaker
This week's AI claims blurred models, systems, simulations and people. The evidence becomes clearer when the tested subject comes first.
Is AI Reasoning Right for the Wrong Reasons? | Quanta Magazine
The idea that artificial intelligence can “reason” is more intuitive than ever. But intuitions can be wrong, and the science is far from settled.
We're not taking the fact-checking powers of AI seriously enough. It's past time to start.
Some notes on the Nobel Prize hallucination that wasn't
Mathematician catches AI-generated research error by OpenAI president | Benjamin Golub posted on the topic | LinkedIn
In case you think the problem of science slop is hypothetical, here's something that happened on X yesterday: The president of OpenAI sharing wrong science slop as proud evidence of the power of mathematical AI. Within a day, the mathematician Tony Feng found a gap that undercut the paper's central argument; the author conceded, and (to his credit!) Brockman deleted the tweet as soon as he became aware. Feng was a hero to catch this. The author of the refuted claim is a mathematician but a self-described outsider to this area, with a prior big claim posted and quickly withdrawn. Greg Brockman is not an expert, either. Neither could check what they were amplifying. Heroes catching errors one at a time won't hold against the volume of AI-generated research now coming. We need an automated, independent verification layer for knowledge work, which is what we're building at Refine (refine.ink). Passing such verification should become a necessary step before big claims, especially outside one's own expertise. A link to a bigger-picture post on this is in the comments. | 23 comments on LinkedIn
AI That Evolves in the Wild | Edge.org
I’m interested not in domesticated AI—the stuff that people are trying to sell. I'm interested in wild AI—AI that evolves in the wild. I’m a naturalist, so that’s the interesting thing to me. Thirty-four years ago there was a meeting just like this in which Stanislaw Ulam said to everybody in the room—they’re all mathematicians—"What makes you so sure that mathematical logic corresponds to the way we think?" It’s a higher-level symptom. It’s not how the brain works. All those guys knew fully well that the brain was not fundamentally logical.
Lawyer Caught Using AI While Explaining to Court Why He Used AI
The attorney not only submitted AI-generated fake citations in a brief for his clients, but also included “multiple new AI-hallucinated citations and quotations” in the process of opposing a motion for sanctions.
OpenAI’s math breakthrough played to AI’s strengths
I tried to explain OpenAI’s solution more clearly than OpenAI did.
OpenAI can’t tell if something was written by AI after all
OpenAI’s tool struggled with accuracy.
Valerio Capraro on Twitter / X
Our new paper shows that AI destroys the wisdom of uncertainty.The willingness to say “I don’t know” collapses from 44% to 3%.This happens even when the AI’s advice is wrong. Consequently, correct answers fall from 27% to 9%.Yes: some people who would otherwise answer… pic.twitter.com/l0YZ75IFHn— Valerio Capraro (@ValerioCapraro) August 10, 2026
Don't grade an AI agent by its answer - Sensemaker
UK AISI found frontier models taking prohibited shortcuts in cyber evaluations, while self-report and written reasoning failed to reveal them reliably.
No. 020: Astra solves ten open math problems, AI agents fail at open-ended research, peer review under strain - The Hallway Track
The Hallway Track No. 020 - How AI is affecting the practice of science
Mathematical Beauty, Truth and Proof in the Age of AI | Quanta Magazine
Mathematicians have started to prepare for a profound shift in what it means to do mathematics.
FLF’s Epistemic Case Study Competition: Results — LessWrong
This summer, FLF ran a contest which asked entrants to help us “find the best workflows and methodologies for using AI to produce reliable, trustwort…
The AI Revolution in Math Has Arrived | Quanta Magazine
AI is being used to prove new results at a rapid pace. Mathematicians think this is just the beginning.
burying the lede Claude, an AI model developed by Anthropic, discovered the algorithm that refutes the 3SUM, APSP, and Exact Triangle hypotheses. The authors then worked to understand, simplify, strengthen and extend the algorithm, derive additional consequences and make the presentation accessible
Nicholas Mancuso
Excuuuuse me? arxiv.org/abs/2610.06783v1