







Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence. Main Track. Pages 3365-3373.
On the Paradox of Learning to Reason from Data
Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence. Main Track. Pages 3365-3373.
Is AI Reasoning Right for the Wrong Reasons? | Quanta Magazine
The idea that artificial intelligence can “reason” is more intuitive than ever. But intuitions can be wrong, and the science is far from settled.

On the Paradox of Learning to Reason from Data
Logical reasoning is needed in a wide range of NLP tasks. Can a BERT model be trained end-to-end to solve logical reasoning problems presented in natural language? We attempt to answer this...

SmolLM3: smol, multilingual, long-context reasoner
We’re on a journey to advance and democratize artificial intelligence through open source and open science.

On the Paradox of Learning to Reason from Data
Logical reasoning is needed in a wide range of NLP tasks. Can a BERT model be trained end-to-end to solve logical reasoning problems presented in natural language? We attempt to answer this question in a confined problem space where there exists a set of parameters that perfectly simulates logical reasoning. We make observations that seem to contradict each other: BERT attains near-perfect accuracy on in-distribution test examples while failing to generalize to other data distributions over the exact same problem space. Our study provides an explanation for this paradox: instead of learning to emulate the correct reasoning function, BERT has in fact learned statistical features that inherently exist in logical reasoning problems. We also show that it is infeasible to jointly remove statistical features from data, illustrating the difficulty of learning to reason in general. Our result naturally extends to other neural models and unveils the fundamental difference between learning to reason and learning to achieve high performance on NLP benchmarks using statistical features.

On AI as model organism for human learning
I've a pretty taste for paradox

With the launch of o3-pro, let’s talk about what AI “reasoning” actually does
New studies reveal pattern-matching reality behind the AI industry's reasoning claims.

A New Approach to Computation Reimagines Artificial Intelligence | Quanta Magazine
By imbuing enormous vectors with semantic meaning, we can get machines to reason more abstractly — and efficiently — than before.

Epistemological Fault Lines Between Human and Artificial Intelligence
Large language models (LLMs) are widely described as artificial intelligence, yet their epistemic profile diverges sharply from human cognition. Here we show that the apparent alignment between...

Training Agentic Reasoners — Will Brown, Prime Intellect

The LLM Reasoning Debate Heats Up
Three recent papers examine the robustness of reasoning and problem-solving in large language models

Why Facts Don’t Change Our Minds
New discoveries about the human mind show the limitations of reason.

Why Facts Don’t Change Our Minds
New discoveries about the human mind show the limitations of reason.


Operadic consistency: a label-free signal for compositional...
Detecting LLM reasoning failures at inference time without ground-truth labels has motivated a wide range of confidence baselines, including self-consistency, semantic entropy, and P(True), built...
