The Gell-Mann Amnesia Effect of AI is a pretty well documented phenomenon: The Gell-Mann amnesia effect is a cognitive bias describing the tendency of individuals to critically assess media reports in a domain they are knowledgeable about, yet continue to trust reporting in other areas despite recognizing similar potential inaccuracies.
AI Use Appears to Have a "Boiling Frog" Effect on Human Cognition, New Study Warns
A new study claims to offer the first causal link between AI dependency and cognitive erosion. Researchers warn of long-term implications.
Study Finds AI Use Eats Away at Users’ Confidence in Their Own Brains
A new study out of Middlesex University argues that the ultimate effects on an AI users' brain come down to how they use it.
Study: Sycophantic AI can undermine human judgment
Subjects who interacted with AI tools were more likely to think they were right, less likely to resolve conflicts.
What the Studies Say About How AI Affects Your Brain: A (Very Big) Compilation
The entire literature clearly points to a single surprising finding
Microsoft Study Finds AI Makes Human Cognition “Atrophied and Unprepared”
Researchers find that the more people use AI at their job, the less critical thinking they use.
Microsoft Study Finds AI Makes Human Cognition “Atrophied and Unprepared”
Researchers find that the more people use AI at their job, the less critical thinking they use.
Reality Monitoring in Large Language Models: Self-Knowledge That Transforms with Conversation Memory
A conversational AI that cannot tell its own output from what a user said will treat its own mistakes as user-provided facts. In humans, this capacity is called reality monitoring, and its failures are linked to hallucinations, delusions, and confabulation, yet whether LLMs possess it remains untested. Here we show, across two experiments and six LLMs, that source attribution depends on how conversational memory is structured: ceiling accuracy for self-generated content under minimal memory demands reverses to a fragile external-item advantage once episodic delay removes that shortcut. Feedback exposes two failures: in some models, internal and external judgments swap; in others, accuracy improves while confidence decouples from correctness, dissociations invisible to existing benchmarks. Across models, this pattern implicates active, not aggregate, parameter count. This suggests that as AI systems take on autonomous, multi-turn roles, evaluating what they know is not enough: tracking where that knowledge came from may matter equally.
People are getting their news from AI – and it’s altering their views
Even when information is factually accurate, how it’s presented can introduce subtle biases. As large language models increasingly bring people the news, this bias is a looming problem.
People are getting their news from AI – and it’s altering their views
Even when information is factually accurate, how it’s presented can introduce subtle biases. As large language models increasingly bring people the news, this bias is a looming problem.
Warning labels shift perceptions of sycophantic AI, but not its influence
Recent work has raised concerns about the influence of sycophantic AI on user judgment and relationships. One proposed mitigation, which has received regulatory attention, is to warn users about potentially harmful AI behaviors such as sycophancy. In a preregistered experiment in which participants (N = 2,610) discussed real interpersonal conflicts with an AI system, we test whether warning labels mitigate sycophancy's influence. We find that a basic AI disclosure (``This chatbot is AI'') has no detectable effect. Labeling the system as sycophantic (``...may agree with you and validate you even when you are wrong...'') does shift users' perceptions, reducing perceived objectivity and trust, but it does not reliably reduce sycophancy's influence on users' self-perceived rightness or their willingness to repair the conflict. Our results reveal a gap between AI perception and AI influence: by shifting perception without reducing influence, warning-based interventions may offer a false sense of protection. Addressing the harms of sycophancy will therefore require understanding the specific mechanisms through which it shapes judgment, and improving model behavior itself.
A Rational Analysis of the Effects of Sycophantic AI
People increasingly use large language models (LLMs) to explore ideas, gather information, and make sense of the world. In these interactions, they encounter agents that are overly agreeable. We argue that this sycophancy poses a unique epistemic risk to how individuals come to see the world: unlike hallucinations that introduce falsehoods, sycophancy distorts reality by returning responses that are biased to reinforce existing beliefs. We provide a rational analysis of this phenomenon, showing that when a Bayesian agent is provided with data that are sampled based on a current hypothesis the agent becomes increasingly confident about that hypothesis but does not make any progress towards the truth. We test this prediction using a modified Wason 2-4-6 rule discovery task where participants (N=557) interacted with AI agents providing different types of feedback. Unmodified LLM behavior suppressed discovery and inflated confidence comparably to explicitly sycophantic prompting. By contrast, unbiased sampling from the true distribution yielded discovery rates five times higher. These results reveal how sycophantic AI distorts belief, manufacturing certainty where there should be doubt.
AI assistants can sway writers’ attitudes, even when they’re watching for bias | Cornell Chronicle
Cornell Tech researchers found that writers who used biased AI auto-suggestions saw their views gravitate toward the AI’s positions without their realizing it — even when they were made aware of the biased AI.
AI Epistemic Risks: Emerging Mechanisms & Evidence
<p>Advances in artificial intelligence pose risks to humanity's collective capacity to form accurate beliefs, reason well, and maintain a healthy information en
AI Is a Mass-Delusion Event
Three years in, one of AI’s enduring impacts is to make people feel like they’re losing it.
Largest study of its kind shows AI assistants misrepresent news content 45% of the time – regardless of language or territory
An intensive international study was coordinated by the European Broadcasting Union (EBU) and led by the BBC
Do People Engage Cognitively with AI? Impact of AI Assistance on Incidental Learning
As part of the Digital Library's transition to Open Access, new features for researchers are available in the Premium Edition. Click here to learn more.