This particular note is around exploring cognitive surrender: uncritically accepting whatever agents output without actually thinking, exploring or considering alternatives. Working this way is extremely fast, not particularly taxing, and unsurprisingly seductive.
Cognitive Surrender
Cognitive offloading is delegating to the AI and still owning the answer. Cognitive surrender is when the AI's output quietly becomes your output and there i...
"Cognitive surrender" leads AI users to abandon logical thinking, research finds
Experiments show large majorities uncritically accepting "faulty" AI answers.
Cognitive Surrender and Tri-System Theory · Today I Learned
How AI can support, displace, or bypass human deliberation
Intention, control, and the feeling of commitment
In this paper we propose that rational control of action, agentive stability over time, and coordinated social behavior, are assisted by a form of metacognitive monitoring, leading to an aspect of conscious experience: a feeling of commitment. This feeling of commitment is attached to the formation, retrieval, and execution of intentions. The metacognitive monitoring that produces it is sensitive to the importance of intentions. And the feeling of commitment facilitates the stability and effectiveness of intentions across individual and social contexts, strengthens goal shielding, biases intention retrieval, and thus structures prospective deliberation, expression of intention, and execution of intention. In section two, we discuss control, which is a central aspect of agency and action. In section three, we discuss a crucial part of control: intention. We also discuss a crucial part of intention: commitment. In section four we relate the commitment involved in intention with definitions of commitment in the literature. In section five we offer and elucidate our hypothesis.
Impact, agency, and taste
understand + work backwards from the root goal • don’t rely too much on permission or encouragement • make success inevitable • find your angle • think real hard • reflect on your thinking
Movements of the Mind: A Theory of Attention, Intention and Action
Abstract. Movements of the Mind explains what it is to be an agent. Focusing on mental agency, the book’s eponymous topic, it investigates an agent’s doing
Via Negativa: The Process of Making Good Decisions By Eliminating Bad Ones
When we set goals—both personal and professional—we tend to focus on what we should do, rather than focussing on what we should avoid. Humans naturally know more about what is wrong, what is bad, what is harmful, or what won’t work, more than they know about what is right and what would work.
The Care of the Self within a Biopolitical Paradigm: Integrating Cognitive Psychology to resist Subjectification
Contemporary theories of resistance to biopolitical subjectification often reify unfreedom by lacking a plausible model of agency. This thesis resolves this by establishing an ontological foundation for the agent as fundamentally autopoietic and semiotic, drawing on contemporary cognitive science. It then proposes a new foundation for resistance by synthesizing Michel Foucault’s later work on the care of the self with the 4P/5E model of embodied cognition. I show how this interdisciplinary approach establishes Foucault’s ethical techniques as a systematic ecology of practices for cultivating a free, self-determining agent and by reframing resistance as a practical, embodied ethics of self-formation, it inherently fosters two vital skills: the gain of self-knowledge and self-mastery.
Thinking—Fast, Slow, and Artificial: How AI is Reshaping Human Reasoning and the Rise of Cognitive Surrender
People increasingly consult generative artificial intelligence (AI) while reasoning. As AI becomes embedded in daily thought, what becomes of human judgment? We introduce Tri-System Theory, extending dual-process accounts of reasoning by positing System 3: artificial cognition that operates outside the brain. System 3 can supplement or supplant internal processes, introducing novel cognitive pathways. A key prediction of the theory is “cognitive surrender”—adopting AI outputs with minimal scrutiny, overriding intuition (System 1) and deliberation (System 2). Across three preregistered experiments using an adapted Cognitive Reflection Test (N = 1,372; 9,593 trials), we randomized AI accuracy via hidden seed prompts. Participants chose to consult an AI assistant on a majority of trials (>50%). Relative to baseline (no System 3 access), accuracy significantly rose when AI was accurate and fell when it erred (+25/-15 percentage points; Study 1), the behavioral signature of cognitive surrender (AI-Accurate vs. AI-Faulty contrast; Cohen’s h = 0.81). Engaging System 3 also increased confidence, even following errors. Time pressure (Study 2) and per-item incentives and feedback (Study 3) shifted baseline performance but did not eliminate this pattern: when accurate, AI buffered time-pressure costs and amplified incentive gains; when faulty, it consistently reduced accuracy regardless of situational moderators. Across studies, participants with higher trust in AI and lower need for cognition and fluid intelligence showed greater surrender to System 3. Tri-System Theory thus characterizes a triadic cognitive ecology, revealing how System 3 reframes human reasoning and may reshape autonomy and accountability in the age of AI.
Thinking—Fast, Slow, and Artificial: How AI is Reshaping Human Reasoning and the Rise of Cognitive Surrender
People increasingly consult generative artificial intelligence (AI) while reasoning. As AI becomes embedded in daily thought, what becomes of human judgment? We introduce Tri-System Theory, extending dual-process accounts of reasoning by positing System 3: artificial cognition that operates outside the brain. System 3 can supplement or supplant internal processes, introducing novel cognitive pathways. A key prediction of the theory is "cognitive surrender"-adopting AI outputs with minimal scrutiny, overriding intuition (System 1) and deliberation (System 2). Across three preregistered experiments using an adapted Cognitive Reflection Test (N = 1,372; 9,593 trials), we randomized AI accuracy via hidden seed prompts. Participants chose to consult an AI assistant on a majority of trials (>50%). Relative to baseline (no System 3 access), accuracy significantly rose when AI was accurate and fell when it erred (+25/-15 percentage points; Study 1), the behavioral signature of cognitive surrender (AI-Accurate vs. AI-Faulty contrast; Cohen's h = 0.81). Engaging System 3 also increased confidence, even following errors. Time pressure (Study 2) and per-item incentives and feedback (Study 3) shifted baseline performance but did not eliminate this pattern: when accurate, AI buffered time-pressure costs and amplified incentive gains; when faulty, it consistently reduced accuracy regardless of situational moderators. Across studies, participants with higher trust in AI and lower need for cognition and fluid intelligence showed greater surrender to System 3. Tri-System Theory thus characterizes a triadic cognitive ecology, revealing how System 3 reframes human reasoning and may reshape autonomy and accountability in the age of AI.
The Backward Mentality to Finding Victory - Mockingbird
It Doesn't Always Pay to Be a Thinker
Thinking—Fast, Slow, and Artificial: How AI is Reshaping Human Reasoning and the Rise of Cognitive Surrender
People increasingly consult generative artificial intelligence (AI) while reasoning. As AI becomes embedded in daily thought, what becomes of human judgment? We
Why major life decisions should be approached with ‘epistemic humility’ | Psyche Videos
At a crossroads in life? No matter how much you deliberate, one unknowable remains: the person you will be on the other side
