Many artificial intelligence tools replace or stand to replace human activity, via automated decision-making, recommender systems and content generation. The more artificial intelligence (AI) replaces valuable human activity, the more it risks deskilling humans of their human capacities. This paper argues for applying a structural perspective to this phenomenon. It introduces the concept of ‘capacity-hostile environments’ to identify instances where AI mediation impedes human capacity cultivation. The analysis moves beyond individual responsibility that agents have to cultivate their human capacities, demonstrating how AI’s influence creates systemic conditions that could inhibit the development and exercise of human capacities by undermining the process of capacity cultivation. Drawing on the philosophy of skill as well as social epistemology, this paper argues that capacity cultivation (skilling) includes acquiring agential control over the capacities, inculcated through a long, gradual process of habituation. Habituation, in turn, depends on learning from others: the ‘know how’ of the skill, as well as a shared understanding of the value of the skill. AI mediation risks undermining the quality of the conditions for capacity habituation, leading to capacity impoverishment. By exploring the role of AI in mediating human activity, the paper highlights the need to evaluate AI applications based on their conduciveness or hostility to capacity cultivation. Ultimately, it calls for a critical reflection on the values inherent in AI socio-technical systems and emphasizes the societal obligation to foster capacity-conducive environments in the age of AI.
The Personalized Learning Revolution
The allure of AI lies predominantly in its unmatched potential for efficiency, convenience, and accuracy. However, this unprecedented convenience brings with it a hidden yet profound threat: the subtle erosion of human capacity for critical thinking through cognitive offloading.
The Impact of Artificial Intelligence on Human Thought
This research paper examines, from a multidimensional perspective (cognitive, social, ethical, and philosophical), how AI is transforming human thought. It highlights a cognitive offloading effect: the externalization of mental functions to AI can reduce intellectual engagement and weaken critical thinking. On the social level, algorithmic personalization creates filter bubbles that limit the diversity of opinions and can lead to the homogenization of thought and polarization. This research also describes the mechanisms of algorithmic manipulation (exploitation of cognitive biases, automated disinformation, etc.) that amplify AI's power of influence. Finally, the question of potential artificial consciousness is discussed, along with its ethical implications. The report as a whole underscores the risks that AI poses to human intellectual autonomy and creativity, while proposing avenues (education, transparency, governance) to align AI development with the interests of humanity.
How Artificial Intelligence Constrains the Human Experience
AbstractArtificial intelligence (AI) and related technologies are transforming many consumption activities, powering breakthroughs that expand the human experience by enhancing human capabilities, performance, and creativity. While this explains the consumer enthusiasm and rapid adoption of these technologies, AI systems can also have the opposite effect: reducing and constraining the range of experiences that are available to consumers. This article examines the mechanisms through which AI can constrain the human experience, considering individual, interpersonal, and societal processes. Our analysis uncovers a complex interplay between the advantages of AI and its inadvertent negative repercussions, which potentially restrict human autonomy, self-identity, relational dynamics, and social behavior. In this article, we propose three different mechanisms at the core of these constraining forces: parametric reductionism, agency transference, and regulated expression. Our exploration of these mechanisms highlights the risks connected to system design and points to questions and implications for future researchers and policymakers.
Are we offloading too much of our thinking to AI?
Reflections on autonomy and the value of thinking for ourselves
AI tools are 'deskilling' workers, philosophy professor says
A philosophy professor warns that AI reliance is weakening workers' judgment, creativity, and problem-solving.
Arvind Narayanan (@aisnakeoil)
There’s a big, under-appreciated reason why people may have very different experiences and opinions about using AI for work — are they using it for tasks they’re already an expert at, or tasks they can’t do themselves? The former leads to a growth cycle and the latter leads to a dependence spiral. When I use AI to do something I’m an expert at, like coding, I treat it as a tool. I can build quickly, maintaining an understanding of the code, knowing that if necessary, I can fix the code myself. It feels empowering. It frees up my time to think about the complex, judgment-oriented parts of software engineering that I can’t or won’t delegate to AI. That means my own skills improve rapidly, and I get to climb the ladder of complexity and develop higher-level skills, much more so than when I write the code myself. I feel in control. I can lock in and achieve a flow state — when AI is working, I’m reviewing, building understanding, and planning the next steps. I never get the feeling that the tool is about to replace me. This is the growth cycle. (Of course, the growth cycle is not automatic. I still need to exercise agency to use AI responsibly. But it’s the same challenge with any productivity-enhancing technology, and those who’ve navigated such transitions before are well-equipped to navigate it with AI as well.) On the other hand, if I use it for tasks I don’t understand and haven’t learned to perform myself, I have no choice but to treat it as a superintelligence. If something breaks, the best I can do is ask AI to fix it and hope for the best. I generally can’t evaluate the quality of the output myself. The only way to find out if it's any good is if and when the work is ultimately reviewed by an actual expert. The experience is confusing, unsettling and disempowering. And forget about flow state. By over-relying on AI, I risk losing whatever skill I had at the task in the first place, even if it boosts productivity in the short term. This is the dependence spiral. It’s no wonder that entry-level workers and students preparing to enter the workforce find themselves in a bind. To compete with the AI-enabled productivity of more seasoned workers, they must adopt AI themselves, but doing so risks the dependence spiral. I have some thoughts on solutions that I will share in later posts, but I think having a clear diagnosis of the problem is a useful first step.
Augmented human intelligence goes beyond the AGI mirage
This paper argues that contemporary Artificial General Intelligence (AGI) approaches face significant challenges that make Augmented Human Intelligence (AHI) a more promising and practically beneficial alternative. Drawing on phenomenological insights from Peter-Paul Verbeek’s technological mediation theory and comprehensive empirical evidence from decades of AI development, we argue that current AGI projects encounter recurring difficulties that may stem from attempting to replace rather than enhance human intelligence. Through analysis of mediation theory’s core concepts, systematic examination of recent AI performance data, and comprehensive review of human–AI collaboration studies, we show why augmentation approaches consistently outperform replacement attempts across domains requiring creativity, judgment, and contextual understanding. Prioritizing sophisticated AHI development over AGI pursuit represents not a compromise but a fundamental reorientation toward more effective and ethically sound approaches to artificial intelligence that better serve human flourishing.
Trust and reliance on AI — An experimental study on the extent and costs of overreliance on AI
Decision-making is undergoing rapid changes due to the introduction of artificial intelligence (AI), as AI recommender systems can help mitigate human flaws and increase decision accuracy and efficiency. However, AI can also commit errors or suffer from algorithmic bias. Hence, blind trust in technologies carries risks, as users may follow detrimental advice resulting in undesired consequences. Building upon research on algorithm appreciation and trust in AI, the current study investigates whether users who receive AI advice in an uncertain situation overrely on this advice — to their own detriment and that of other parties. In a domain-independent, incentivized, and interactive behavioral experiment, we find that the mere knowledge of advice being generated by an AI causes people to overrely on it, that is, to follow AI advice even when it contradicts available contextual information as well as their own assessment. Frequently, this overreliance leads not only to inefficient outcomes for the advisee, but also to undesired effects regarding third parties. The results call into question how AI is being used in assisted decision making, emphasizing the importance of AI literacy and effective trust calibration for productive deployment of such systems.
What Does 'Human-Centred AI' Mean?
While it seems sensible that human-centred artificial intelligence (AI) means centring "human behaviour and experience," it cannot be any other way. AI, I argue, is usefully seen as a relationship between technology and humans where it appears that artifacts can perform, to a greater or lesser extent, human cognitive labour. This is evinced using examples that juxtapose technology with cognition, inter alia: abacus versus mental arithmetic; alarm clock versus knocker-upper; camera versus vision; and sweatshop versus tailor. Using novel definitions and analyses, sociotechnical relationships can be analysed into varying types of: displacement (harmful), enhancement (beneficial), and/or replacement (neutral) of human cognitive labour. Ultimately, all AI implicates human cognition; no matter what. Obfuscation of cognition in the AI context -- from clocks to artificial neural networks -- results in distortion, in slowing critical engagement, perverting cognitive science, and indeed in limiting our ability to truly centre humans and humanity in the engineering of AI systems. To even begin to de-fetishise AI, we must look the human-in-the-loop in the eyes.
What Does 'Human-Centred AI' Mean?
While it seems sensible that human-centred artificial intelligence (AI) means centring "human behaviour and experience," it cannot be any other way. AI, I argue, is usefully seen as a relationship between technology and humans where it appears that artifacts can perform, to a greater or lesser extent, human cognitive labour. This is evinced using examples that juxtapose technology with cognition, inter alia: abacus versus mental arithmetic; alarm clock versus knocker-upper; camera versus vision; and sweatshop versus tailor. Using novel definitions and analyses, sociotechnical relationships can be analysed into varying types of: displacement (harmful), enhancement (beneficial), and/or replacement (neutral) of human cognitive labour. Ultimately, all AI implicates human cognition; no matter what. Obfuscation of cognition in the AI context -- from clocks to artificial neural networks -- results in distortion, in slowing critical engagement, perverting cognitive science, and indeed in limiting our ability to truly centre humans and humanity in the engineering of AI systems. To even begin to de-fetishise AI, we must look the human-in-the-loop in the eyes.
AI Tools in Society: Impacts on Cognitive Offloading and the Future of Critical Thinking
The proliferation of artificial intelligence (AI) tools has transformed numerous aspects of daily life, yet its impact on critical thinking remains underexplored. This study investigates the relationship between AI tool usage and critical thinking skills, focusing on cognitive offloading as a mediating factor. Utilising a mixed-method approach, we conducted surveys and in-depth interviews with 666 participants across diverse age groups and educational backgrounds. Quantitative data were analysed using ANOVA and correlation analysis, while qualitative insights were obtained through thematic analysis of interview transcripts. The findings revealed a significant negative correlation between frequent AI tool usage and critical thinking abilities, mediated by increased cognitive offloading. Younger participants exhibited higher dependence on AI tools and lower critical thinking scores compared to older participants. Furthermore, higher educational attainment was associated with better critical thinking skills, regardless of AI usage. These results highlight the potential cognitive costs of AI tool reliance, emphasising the need for educational strategies that promote critical engagement with AI technologies. This study contributes to the growing discourse on AI’s cognitive implications, offering practical recommendations for mitigating its adverse effects on critical thinking. The findings underscore the importance of fostering critical thinking in an AI-driven world, making this research essential reading for educators, policymakers, and technologists.
AI Tools in Society: Impacts on Cognitive Offloading and the Future of Critical Thinking
The proliferation of artificial intelligence (AI) tools has transformed numerous aspects of daily life, yet its impact on critical thinking remains underexplored. This study investigates the relationship between AI tool usage and critical thinking skills, focusing on cognitive offloading as a mediating factor. Utilising a mixed-method approach, we conducted surveys and in-depth interviews with 666 participants across diverse age groups and educational backgrounds. Quantitative data were analysed using ANOVA and correlation analysis, while qualitative insights were obtained through thematic analysis of interview transcripts. The findings revealed a significant negative correlation between frequent AI tool usage and critical thinking abilities, mediated by increased cognitive offloading. Younger participants exhibited higher dependence on AI tools and lower critical thinking scores compared to older participants. Furthermore, higher educational attainment was associated with better critical thinking skills, regardless of AI usage. These results highlight the potential cognitive costs of AI tool reliance, emphasising the need for educational strategies that promote critical engagement with AI technologies. This study contributes to the growing discourse on AI’s cognitive implications, offering practical recommendations for mitigating its adverse effects on critical thinking. The findings underscore the importance of fostering critical thinking in an AI-driven world, making this research essential reading for educators, policymakers, and technologists.
What matters in the age of AI is taste
the case for why a curated personal knowledge base has never mattered more
Mathematical methods and human thought in the age of AI
Artificial intelligence (AI) is the name popularly given to a broad spectrum of computer tools designed to perform increasingly complex cognitive tasks, including many that used to solely be the province of humans. As these tools become exponentially sophisticated and pervasive, the justifications for their rapid development and integration into society are frequently called into question, particularly as they consume finite resources and pose existential risks to the livelihoods of those skilled individuals they appear to replace. In this paper, we consider the rapidly evolving impact of AI to the traditional questions of philosophy with an emphasis on its application in mathematics and on the broader real-world outcomes of its more general use. We assert that artificial intelligence is a natural evolution of human tools developed throughout history to facilitate the creation, organization, and dissemination of ideas, and argue that it is paramount that the development and application of AI remain fundamentally human-centered. With an eye toward innovating solutions to meet human needs, enhancing the human quality of life and expanding the capacity for human thought and understanding, we propose a pathway to integrating AI into our most challenging and intellectually rigorous fields to the benefit of all humankind.
The case for friction in AI-mediated information seeking and learning
Introduction. This paper challenges the assumption that frictionless AI-mediated information seeking represents progress. We argue that AI systems eliminating productive friction, such as uncertainty, exploration, and reflective processes, undermine intellectual virtues essential for critical thinking in an AI-saturated information environment. Method. This conceptual article employs a theory synthesis approach, drawing on library information science (LIS) theories of information behaviour, experience, and literacy, virtue epistemology, and human–computer interaction (HCI) friction design literature. Analysis. We map intellectual virtues such as curiosity, thoroughness, and intellectual humility onto the Association of College and Research Libraries (ACRL) Framework for Information Literacy for Higher Education, building on and extending previous analyses. We connect dimensions of virtuous search to AI system design principles and align friction types with specific intellectual virtues. Results. We propose three design principles for human-centred AI systems (representation, affordance, and facilitation) and develop a typology that maps friction interventions to intellectual virtues, providing concrete examples for each. Conclusion. Productive friction should be understood as a feature supporting intellectual development, not a barrier to efficiency. The design choices made today will determine whether AI serves as intellectual scaffolding or cognitive crutch.
