Two different ways of thinking through texts are compared for learning value.
ChatGPT as a cognitive crutch: Evidence from a randomized controlled trial on knowledge retention
The rapid integration of generative artificial intelligence into higher education has outpaced empirical understanding of its effects on fundamental learning processes. To address this gap, this randomized controlled trial (n = 120) tested ChatGPT's impact on long-term knowledge retention in undergraduates learning AI. Participants were randomly assigned either to use ChatGPT as a study aid (AI-Assisted Group) or to use only traditional, non-AI study methods (traditional learning group). Knowledge retention was assessed with a surprise test 45 days after learning. Students who used ChatGPT scored significantly lower on the retention test (57.5 % correct) compared to those who studied traditionally (68.5 % correct), t (83) = −3.19, p = .002, Cohen's d = 0.68. This suggests that unrestricted ChatGPT use impaired long-term retention, likely by reducing the cognitive effort that supports durable memory. The findings align with cognitive offloading theory and the ‘desirable difficulties’ principle: while AI assistance may ease initial learning, it appears to undermine the effortful processes needed for robust learning. These results have important implications for how generative AI tools should be integrated into higher education.
Unlocking Scientific Concepts: How Effective Are LLM-Generated Analogies for Student Understanding and Classroom Practice?
Teaching scientific concepts is essential but challenging, and analogies help students connect new concepts to familiar ideas. Advancements in large language models (LLMs) enable generating analogies, yet their effectiveness in education remains underexplored. In this paper, we first conducted a two-stage study involving high school students and teachers to assess the effectiveness of LLM-generated analogies in biology and physics through a controlled in-class test and a classroom field study. Test results suggested that LLM-generated analogies could enhance student understanding particularly in biology, but require teachers’ guidance to prevent over-reliance and overconfidence. Classroom experiments suggested that teachers could refine LLM-generated analogies to their satisfaction and inspire new analogies from generated ones, encouraged by positive classroom feedback and homework performance boosts. Based on findings, we developed and evaluated a practical system to help teachers generate and refine teaching analogies. We discussed future directions for developing and evaluating LLM-supported teaching and learning by analogy.
Why Some Students Learn Faster
A hypothesis about teaching and learning
Why Some Students Learn Faster
A hypothesis about teaching and learning
How Learning Happens | Seminal Works in Educational Psychology and Wha
How Learning Happens introduces 28 giants of educational research and their findings on how we learn and what we need to learn effectively, efficiently, and
Experimental evidence of the effects of large language models versus web search on depth of learning
Abstract The effects of using large language models (LLMs) versus traditional web search on depth of learning are explored. A theory is proposed that when individuals learn about a topic from LLM syntheses, they risk developing shallower knowledge than when they learn through standard web search, even when the core facts in the results are the same. This shallower knowledge accrues from an inherent feature of LLMs—the presentation of results as summaries of vast arrays of information rather than individual search links—which inhibits users from actively discovering and synthesizing information sources themselves, as in traditional web search. Thus, when subsequently forming advice on the topic based on their search, those who learn from LLM syntheses (vs. traditional web links) feel less invested in forming their advice, and, more importantly, create advice that is sparser, less original, and ultimately less likely to be adopted by recipients. Results from seven online and laboratory experiments (n = 10,462) lend support for these predictions, and confirm, for example, that participants reported developing shallower knowledge from LLM summaries even when the results were augmented by real-time web links. Implications of the findings for recent research on the benefits and risks of LLMs, as well as limitations of the work, are discussed.
Experimental evidence of the effects of large language models versus web search on depth of learning
Abstract. The effects of using large language models (LLMs) versus traditional web search on depth of learning are explored. A theory is proposed that when
Social learning preserves both useful and useless theories by canalizing learners’ exploration
In many domains, learning from others is crucial for leveraging cumulative cultural knowledge, which encapsulates the efforts of successive generations of innovators. However, anecdotal and experimental evidence suggests that reliance on social information can reduce the exploration of the problem space. Here, we experimentally investigate the extent to which cultural transmission fosters the persistence of arbitrary solutions in a context where participants are incentivized to improve a physical system across multiple trials. Participants were exposed to various theories about the system, ranging from accurate to misleading. Our findings indicate that even under conditions conducive to exploration, the transmission of cultural knowledge canalizes learners’ focus, limiting their consideration of alternative solutions. This effect was observed in both the theories produced and the solutions attempted by participants, irrespective of the accuracy of the provided theories. These results challenge the notion that arbitrary solutions persist only when they are efficient or intuitive and underscore the significant role of cultural transmission in shaping human knowledge and technologies.
Retraction Note: The effect of ChatGPT on students’ learning performance, learning perception, and higher-order thinking: insights from a meta-analysis
Humanities and Social Sciences Communications - Retraction Note: The effect of ChatGPT on students’ learning performance, learning perception, and higher-order thinking: insights from a...
Retraction Note: The effect of ChatGPT on students’ learning performance, learning perception, and higher-order thinking: insights from a meta-analysis
Humanities and Social Sciences Communications - Retraction Note: The effect of ChatGPT on students’ learning performance, learning perception, and higher-order thinking: insights from a...
What Makes a Concept Good? A Criterial Framework for Understanding Concept Formation in the Social Sciences
Nowhere in the broad and heterogeneous work on concept formation has the question of conceptual utility been satisfactorily addressed. Goodness in concept formation, I argue, cannot be reduced to 'clarity,' to empirical or theoretical relevance, to a set of rules, or to the methodology particular to a given study. Rather, I argue that conceptual adequacy should be perceived as an attempt to respond to a standard set of criteria, whose demands are felt in the formation and use of all social science concepts: (1) familiarity, (2) resonance, (3) parsimony, (4) coherence, (5) differentiation, (6) depth, (7) theoretical utility, and (8) field utility. The significance of this study is to be found not simply in answering this important question, but also in providing a complete and reasonably concise framework for explaining the process of concept formation within the social sciences. Rather than conceiving of concept formation as a method (with a fixed set of rules and a definite outcome), I view it as a highly variable process involving trade-offs among these eight demands.
ChatGPT acts as a "cognitive crutch" that weakens memory, new research suggests
A recent experiment provides evidence that relying on artificial intelligence to study tends to reduce how much information students remember weeks later.
How cognitive elaboration fosters knowledge acquisition on social media—a field experiment
Abstract. Social media technologies have been criticized as ineffective sources of information because users seem to increase their subjective but not thei
Cross-Lingual Exploration for Parametric Knowledge | Idan Szpektor
Accepted to EMNLP Findings! While Large Language Models encode vast amounts of multicultural and factual information, this parametric knowledge is often unevenly accessible across languages. Standard inference frequently fails to surface localized facts, creating persistent gaps in cross-lingual knowledge transfer and consistency. We address this challenge in our paper "Cross-Lingual Exploration for Parametric Knowledge" (https://lnkd.in/drf36bV7), a collaboration between Elisha Diskind, Itamar Trainin, and Omri Abend from The Hebrew University of Jerusalem, Leshem Choshen from the Weizmann Institute of Science, alongside Uri Shaham and myself from our Google Research IL group. We formalize cross-lingual exploration as a structured search process across four core dimensions: language selection, exploration routing, answer aggregation, and inference budget. Evaluating across 17 typologically diverse languages on the ECLeKTic and CLIKE benchmarks, we show that allowing models to autonomously navigate alternative linguistic paths yields up to a 21% gain in knowledge transfer and a 16% boost in factual recall over native baselines, surpassing both standard English-pivot routing and native-language reasoning. Crucially, cross-lingual exploration defines a significantly more efficient compute Pareto frontier than scaling within the native query language, while driving intrinsic cross-lingual consistency gains beyond what accuracy improvements alone explain. Technically, this moves the needle for multilingual inference and knowledge elicitation pipelines, demonstrating that strategic language switching is a powerful, training-free mechanism for unlocking latent parametric knowledge.
Social-information seeking in development: The child as experimental psychologist
Research has established that children are “naive psychologists”, adept at understanding and navigating the social world from an early age. However, most of this work has focused on how children process information that they acquire incidentally, for example by passively observing others’ actions. Here, we draw on literature framing children as intuitive scientists, who actively seek information and test hypotheses, to propose a view of children as naive experimental psychologists. From this perspective, children play an active role in selecting and pursuing relevant social information (e.g., about agents’ goals, traits, or relationships), whereby their search strategies are influenced both by context and task demands, as well as their prior beliefs, concepts, and domain-specific naive theories. We argue that the particular challenges associated with learning and reasoning about other minds may necessitate that children leverage their active learning competences, and we outline how the social domain uniquely constrains and shapes the learning process. We review existing research on social-information seeking in children and adults, and identify directions for future research, emphasizing that children’s developing social cognition should be understood in terms of the active, exploratory role they take in learning about and participating in the social world.
Description not evaluation - The Cynefin Co
One of the things I am enjoying at the moment is the way a lot of things are coming together conceptually. It happens like this when you develop or repurpose knowledge from different sources. Individual practices and ideas make sense in their own right. Then you read more, practice more, and the various origins […]
