When we look at a representation of reality, we can choose to either see it as descriptive, meaning it tells us what the world is currently like, or as prescriptive, meaning it tells us how the world should be. Descriptions teach us, but they also give us room to innovate. Prescriptions can get us stuck. One place this tension shows up is in language.
Description not evaluation - The Cynefin Co
One of the things I am enjoying at the moment is the way a lot of things are coming together conceptually. It happens like this when you develop or repurpose knowledge from different sources. Individual practices and ideas make sense in their own right. Then you read more, practice more, and the various origins […]
Tracing the thoughts of a large language model
Anthropic's latest interpretability research: a new microscope to understand Claude's internal mechanisms
Misarticulation: Why We Sometimes Feel Our Words Don’t Match Our Thoughts
People do not always say what they mean. In everyday conversations, people regularly sense that they have not fully communicated what they had in mind—a subject
The Triadic Mind: How Language Reveals the Limits of Human Cognition
Languages are the most complex symbolic systems humans have ever created. Yet children acquire them effortlessly, without formal…
Say precisely what you mean.
The words designers use when they know what they’re looking at.
Computational hermeneutics: evaluating generative AI as a cultural technology
Generative AI (GenAI) systems are increasingly recognized as cultural technologies, yet current evaluation frameworks often treat culture as a variable to be measured rather than fundamental to the system's operation. Drawing on hermeneutic theory from the humanities, we argue that GenAI systems function as "context machines" that must inherently address three interpretive challenges: situatedness (meaning only emerges in context), plurality (multiple valid interpretations coexist), and ambiguity (interpretations naturally conflict). We present computational hermeneutics as an emerging framework offering an interpretive account of what GenAI systems do, and how they might do it better. We offer three principles for hermeneutic evaluation—that benchmarks should be iterative, not one-off; include people, not just machines; and measure cultural context, not just model output. This perspective offers a nascent paradigm for designing and evaluating contemporary AI systems: shifting from standardized questions about accuracy to contextual ones about meaning.
Language Access in Healthcare — Discourse Graph
An open, AI-assisted evidence synthesis of how language concordance — matching patients with providers or interpreters who share their language — affects healthcare outcomes. Every question, claim, evidence item, caveat, and source is its own addressable node.
The Future of Text
We are a community dedicated to working on how we can better develop text to augment our capabilities and we invite you to join us. We believe that the potential of richly interactive text to truly augment how we think & communicate is massive. Text after all, is externalized symbols we can interact with to extend our mind’s reach. Therefore text is not just a medium, it is also a tool for thought, and we are looking Beyond Visual Range.
Reify This
The authors contend that contemporary efforts to render AI systems interpretable rest on a mistake: reification, the process of treating abstractions and statistical artifacts as if they were concrete realities.…
Mapping the Mind of a Large Language Model
We have identified how millions of concepts are represented inside Claude Sonnet, one of our deployed large language models. This is the first ever detailed look inside a modern, production-grade large language model.
Notation as a Tool of Thought
When Truth Becomes Hazardous: Navigating Information Through the Metacrisis | Frankly 153
Many Minds: Seven metaphors for AI
If you wanted a petri dish for understanding metaphors—how they emerge and evolve and jostle with each other—it would be hard to do better than the world of AI. We talk about AI systems variously as coaches or co-pilots, little genies or alien intelligences. Some researchers claim that AIs "grow," that they're entering their phase of "adolescence." Critics deride AI products as slop and dismiss LLMs as a kind of autocomplete on steroids. What's behind these different characterizations? Which ones are accurate and which are unfair? And are our metaphors mostly colorful rhetoric or do they matter? Are they shaping how we understand, adopt, and ultimately regulate these new technologies? My guest today is . Melanie is a computer scientist and Professor at the Santa Fe Institute. She is the author of the book, and she writes a by the same name. This episode is a bit of a companion to with Steve Flusberg. In that episode, Steve and I attempted a kind of crash course on metaphor and the human mind. Here, Melanie and I sit down for more of an extended case study: how metaphors are guiding, galvanizing, and maybe deceiving us in the contested realm of AI discourse. We unpack seven of the most widely used metaphors in this space. We consider how these metaphors are shaping not only our everyday understandings of AI, but also law and policy. We also talk about the metaphor and analogy capabilities of AI itself. Can these systems reason abstractly in the way that humans can? Along the way, Melanie and I touch on: AI-generated poetry, anthropomorphism, the original sin of AI research, the myth of Narcissus, psychometric testing and its pitfalls, metaphors for AI that are a bit hard to spot, and the question of whether an AI has ever come up with a decent analogy for itself. Longtime fans of the show will know that we've had Melanie on the show . We invited her back, not only because she's thought about metaphor and analogy in AI discourse for decades, but because she's a voice of calm insight in an area that’s increasingly awash in hype and polemic. Longtime fans of the show may also note that we are now celebrating our 6th birthday at Many Minds. That's right, the show launched in February 2020. If you'd like to support us as we recognize this milestone, you can leave us a rating or a review, recommend us to a friend, or give us a shout out on social media. Your support is always appreciated. Without further ado, on to my conversation with Dr. Melanie Mitchell. Enjoy! Notes 3:30 – For an overview of Douglas Hofstadter’s work on analogy, see . 8:00 – Much of our discussion in this interview draws on Dr. Mitchell’s piece on the in Science magazine. 13:30 – For earlier discussions of anthropomorphism on the show, see our earlier episodes and . 16:00 – See for the original discussion of LLMs as “stochastic parrots.” 17:00 – See for the original discussion of ChatGPT as a “blurry jpeg.” 18:30 – See for the original discussion of LLMs as role players. 22:00 – See for one use of the “LLMs as crowds” metaphor. See also a discussion of this metaphor (and other metaphors for AI) . 25:00 – For one discussion of AI as a “cultural technology” by Alison Gopnik and colleagues, see . For a more recent discussion of the same metaphor by Henry Farrell, Alison Gopnik and others, see . 27:00 – For the podcast series on intelligence that Dr. Mitchell co-hosted for the Santa Fe Institute, see . 28:00 – See for an influential formulation of the idea that AI is an “alien intelligence.” 29:00 – For philosopher Shannon Vallor’s book about AI as “mirror,” see . 31:00 – For the recent study on users’ metaphors for AI systems, see . 33:00 – For more on the rise of social AI, see our earlier episode . 38:00 – For more on what AI researchers might learn from developmental and comparative psychologists, see Dr. Mitchell’s (summarizing her keynote at NeurIPs). 42:00 – For more on the ARC (Abstraction and Reasoning Corpus) and the research that Dr. Mitchell and colleagues have been doing with it, see and . 48:30 – For the study on humans' preference for AI-generated poetry, see . 50:30 – For Brigitte Nerlich’s documentation and discussion of various metaphors for AI (including AI’s metaphors for itself), see . Recommendations , by Shannon Vallor ‘,’ by Murray Shanahan (!) et al. ‘,’ by Henry Farrell et al. Many Minds is a project of the , which is made possible by a generous grant from the John Templeton Foundation to Indiana University. The show is hosted and produced by , with help from Assistant Producer and with creative support from DISI Directors Erica Cartmill and Jacob Foster. Our artwork is by . Subscribe to Many Minds on Apple, Stitcher, Spotify, Pocket Casts, Google Play, or wherever you listen to podcasts. You can also now subscribe to the Many Minds newsletter ! We welcome your comments, questions, and suggestions. Feel free to email us at: manymindspodcast@gmail.com. For updates about the show, visit or follow us on Bluesky ().
When Convenient Illusions Hold Precedence...
Language, Substance, and Money are intermediaries which crumble under weight of inspection
We Have Always Been Action TheoristsToward a Critical Theory of Language for the Era of “Large Language Models”
Scholars of literature and culture understandably place themselves among the world’s premiere experts on matters of language. But they also know that fields like linguistics and communication have their own ways of studying how people express themselves through speech and written media. A key difference concerns the theories and methodologies...
The Shape of Knowing - The Cynefin Co
We evolved to make sense of a world that does not come with explanations attached. This is the third in a series on the trialectics. For an introduction
