Beyond Misinformation: Social Media and the Sculpting of Epistemic Agency

ECHO CHAMBERS AND EPISTEMIC BUBBLES

Discussion of the phenomena of post-truth and fake news often implicates the closed epistemic networks of social media. The recent conversation has, however, blurred two distinct social epistemic phenomena. An epistemic bubble is a social epistemic structure in which other relevant voices have been left out, perhaps accidentally. An echo chamber is a social epistemic structure from which other relevant voices have been actively excluded and discredited. Members of epistemic bubbles lack exposure to relevant information and arguments. Members of echo chambers, on the other hand, have been brought to systematically distrust all outside sources. In epistemic bubbles, other voices are not heard; in echo chambers, other voices are actively undermined. It is crucial to keep these phenomena distinct. First, echo chambers can explain the post-truth phenomena in a way that epistemic bubbles cannot. Second, each type of structure requires a distinct intervention. Mere exposure to evidence can shatter an epistemic bubble, but may actually reinforce an echo chamber. Finally, echo chambers are much harder to escape. Once in their grip, an agent may act with epistemic virtue, but social context will pervert those actions. Escape from an echo chamber may require a radical rebooting of one's belief system.

On the epistemic structure of voluntary servitude in the infosphere

This paper introduces the concept of Voluntary Epistemic Servitude (VES) to describe a social-epistemic pathology generated by the contemporary infosphere. Drawing on Étienne de La Boétie’s Discours de la Servitude Volontaire as a theoretical resource, we argue that algorithmic systems produce conditions in which agents not only delegate their core belief-forming processes to nontransparent architectures but come to prefer and actively reproduce this delegation through social mechanisms structurally isomorphic to those La Boétie identified in political tyranny. We show that VES is irreducible to existing social-epistemic categories such as epistemic injustice (Fricker 2007), epistemic bubbles and echo chambers (Nguyen 2020), and veritistic failure (Goldman 1999) because it operates at the level of epistemic preference formation rather than credibility attribution or informational access. The paper identifies a preference-laundering mechanism by which algorithmic systems colonize the second-order epistemic desires of agents, thereby undermining the conditions of epistemic autonomy that social epistemology has largely presupposed. We further develop a precise account of reflective access that distinguishes algorithmic opacity from ordinary preference opacity, introduce the concept of epistemic counterfactual capacity with a modal analysis connecting it to Williamson’s (2000) safety condition, situate VES as a structurally induced epistemic vice (Cassam 2019) and a form of misaligned extended cognition (Clark and Chalmers 1998), and provide a typology of three algorithmic architectures through which VES operates. We conclude by stating an explicit normative bridge principle and drawing on La Boétie’s positive ideal of free horizontal epistemic bonds to sketch the preconditions for epistemic liberation in algorithmically mediated environments.

Sharing of misinformation is habitual, not just lazy or biased

Why do people share misinformation on social media? In this research ( N = 2,476), we show that the structure of online sharing built into social platforms is more important than individual deficits in critical reasoning and partisan bias—commonly cited drivers of misinformation. Due to the reward-based learning systems on social media, users form habits of sharing information that attracts others' attention. Once habits form, information sharing is automatically activated by cues on the platform without users considering response outcomes such as spreading misinformation. As a result of user habits, 30 to 40% of the false news shared in our research was due to the 15% most habitual news sharers. Suggesting that sharing of false news is part of a broader response pattern established by social media platforms, habitual users also shared information that challenged their own political beliefs. Finally, we show that sharing of false news is not an inevitable consequence of user habits: Social media sites could be restructured to build habits to share accurate information.

Sharing of misinformation is habitual, not just lazy or biased

Why do people share misinformation on social media? In this research ( N = 2,476), we show that the structure of online sharing built into social platforms is more important than individual deficits in critical reasoning and partisan bias—commonly cited drivers of misinformation. Due to the reward-based learning systems on social media, users form habits of sharing information that attracts others' attention. Once habits form, information sharing is automatically activated by cues on the platform without users considering response outcomes such as spreading misinformation. As a result of user habits, 30 to 40% of the false news shared in our research was due to the 15% most habitual news sharers. Suggesting that sharing of false news is part of a broader response pattern established by social media platforms, habitual users also shared information that challenged their own political beliefs. Finally, we show that sharing of false news is not an inevitable consequence of user habits: Social media sites could be restructured to build habits to share accurate information.

Disinformation and grievance narratives

Synthese - Disinformation is often defined as misleading content intended to instill false beliefs. But this definition is too narrow. We need to focus instead on its broader epistemic effects....

Building Epistemically Healthier Platforms

When thinking about designing social media platforms, we often focus on factors such as usability, functionality, aesthetics, ethics, and so forth. Epistemic considerations have rarely been given the same level of attention in design discussions. This paper aims to rectify this neglect. We begin by arguing that there are epistemic norms that govern environments, including social media environments. Next, we provide a framework for applying these norms to the question of platform design. We then apply this framework to the real-world case of long-form informational content platforms. We argue that many current long-form informational content platforms are epistemically unhealthy. The good news? We provide concrete advice on how to take steps toward improving their health! Specifically, we argue that they should change how they verify and authenticate content creators and how this information is displayed to content consumers. We conclude by connecting this guidance to broader issues about the epistemic health of platforms.

There is no fresh air: A problem with the concept of echo chambers

Standardly, echo chambers are thought to be structures that we should avoid. Agents should keep away from them, to be able to assess a fuller range of evidence and avoid having their confidence in that information manipulated. This paper argues against that standard view. Not only can echo chambers be neutral or good for us, but the existing definitions apply so widely that such chambers are unavoidable. We are all in large numbers of echo chambers at any time – they can be found not just on social media or in political groups, but in almost every social or epistemic group we could categorise ourselves into. Because we are finite and fallible, we cannot escape them and need to exist in them just to get by. The concept, then, does not actually capture something as structurally problematic as the paradigmatic cases would suggest. Our way of using the term in social epistemology needs to change.

Epistemic assholes

In this paper, I develop and defend the concept epistemic assholes. An epistemic asshole is someone who exhibits a distinctive form of epistemic badness characterized not by gross irrationality or hostility to truth, but by a stable, entitled disregard for one’s epistemic relations with others. Drawing on Aaron James’s (2012) account of moral assholes, I examine how people can systematically exploit epistemic cooperation by allowing themselves special advantages—such as “freedom from inquiry”, “doxastic comfort”, and “freedom to criticize”—while remaining insulated from criticism by an entrenched sense of entitlement. The resulting view, the Relational Approach to Epistemic Assholes (REA), explains why epistemic assholes are not epistemically the worst, yet are nonetheless deeply galling. After motivating the need for this concept, I show how REA captures both “impure” cases (involving both epistemic and moral assholery) and “pure” epistemic assholes, whose objectionable conduct is driven by epistemic aims themselves. I further explore connections between epistemic assholes and epistemic vice, and the causal role that epistemic assholery can play in active ignorance and epistemic exploitation. Through this latter connection, I argue that epistemic assholes play an insidious causal role in sustaining objectionable social power dynamics. The concept of epistemic assholes provides a valuable lens for understanding important but often-hidden hazards in our social epistemic environment.

Free Speech on the Internet: The Crisis of Epistemic Authority

Abstract. Much of our knowledge of the world comes not from direct sensory experience, but from reliance on epistemic authorities: individuals or institutions that tell us what we ought to believe. For example, what most of us believe about natural selection, climate change, or the Holocaust comes from our reliance on epistemic authorities (scientists, historians). Sustaining epistemic authority depends, crucially, on social institutions that inculcate reliable second-order norms about whom to believe about what. The traditional media were crucial, in the age of mass democracy, with promulgating and sustaining such norms. The internet has obliterated the intermediaries who made that possible, and, in the process, undermined the epistemic standing of actual experts. This essay considers some possible changes to existing free speech doctrine to remedy the epistemological crisis brought about by the internet.

Unveiling the waves of mis- and disinformation from social media

In the digital era, social media platforms have become the focal point for public discourse, with a significant impact on shaping societal narratives. However, they are also rife with mis- and disinformation, which can rapidly disseminate and influence public opinion. This paper investigates the propagation of mis- and disinformation on X, a social media platform formerly known as Twitter. We employ a multidimensional analytical approach, integrating sentiment analysis, wavelet analysis, and network analysis to discern the patterns and intensity of misleading information waves. Sentiment analysis elucidates the emotional tone and subjective context within which information is framed. Wavelet analysis reveals the temporal dynamics and persistence of disinformation trends over time. Network analysis maps the intricate web of information flow, identifying key nodes and vectors of virality. The results offer a granular understanding of how false narratives are constructed and sustained within the digital ecosystem. This study contributes to the broader field of digital media literacy by highlighting the urgent need for robust analytical tools to navigate and neutralize the infodemic in the age of social media.

Architecting Trust in Artificial Epistemic Agents

Large language models increasingly function as epistemic agents -- entities that can 1) autonomously pursue epistemic goals and 2) actively shape our shared knowledge environment. They curate the information we receive, often supplanting traditional search-based methods, and are frequently used to generate both personal and deeply specialized advice. How they perform these functions, including whether they are reliable and properly calibrated to both individual and collective epistemic norms, is therefore highly consequential for the choices we make. We argue that the potential impact of epistemic AI agents on practices of knowledge creation, curation and synthesis, particularly in the context of complex multi-agent interactions, creates new informational interdependencies that necessitate a fundamental shift in evaluation and governance of AI. While a well-calibrated ecosystem could augment human judgment and collective decision-making, poorly aligned agents risk causing cognitive deskilling and epistemic drift, making the calibration of these models to human norms a high-stakes necessity. To ensure a beneficial human-AI knowledge ecosystem, we propose a framework centered on building and cultivating the trustworthiness of epistemic AI agents; aligning AI these agents with human epistemic goals; and reinforcing the surrounding socio-epistemic infrastructure. In this context, trustworthy AI agents must demonstrate epistemic competence, robust falsifiability, and epistemically virtuous behaviors, supported by technical provenance systems and "knowledge sanctuaries" designed to protect human resilience. This normative roadmap provides a path toward ensuring that future AI systems act as reliable partners in a robust and inclusive knowledge ecosystem.

How Social Media Rewards Misinformation

A majority of false stories are spread by a small number of frequent users, suggests a new study co-authored by Yale SOM’s Gizem Ceylan. But they can be taught to change their ways.

Can We Fix Social Media? Testing Prosocial Interventions using Generative Social Simulation

Social media platforms have been widely linked to societal harms, including rising polarization and the erosion of constructive debate. Can these problems be mitigated through prosocial interventions? We address this question using a novel method - generative social simulation - that embeds Large Language Models within Agent-Based Models to create socially rich synthetic platforms. We create a minimal platform where agents can post, repost, and follow others. We find that the resulting following-networks reproduce three well-documented dysfunctions: (1) partisan echo chambers; (2) concentrated influence among a small elite; and (3) the amplification of polarized voices - creating a 'social media prism' that distorts political discourse. We test six proposed interventions, from chronological feeds to bridging algorithms, finding only modest improvements - and in some cases, worsened outcomes. These results suggest that core dysfunctions may be rooted in the feedback between reactive engagement and network growth, raising the possibility that meaningful reform will require rethinking the foundational dynamics of platform architecture.

Can We Fix Social Media? Testing Prosocial Interventions using Generative Social Simulation

Social media platforms have been widely linked to societal harms, including rising polarization and the erosion of constructive debate. Can these problems be mitigated through prosocial interventions? We address this question using a novel method - generative social simulation - that embeds Large Language Models within Agent-Based Models to create socially rich synthetic platforms. We create a minimal platform where agents can post, repost, and follow others. We find that the resulting following-networks reproduce three well-documented dysfunctions: (1) partisan echo chambers; (2) concentrated influence among a small elite; and (3) the amplification of polarized voices - creating a 'social media prism' that distorts political discourse. We test six proposed interventions, from chronological feeds to bridging algorithms, finding only modest improvements - and in some cases, worsened outcomes. These results suggest that core dysfunctions may be rooted in the feedback between reactive engagement and network growth, raising the possibility that meaningful reform will require rethinking the foundational dynamics of platform architecture.

The Role of Media in Political Polarization| Inoculation Can Reduce the Perceived Reliability of Polarizing Social Media Content

Little research is available on psychological interventions that counter susceptibility to polarizing online content. We conducted 3 studies (n1 = 472, n2 = 193, n3 = 772) to evaluate whether psychological resistance against polarizing social media content can be conferred, using the Bad News game, a “technique-based inoculation” intervention that simulates a social media feed. We investigate (1) whether technique-based inoculation can reduce susceptibility to content designed to fuel intergroup polarization; (2) whether technique-based inoculation can offer cross-protection against misinformation techniques that people were not inoculated against; and (3) whether political ideology plays a role in how people engage with anti-misinformation interventions. In Studies 1 and 3 (but not Study 2), we found that technique-based inoculation significantly reduces the perceived reliability of polarizing content and offers partial cross-protection against untreated misinformation techniques. We found no effect for attitudinal certainty and news-sharing intentions. Finally, we report preliminary evidence that people may choose to engage with politically congruent news topics within the intervention.