







Understanding key distinctions between misinformation/disinformation, speech/action, and mistaken belief/conviction provides an opportunity to expand research and policy toward more constructive online communication.
The five biggest challenges facing misinformation researchers
How People Weave Online Information Into Pseudoknowledge
Misinformation has found a new natural habitat in the digital age. Thousands of forums, blogs, and alternative news sources amplify fake news and inaccurate information to such a degree that it impacts our collective intelligence. Researchers and policy makers are troubled by misinformation because it is presumed to energize or even carry false narratives that can motivate poor decision-making and dangerous behaviors. Yet, while a growing body of research has focused on how viral misinformation spreads, little work has examined how false narratives are in fact constructed. In this study, we move beyond contagion inspired approaches to examine how people construct a false narrative. We apply prior work in cognitive science on narrative understanding to illustrate how the narrative changes over time and in response to social dynamics, and examine how forum participants draw upon a diverse set of online sources to substantiate the narrative. We find that the narrative is based primarily on reinterpretations of conventional and scholarly sources, and then used to provide an alternate account of unfolding events. We conclude that the link between misinformation, conventional knowledge, and false narratives is more complex than is often presumed, and advocate for a more direct study of this relationship.

Capturing our Attention
What are the harms of misinformation? It’s widely believed that it causes false belief, including false beliefs in quite bizarre claims. I argue that this threat is greatly exaggerated: while plaus...

Believing misinformation is a “win” for some people, even when proven false
Winning" means prioritizing independence from outside influence over being right.

We Failed The Misinformation Fight. Now What?
Defending democracy in the digital age will require moving beyond the focus of fighting online misinformation.

Facts and Myths about Misperceptions
Misperceptions threaten to warp mass opinion and public policy on controversial issues in politics, science, and health. What explains the prevalence and persistence of these false and unsupported beliefs, which seem to be genuinely held by many people? Though limits on cognitive resources and attention play an important role, many of the most destructive misperceptions arise in domains where individuals have weak incentives to hold accurate beliefs and strong directional motivations to endorse beliefs that are consistent with a group identity such as partisanship. These tendencies are often exploited by elites who frequently create and amplify misperceptions to influence elections and public policy. Though evidence is lacking for claims of a “post-truth” era, changes in the speed with which false information travels and the extent to which it can find receptive audiences require new approaches to counter misinformation. Reducing the propagation and influence of false claims will require further efforts to inoculate people in advance of exposure (for example, media literacy), debunk false claims that are already salient or widespread (for example, fact-checking), reduce the prevalence of low-quality information (for example, changing social media algorithms), and discourage elites from promoting false information (for example, strengthening reputational sanctions).
Debunking: A Meta-Analysis of the Psychological Efficacy of Messages Countering Misinformation
This meta-analysis investigated the factors underlying effective messages to counter attitudes and beliefs based on misinformation. Because misinformation can lead to poor decisions about consequential matters and is persistent and difficult to correct, debunking it is an important scientific and public-policy goal. This meta-analysis ( k = 52, N = 6,878) revealed large effects for presenting misinformation ( ds = 2.41–3.08), debunking ( ds = 1.14–1.33), and the persistence of misinformation in the face of debunking ( ds = 0.75–1.06). Persistence was stronger and the debunking effect was weaker when audiences generated reasons in support of the initial misinformation. A detailed debunking message correlated positively with the debunking effect. Surprisingly, however, a detailed debunking message also correlated positively with the misinformation-persistence effect.

A Meta-Analytic Examination of the Continued Influence of Misinformation in the Face of Correction: How Powerful Is It, Why Does It Happen, and How to Stop It?
A meta-analysis was conducted to examine the extent of continued influence of misinformation in the face of correction and the theoretical explanations of this phenomenon. Aggregation of results from 32 studies ( N = 6,527) revealed that, on average, correction does not entirely eliminate the effect of misinformation ( r = –.05, p = .045). Corrective messages were found to be more successful when they are coherent, consistent with the audience’s worldview, and delivered by the source of the misinformation itself. Corrections are less effective if the misinformation was attributed to a credible source, the misinformation has been repeated multiple times prior to correction, or when there was a time lag between the delivery of the misinformation and the correction. These findings are consistent with predictions based on theories of mental models and offer concrete recommendations for practitioners.

Disinformation and grievance narratives
Synthese - Disinformation is often defined as misleading content intended to instill false beliefs. But this definition is too narrow. We need to focus instead on its broader epistemic effects....
Trust: Foundation of Human Knowledge yet online Platforms won't allow | David Karger | TEDxMIT Salon
How Social Media Rewards Misinformation
A majority of false stories are spread by a small number of frequent users, suggests a new study co-authored by Yale SOM’s Gizem Ceylan. But they can be taught to change their ways.

Why the backfire effect does not explain the durability of political misperceptions
Previous research indicated that corrective information can sometimes provoke a so-called “backfire effect” in which respondents more strongly endorsed a misperception about a controversial political or scientific issue when their beliefs or predispositions were challenged. I show how subsequent research and media coverage seized on this finding, distorting its generality and exaggerating its role relative to other factors in explaining the durability of political misperceptions. To the contrary, an emerging research consensus finds that corrective information is typically at least somewhat effective at increasing belief accuracy when received by respondents. However, the research that I review suggests that the accuracy-increasing effects of corrective information like fact checks often do not last or accumulate; instead, they frequently seem to decay or be overwhelmed by cues from elites and the media promoting more congenial but less accurate claims. As a result, misperceptions typically persist in public opinion for years after they have been debunked. Given these realities, the primary challenge for scientific communication is not to prevent backfire effects but instead, to understand how to target corrective information better and to make it more effective. Ultimately, however, the best approach is to disrupt the formation of linkages between group identities and false claims and to reduce the flow of cues reinforcing those claims from elites and the media. Doing so will require a shift from a strategy focused on providing information to the public to one that considers the roles of intermediaries in forming and maintaining belief systems.
Let's normalize debunking each other
The spread of misinformation has become an epidemic, but information hygiene can help.

Beyond Misinformation: Social Media and the Sculpting of Epistemic Agency
ABSTRACT The dominant account of social media's epistemic harms focuses on the spread of misinformation and the production of false beliefs at scale. This paper argues that the misinformation narrative, whatever its merits, has obscured a deeper and more intimate form of epistemic damage. Dominant social media platforms do not merely supply bad inputs to stable epistemic machinery. They reshape the machinery itself. I argue that social media platforms are powerful engines for sculpting epistemic agency via two mechanisms: normative learning, through which users internalize descriptive and injunctive norms about how to interact with evidence, and reinforcement learning, through which habitual patterns of epistemic response are developed. In these ways, platforms can reshape users' epistemic styles, including their testimonial policies, evidential thresholds for belief revision, and theoretical values governing how they select explanations. This should trouble us, as the constraints driving which styles are produced are systematically orthogonal to truth and ignore information about the environments agents inhabit. This discussion identifies a neglected form of epistemic hostility: not the exploitation of existing cognitive vulnerabilities to implant false beliefs, but the production of new vulnerabilities that can then be exploited. From this, more and better evidence cannot save us.

The Role of Media in Political Polarization| Inoculation Can Reduce the Perceived Reliability of Polarizing Social Media Content
Little research is available on psychological interventions that counter susceptibility to polarizing online content. We conducted 3 studies (n1 = 472, n2 = 193, n3 = 772) to evaluate whether psychological resistance against polarizing social media content can be conferred, using the Bad News game, a “technique-based inoculation” intervention that simulates a social media feed. We investigate (1) whether technique-based inoculation can reduce susceptibility to content designed to fuel intergroup polarization; (2) whether technique-based inoculation can offer cross-protection against misinformation techniques that people were not inoculated against; and (3) whether political ideology plays a role in how people engage with anti-misinformation interventions. In Studies 1 and 3 (but not Study 2), we found that technique-based inoculation significantly reduces the perceived reliability of polarizing content and offers partial cross-protection against untreated misinformation techniques. We found no effect for attitudinal certainty and news-sharing intentions. Finally, we report preliminary evidence that people may choose to engage with politically congruent news topics within the intervention.
Practicing Information Sensibility: How Gen Z Engages with Online Information
Assessing the trustworthiness of information online is complicated. Literacy-based paradigms are both widely used to help and widely critiqued. We conducted a study with 35 Gen Zers from across the U.S. to understand how they assess information online. We found that they tended to encounter -- rather than search for -- information, and that those encounters were shaped more by social motivations than by truth-seeking queries. For them, information processing is fundamentally a social practice. Gen Zers interpreted online information together, as aspirational members of social groups. Our participants sought information sensibility: a socially-informed awareness of the value of information encountered online. We outline key challenges they faced and practices they used to make sense of information. Our findings suggest that like their information sensibility practices, solutions and strategies to address misinformation should be embedded in social contexts online.
