Legally Cognizable Manipulation

Digital Social Norm Enforcement: Online Firestorms in Social Media

Actors of public interest today have to fear the adverse impact that stems from social media platforms. Any controversial behavior may promptly trigger temporal, but potentially devastating storms of emotional and aggressive outrage, so called online firestorms. Popular targets of online firestorms are companies, politicians, celebrities, media, academics and many more. This article introduces social norm theory to understand online aggression in a social-political online setting, challenging the popular assumption that online anonymity is one of the principle factors that promotes aggression. We underpin this social norm view by analyzing a major social media platform concerned with public affairs over a period of three years entailing 532,197 comments on 1,612 online petitions. Results show that in the context of online firestorms, non-anonymous individuals are more aggressive compared to anonymous individuals. This effect is reinforced if selective incentives are present and if aggressors are intrinsically motivated.

Digital Social Norm Enforcement: Online Firestorms in Social Media

Actors of public interest today have to fear the adverse impact that stems from social media platforms. Any controversial behavior may promptly trigger temporal, but potentially devastating storms of emotional and aggressive outrage, so called online firestorms. Popular targets of online firestorms are companies, politicians, celebrities, media, academics and many more. This article introduces social norm theory to understand online aggression in a social-political online setting, challenging the popular assumption that online anonymity is one of the principle factors that promotes aggression. We underpin this social norm view by analyzing a major social media platform concerned with public affairs over a period of three years entailing 532,197 comments on 1,612 online petitions. Results show that in the context of online firestorms, non-anonymous individuals are more aggressive compared to anonymous individuals. This effect is reinforced if selective incentives are present and if aggressors are intrinsically motivated.

Exposing Cross-Platform Coordinated Inauthentic Activity in the Run-Up to the 2024 U.S. Election

Coordinated information operations remain a persistent challenge on social media, despite platform efforts to curb them. While previous research has primarily f

Online abuse: banning anonymous social media accounts is not the answer

In the wake of the tragic death of Sir David Amess, some politicians are calling for a law banning anonymous social media profiles. But it’s not the right way to tackle online abuse.

Online abuse: banning anonymous social media accounts is not the answer

In the wake of the tragic death of Sir David Amess, some politicians are calling for a law banning anonymous social media profiles. But it’s not the right way to tackle online abuse.

Custodians of the Internet

A revealing and gripping investigation into how social media platforms police what we post online—and the large societal impact of these decisions Most use...

Uncovering Coordinated Networks on Social Media: Methods and Case Studies

Coordinated campaigns are used to influence and manipulate social media platforms and their users, a critical challenge to the free exchange of information online. Here we introduce a general, unsupervised network-based methodology to uncover groups of accounts that are likely coordinated. The proposed method constructs coordination networks based on arbitrary behavioral traces shared among accounts. We present five case studies of influence campaigns, four of which in the diverse contexts of U.S. elections, Hong Kong protests, the Syrian civil war, and cryptocurrency manipulation. In each of these cases, we detect networks of coordinated Twitter accounts by examining their identities, images, hashtag sequences, retweets, or temporal patterns. The proposed approach proves to be broadly applicable to uncover different kinds of coordination across information warfare scenarios.

A General Method to Find Highly Coordinating Communities in Social Media through Inferred Interaction Links

Political misinformation, astroturfing and organised trolling are online malicious behaviours with significant real-world effects. Many previous approaches examining these phenomena have focused on broad campaigns rather than the small groups responsible for instigating or sustaining them. To reveal latent (i.e., hidden) networks of cooperating accounts, we propose a novel temporal window approach that relies on account interactions and metadata alone. It detects groups of accounts engaging in various behaviours that, in concert, come to execute different goal-based strategies, a number of which we describe. The approach relies upon a pipeline that extracts relevant elements from social media posts, infers connections between accounts based on criteria matching the coordination strategies to build an undirected weighted network of accounts, which is then mined for communities exhibiting high levels of evidence of coordination using a novel community extraction method. We address the temporal aspect of the data by using a windowing mechanism, which may be suitable for near real-time application. We further highlight consistent coordination with a sliding frame across multiple windows and application of a decay factor. Our approach is compared with other recent similar processing approaches and community detection methods and is validated against two relevant datasets with ground truth data, using content, temporal, and network analyses, as well as with the design, training and application of three one-class classifiers built using the ground truth; its utility is furthermore demonstrated in two case studies of contentious online discussions.

Trolling democracy: anonymity doesn’t cause conflicts, bad site design does

‘Don’t feed the trolls’, people on social media are told. By forcing people to use their real names online, the managers of online forums hope to shame trolls into silence. But, J…

Anonymity, pseudonymity, and the agency of online identity: Examining the social practices of r/Gonewild

A debate is currently raging regarding the value of anonymity online. On one side of the debate is Facebook, the world’s largest social network site. Facebook demands that people use their real names and is one of the leading forces behind the push towards a “real name” Internet. On the other side of the debate are scholars such as danah boyd and Bernie Hogan and sites such as 4chan and Reddit that view anonymity and pseudonymity as important to how people construct identity online. While much has been written about the benefits of anonymity and pseudonymity, there is a lack of published research examining specific practices enabled by pseudonyms. This paper provides a detailed account of the behaviors enabled through pseudonymous identity construction through a case study of the subreddit r/gonewild. The main contribution of the article is to provide a specific account of the costs of a totalizing embrace of the “real name” Internet.

Anonymity, pseudonymity, and the agency of online identity: Examining the social practices of r/Gonewild

A debate is currently raging regarding the value of anonymity online. On one side of the debate is Facebook, the world’s largest social network site. Facebook demands that people use their real names and is one of the leading forces behind the push towards a “real name” Internet. On the other side of the debate are scholars such as danah boyd and Bernie Hogan and sites such as 4chan and Reddit that view anonymity and pseudonymity as important to how people construct identity online. While much has been written about the benefits of anonymity and pseudonymity, there is a lack of published research examining specific practices enabled by pseudonyms. This paper provides a detailed account of the behaviors enabled through pseudonymous identity construction through a case study of the subreddit r/gonewild. The main contribution of the article is to provide a specific account of the costs of a totalizing embrace of the “real name” Internet.

Deliberation and Identity Rules: The Effect of Anonymity, Pseudonyms and Real-Name Requirements on the Cognitive Complexity of Online News Comments

How do identity rules influence online deliberation? We address this question by drawing on a data set of 45 million comments on news articles on the Huffington Post from January 2013 to May 2015. At the beginning of this period, the site allowed commenting under what we call non-durable pseudonyms. In December 2013, Huffington Post moved to regulate its forum by requiring users to authenticate their accounts. And in June 2014, Huffington Post outsourced commenting to Facebook altogether, approximating a ‘real-name’ environment. We find a significant increase in the cognitive complexity of comments (a proxy for one aspect of deliberative quality) during the middle phase, followed by a decrease following the shift to real-name commenting through Facebook. Our findings challenge the terms of the apparently simple trade-off between the goods and bads of anonymous and real-name environments and point to the potential value of durable pseudonymity in the context of online discussion.

Deliberation and Identity Rules: The Effect of Anonymity, Pseudonyms and Real-Name Requirements on the Cognitive Complexity of Online News Comments

How do identity rules influence online deliberation? We address this question by drawing on a data set of 45 million comments on news articles on the Huffington Post from January 2013 to May 2015. At the beginning of this period, the site allowed commenting under what we call non-durable pseudonyms. In December 2013, Huffington Post moved to regulate its forum by requiring users to authenticate their accounts. And in June 2014, Huffington Post outsourced commenting to Facebook altogether, approximating a ‘real-name’ environment. We find a significant increase in the cognitive complexity of comments (a proxy for one aspect of deliberative quality) during the middle phase, followed by a decrease following the shift to real-name commenting through Facebook. Our findings challenge the terms of the apparently simple trade-off between the goods and bads of anonymous and real-name environments and point to the potential value of durable pseudonymity in the context of online discussion.