Social media companies make important decisions about what counts as “problematic” content and how they will remove it. Some choose to moderate hashtags, blocking the results for certain tag searches and issuing public service announcements (PSAs) when users search for troubling terms. The hashtag has thus become an indicator of where problematic content can be found, but this has produced limited understandings of how such content actually circulates. Using pro-eating disorder (pro-ED) communities as a case study, this article explores the practices of circumventing hashtag moderation in online pro-ED communities. It shows how (1) untagged pro-ED content can be found without using the hashtag as a search mechanism; (2) users are evading hashtag and other forms of platform policing, devising signals to identify themselves as “pro-ED”; and (3) platforms’ recommendation systems recirculate pro-ED content, revealing the limitations of hashtag logics in social media content moderation.
Social Media Is Now Parasocial Media
When practitioners used the term “social media” to describe the internet tools that emerged in the mid-aughts, they were giving a name to the kinds of platforms and protocols that allowed people to socialize with friends and communities of interest by using digital technologies. Twenty years later, users of social media are far more likely to scroll than post – and the content that they consume is often strategically produced and algorithmically curated. In this essay, I argue that the very essence of social media has changed. To more effectively interrogate what we are witnessing, we need to stop presuming that these tools are “social media” and begin recognizing that they are now “parasocial media.” Doing so raises new questions about digitally mediated sociality, not to mention the politics and governance of these platforms.
How Instagram's moderation rules are made
Cleaning Up the Streets: Understanding Motivations, Mental Models, and Concerns of Users Flagging Social Media Content
Social media platforms offer flagging, a technical feature that empowers users to report inappropriate posts or bad actors to reduce online harm. The deceptively simple flagging interfaces on nearly all major social media platforms disguise complex underlying interactions among users, algorithms, and moderators. Through interviewing 25 social media users with prior flagging experience, most of whom belong to marginalized groups, we examine end-users’ understanding of flagging procedures, explore the factors that motivate them to flag, and surface their cognitive and privacy concerns. We found that a lack of procedural transparency in flagging mechanisms creates gaps in users’ mental models, yet they strongly believe that platforms must provide flagging options. Our findings highlight how flags raise critical questions about distributing labor and responsibility between platforms and users for addressing online harm. We recommend innovations in the flagging design space that enhance user comprehension, ensure privacy, and reduce cognitive burdens.
Digital Social Norm Enforcement: Online Firestorms in Social Media
Actors of public interest today have to fear the adverse impact that stems from social media platforms. Any controversial behavior may promptly trigger temporal, but potentially devastating storms of emotional and aggressive outrage, so called online firestorms. Popular targets of online firestorms are companies, politicians, celebrities, media, academics and many more. This article introduces social norm theory to understand online aggression in a social-political online setting, challenging the popular assumption that online anonymity is one of the principle factors that promotes aggression. We underpin this social norm view by analyzing a major social media platform concerned with public affairs over a period of three years entailing 532,197 comments on 1,612 online petitions. Results show that in the context of online firestorms, non-anonymous individuals are more aggressive compared to anonymous individuals. This effect is reinforced if selective incentives are present and if aggressors are intrinsically motivated.
Digital Social Norm Enforcement: Online Firestorms in Social Media
Actors of public interest today have to fear the adverse impact that stems from social media platforms. Any controversial behavior may promptly trigger temporal, but potentially devastating storms of emotional and aggressive outrage, so called online firestorms. Popular targets of online firestorms are companies, politicians, celebrities, media, academics and many more. This article introduces social norm theory to understand online aggression in a social-political online setting, challenging the popular assumption that online anonymity is one of the principle factors that promotes aggression. We underpin this social norm view by analyzing a major social media platform concerned with public affairs over a period of three years entailing 532,197 comments on 1,612 online petitions. Results show that in the context of online firestorms, non-anonymous individuals are more aggressive compared to anonymous individuals. This effect is reinforced if selective incentives are present and if aggressors are intrinsically motivated.
Building A Prosocial Media Ecosystem | NOEMA
There’s never been a better time to make social media what it always should have been: a tool to strengthen rather than strip-mine the social fabric.
RIP social media. What comes next is messy.
As social media splinters, how can we keep the new online spaces from devolving into toxic pits of despair?
Harm Through the “#RizzCam”: Smart Glasses, Ambient Capture and Invisible Harassment
In online safety research, harassment is commonly understood as involving overt and unwanted acts that create a hostile environment for individuals or groups. Smart glasses, or wearable digital devices that are often indistinguishable from ordinary eyewear but can record video, audio and location data in real time, enable new forms of online harassment and gender-based harms that may not be recognised by current online safety or platform governance frameworks. Drawing on an interpretive content analysis of 350 point-of-view Instagram videos posted by individuals self-associated with the pick-up artistry (PUA) community, we examine how smart glasses can be used to harass women through what we call ambient capture. Ambient capture includes clandestine recording of people and social interactions within public, semi-private and private spaces. We argue this can constitute harassment when it is targeted at women and shared online without their consent. In our study, we found videos using ambient capture practices to harass women that had gone undetected by Instagram’s content moderation systems. These findings suggest online safety regimes and content moderation approaches should be assessed to ensure they account for the more invisible forms of harassment introduced by smart glasses and other wearable technologies.
Custodians of the Internet
A revealing and gripping investigation into how social media platforms police what we post online—and the large societal impact of these decisions Most use...
A perspective on friction interventions to curb the spread of misinformation
Social media has enabled the spread of information at unprecedented speeds and scales, and with it the proliferation of high-engagement, low-quality content. Friction—behavioral design measures that make the sharing of content more cumbersome—might be a way to raise the quality of what is spread online. In this perspective, we propose a scalable field experiment to study the effects of friction with a learning component to educate users on the platform’s community standards. Preliminary simulations from an agent-based model suggest that while friction alone may decrease the number of posts without improving their quality, it could significantly increase the average quality of posts when combined with learning. The model also suggests that too much friction could be counterproductive. Experimental interventions inspired by these findings would be minimally invasive.
Debate: Social media in children and young people – time for a ban? Weighing up the implications and limitations of age-based social media restrictions
Recent legislation in Australia banning social media accounts for children under 16, alongside similar proposals worldwide, has ignited debate about whether age-based restrictions are an effective way to protect young people's mental health. While the intent of such bans is to reduce exposure to harmful content, their feasibility and effectiveness remain unclear. Enforcement requires robust age verification, often relying on sensitive data such as government-issued identification or facial scans, which raises privacy concerns and can be circumvented through the use of VPNs. Moreover, social media use is diverse. Although it can intensify harms such as bullying, it also provides vital opportunities for connection and support, particularly for marginalised adolescents. Removing access to accounts may limit risks within platforms, but does not prevent exposure to harmful content elsewhere, nor does it guarantee increased offline engagement. Importantly, blanket bans fail to address unsafe design features embedded within social media or to equip adolescents with the skills needed to navigate online environments. More targeted, evidence-based regulation that promotes safer platform design and accountability may provide a more effective pathway to protecting young people's well-being.
Trust: Foundation of Human Knowledge yet online Platforms won't allow | David Karger | TEDxMIT Salon
Bonsai: Intentional and Personalized Social Media Feeds
Social media feeds use predictive models to maximize engagement, often misaligning how people consume content with how they wish to. We introduce Bonsai, a system that enables people to build personalized and intentional feeds. Bonsai implements a platform-agnostic framework comprising Planning, Sourcing, Curating, and Ranking modules. This framework allows users to express their intent in natural language and exert fine-grained control over a procedurally transparent feed creation process. We evaluated the system with 15 Bluesky users in a two-phase, multi-week study. We find that participants successfully used our system to discover new content, filter out irrelevant or toxic posts, and disentangle engagement from intent, but curating intentional feeds required more effort than they are used to. Simultaneously, users sought system transparency mechanisms to effectively use (and trust) intentional, personalized feeds. Overall, our work highlights intentional feedbuilding as a viable path beyond engagement-based optimization.
CivilServant: Citizen Science for Online Communities - Citizens and Technology Lab
Moderators of online communities, often volunteers, work hard to protect their communities from harassment, misinformation, trolls, and other online harms. But which policies and procedures actually work?
Study: Social media probably can’t be fixed
The [structural] mechanism producing these problematic outcomes is really robust and hard to resolve."
Scrolling Past Public Health Campaigns: Information Context Collapse on Social Media and Its Effects on Tobacco Information Recall
Although traditional media usually present content separated by topic, social media feeds are usually unsorted, shifting topics from post to post, a feature called “information context collapse.” Public health groups have often failed to consider how the presentation context of their campaigns may influence message reception. This study uses a mock social media feed that presents content across six topics in a sorted or unsorted fashion to see how presentation order of content influences recall of information about a novel tobacco product. The moderating impact of topic relevance and source congruency are also tested. Results show that for some measures of recall unsorted presentation reduced recall. Impacts of source congruency and topic relevance are reduced when the content is unsorted. The application of these findings for both scholarship and digital health campaigns is discussed.