The old world of content safety practices is dead, and the new one is struggling to be born.
Remotely Coerced Violence: 764, The Com Network, and the Hybridization of Threats - Combating Terrorism Center at West Point
Abstract: This article examines 764 and the wider Com Network as a case study in remotely coerced violence and the hybridization of contemporary terrorist and violent extremist threats. It argues that nihilistic violent extremism is best understood as a victim-driven, youth-centered online ecosystem in which status, belonging, and identity are earned through the production, circulation, … Continued
The Slow Death of Online Safety
I am a 15-year-old girl. Let me show you the vile misogyny that confronts me on social media every day | Anonymous
Objectification, hate, rape threats: the politicians debating online abuse mean well, but to truly understand, they need to see what I see
Bias, Skew, and Search Engines Are Sufficient to Explain Online Toxicity
U.S. political discourse seems to have fissioned into discrete bubbles, each reflecting its own distorted image of the world. Many blame machine-learning algorithms that purportedly maximize “engagement”—serving up content that keeps YouTube or Facebook users watching videos or scrolling through their feeds—for radicalizing users or strengthening their partisanship. Sociologist Shoshana Zuboff15 even argues that “surveillance capitalism” uses optimized algorithmic feedback for “automated behavioral modification” at scale, writing the “music” that users then “dance” to.
Bias, Skew, and Search Engines Are Sufficient to Explain Online Toxicity
U.S. political discourse seems to have fissioned into discrete bubbles, each reflecting its own distorted image of the world. Many blame machine-learning algorithms that purportedly maximize “engagement”—serving up content that keeps YouTube or Facebook users watching videos or scrolling through their feeds—for radicalizing users or strengthening their partisanship. Sociologist Shoshana Zuboff15 even argues that “surveillance capitalism” uses optimized algorithmic feedback for “automated behavioral modification” at scale, writing the “music” that users then “dance” to.
‘Now we don’t have a safe place’: sex workers’ social media site Switter shuts down amid legal fears
Platform says government changes to online safety and defamation laws in Australia, UK and US made it ‘impossible’ to comply
Online Safety Bills Are Fueling a New Wave of Internet Censorship
State and federal bills seek to limit minors’ access to social media, but civil liberties advocates warn that the resulting online censorship threatens constitutional rights without delivering real safety.
Resist ‘dangerous and socially unacceptable’ age checks for social media, scientists warn
Computer scientists are campaigning against the global march toward age checks online.
Digital Social Norm Enforcement: Online Firestorms in Social Media
Actors of public interest today have to fear the adverse impact that stems from social media platforms. Any controversial behavior may promptly trigger temporal, but potentially devastating storms of emotional and aggressive outrage, so called online firestorms. Popular targets of online firestorms are companies, politicians, celebrities, media, academics and many more. This article introduces social norm theory to understand online aggression in a social-political online setting, challenging the popular assumption that online anonymity is one of the principle factors that promotes aggression. We underpin this social norm view by analyzing a major social media platform concerned with public affairs over a period of three years entailing 532,197 comments on 1,612 online petitions. Results show that in the context of online firestorms, non-anonymous individuals are more aggressive compared to anonymous individuals. This effect is reinforced if selective incentives are present and if aggressors are intrinsically motivated.
Digital Social Norm Enforcement: Online Firestorms in Social Media
Actors of public interest today have to fear the adverse impact that stems from social media platforms. Any controversial behavior may promptly trigger temporal, but potentially devastating storms of emotional and aggressive outrage, so called online firestorms. Popular targets of online firestorms are companies, politicians, celebrities, media, academics and many more. This article introduces social norm theory to understand online aggression in a social-political online setting, challenging the popular assumption that online anonymity is one of the principle factors that promotes aggression. We underpin this social norm view by analyzing a major social media platform concerned with public affairs over a period of three years entailing 532,197 comments on 1,612 online petitions. Results show that in the context of online firestorms, non-anonymous individuals are more aggressive compared to anonymous individuals. This effect is reinforced if selective incentives are present and if aggressors are intrinsically motivated.
Why Protecting Kids from Social Media May Make Things Worse — Douglas Rushkoff
I’m supposed to give a talk next week about kids and social media and the need for more media literacy education, more regulation of platforms, and more substantive discussion about how to keep our kids from media-induced self-harm. The whole event is well-meaning, but is characterized by a sense of worry and protection. And for some reason, after years of making those sorts of arguments in my articles and documentaries, I have a strong impulse to pivot the other way.
The Kids Online Safety Act Will Make the Internet Worse for Everyone
Lawmakers who support KOSA today are choosing to trust the current administration, and future administrations, to define what youth—and to some degree, all of us—should be allowed to read online.
Reddit and the Struggle to Detoxify the Internet
From 2018: The trolls are winning. How do we fix life online without limiting free speech?
Online Safety Amendment (Social Media Minimum Age) Act 2024
The Online Safety Amendment Act 2024 is an Australian act of parliament that prohibits minors under the age of 16 from holding an account on certain social media platforms. It is an amendment to the Online Safety Act 2021 and was passed by the Parliament of Australia on 29 November 2024. It imposes monetary penalties on social media companies that fail to take reasonable steps to prevent minors under 16 that are located in Australia from having accounts on their services.
Debate: Social media in children and young people – time for a ban? Weighing up the implications and limitations of age-based social media restrictions
Recent legislation in Australia banning social media accounts for children under 16, alongside similar proposals worldwide, has ignited debate about whether age-based restrictions are an effective way to protect young people's mental health. While the intent of such bans is to reduce exposure to harmful content, their feasibility and effectiveness remain unclear. Enforcement requires robust age verification, often relying on sensitive data such as government-issued identification or facial scans, which raises privacy concerns and can be circumvented through the use of VPNs. Moreover, social media use is diverse. Although it can intensify harms such as bullying, it also provides vital opportunities for connection and support, particularly for marginalised adolescents. Removing access to accounts may limit risks within platforms, but does not prevent exposure to harmful content elsewhere, nor does it guarantee increased offline engagement. Importantly, blanket bans fail to address unsafe design features embedded within social media or to equip adolescents with the skills needed to navigate online environments. More targeted, evidence-based regulation that promotes safer platform design and accountability may provide a more effective pathway to protecting young people's well-being.
