‘Distillation attacks’ is a horrible term for what is happening right now.
241. Distillation Is Not Anti-American, Weaponizing It Is
Recent attempts at pursuing government intervention in distillation of AI models are short-sighted and technically weak arguments to attempt regulatory capture
What is Knowledge distillation? | IBM
Knowledge distillation is a machine learning technique used to transfer the learning of a large pre-trained “teacher model” to a smaller “student model.”
Detecting and preventing distillation attacks
Anthropic is an AI safety and research company that's working to build reliable, interpretable, and steerable AI systems.
Hyperstition
A hyperstition is a self-fulfilling idea that becomes real through its own existence.[1] The price of Bitcoin,[2] Roko's Basilisk,[3] accelerationism,[4] and the QAnon conspiracy theory[5] have all been described as hyperstitions. Self-fulfilling prophecies are a kind of hyperstition where predictions are made about the future that become true by being known.[6] The concept was coined by Nick Land in 1995 as a portmanteau of hyper- and superstition,[7] during his time at the Cybernetic Culture Research Unit developing the philosophy of accelerationism.[3][8]
Everything You Need to Know about Knowledge Distillation
A Blog post by Ksenia Se on Hugging Face
On-Policy Distillation
On-policy, dense supervision is a useful tool for distillation
A Potential Termination Event
Cascading failure across the global food system is a real and horrific possibility, which most governments are doing nothing to avert.
Hedgie on Twitter / X
🦔 A group of Princeton researchers is calling Big Tech's extraction of human attention "human fracking." The analogy: just as oil companies pump high-pressure chemicals into the ground to force out petroleum, tech companies pump endless streams of addictive content into our… pic.twitter.com/UKzjH7E2iX— Hedgie (@HedgieMarkets) January 19, 2026
Distillation Scaling Laws
We propose a distillation scaling law that estimates distilled model performance based on a compute budget and its allocation between the…
Paranoia: A Beginner's Guide — LessWrong
People sometimes make mistakes. (Citation Needed) …
Dopamine Fracking
The act of pumping immense, disproportionate resources into a previously casual or complex and layered activity to forcefully extract and squeeze out the purest, most concentrated dopamine hit
Let's normalize debunking each other
The spread of misinformation has become an epidemic, but information hygiene can help.
Cleaning up a coal-fired mess
China’s green-industrial complex makes deep decarbonisation possible, but far from inevitable
I am disappointed by the fact that so many seem tempted to share a "nonrigorous", unserious attempt at quantifying fraud in science because it passes some silly vibe check ("I asked others and they agree"). So in the name of good science, we're ready to produce bad science as a rhetorical tool.
