Scaling is a complex topic, but after working at big tech on services handling millions of requests and scaling my own startup (AlgoMaster.io) from scratch, I’ve realized that most systems evolve through a surprisingly similar set of stages as they grow.
How To Scale a Development Team
As hackers, we’re familiar with the need to scale web servers, databases, and other software systems. An equally important challenge in a growing business is scaling your development team.
The Value of Getting Closer to the Work
Scaling The core problem of scaling a team is that not everyone can know everything. Scaling is the work of systematizing that – so that things are understandable, knowable. It’s turnin…
Build Bigger With Small Ai: Running Small Models Locally
Paul Frazee — Solving for scale in open networks
The AI Scaling Problem
eBPF and Kubernetes: Little Helper Minions for Scaling Microservices - Daniel Borkmann, Cilium
How To Scale Your Model
Training LLMs often feels like alchemy, but understanding and optimizing the performance of your models doesn't have to. This book aims to demystify the science of scaling language models: how TPUs (and GPUs) work and how they communicate with each other, how LLMs run on real hardware, and how to parallelize your models during training and inference so they run efficiently at massive scale. If you've ever wondered “how expensive should this LLM be to train” or “how much memory do I need to serve this model myself” or “what's an AllGather”, we hope this will be useful to you.
Declarative Server with NixOS: A Reproducible Infrastructure | Mustafa Erbay
A technical guide exploring how to create a declarative server configuration with NixOS, covering reproducibility and rollback processes.
AWS re:Invent 2018: Amazon DynamoDB Under the Hood: How We Built a Hyper-Scale Database (DAT321)
Scale deep — The Systems Sanctuary
The world calls us to shift our mindsets and values from outdated ways of being and doing rooted in dominance, hierarchy and harmful systems, towards new ways rooted in relationship, collaboration and innovation.
Adopt and scale Team Topologies: platform-as-a-product, templates, more. — Team Topologies - Organizing for fast flow of value
Accelerate value with Team Topologies: measure cognitive load, define team boundaries, apply inverse Conway, readiness assessments, and more for fast delivery.
Scaling Engineering Teams: Lessons from Google, Facebook, and Netflix
After spending over a decade in engineering leadership roles at some of the world’s most chaotic innovation factories—Google, Facebook, and Netflix—I’ve learned one universal truth: scaling e…
When to Design for Emergence
Market applications on the long-tail of user needs
An unordered / non-exhaustive list of things that helped scale Bluesky's infra efficiently: + Exiting the cloud (colocation) + HAProxy w/many Node backends + Go w/clever code + ScyllaDB + SQLite w/per user databases + Redis w/many instances + AMD servers w/many cores + Purchasing bandwidth directly
