







Distributed, masterless, high performance, fault tolerant data processing
Upstash: Serverless Data Platform - Redis, Vector, Search
Serverless Redis, Vector and Search databases with low latency and pay-as-you-go pricing. Upstash is the data platform for modern and AI applications — create a Redis database in seconds.

Cassandra: a decentralized structured storage system: ACM SIGOPS Operating Systems Review: Vol 44, No 2
Cassandra is a distributed storage system for managing very large amounts of structured data spread out across many commodity servers, while providing highly available service with no single point of failure. Cassandra aims to run on top of an ...

CRDTs: The Hard Parts
parallelchain-io/hotstuff_rs
Performant Byzantine Fault Tolerant State Machine Replication (BFT SMR) in Rust.
jazware/vlpds
Very Large PDS, a world-scale, incredibly efficient, incredibly resilient, atproto personal data server
Dynamo | Proceedings of twenty-first ACM SIGOPS symposium on Operating systems principles
Reliability at massive scale is one of the biggest challenges we face at Amazon.com, one of the largest e-commerce operations in the world; even the slightest outage has significant financial consequences and impacts customer trust. The Amazon.com ...

Bluefin
The next generation cloud-native Linux workstation, designed for reliability, performance, and sustainability.

AWS re:Invent 2018: Amazon DynamoDB Under the Hood: How We Built a Hyper-Scale Database (DAT321)
Egres: A Postgres-compatible database for heavy, multi-tenant workloads
I love Postgres. It is an incredible database. But, its design is also 30 years old and most of what people fight in production comes from decisions made long time ago: VACUUM, transaction id wraparound, bloat, a process per connection…

A distributed systems reliability glossary | Antithesis Docs
A list of key concepts for building and testing reliable distributed systems, with basic definitions and deep references.

MapReduce: Simplified Data Processing on Large Clusters
Our teams advance the state of the art through research, systems engineering, and collaboration across Google.

Graft
Graft is an open-source transactional storage engine designed for efficient data synchronization at the edge.
Nydus - Acceleration Framework For Cloud-Native Distribution
Nydus Provides Fast, Secure And Easy Access to Data Distribution
Conflict-Free Replicated Data Types
Replicating data under Eventual Consistency (EC) allows any replica to accept updates without remote synchronisation. This ensures performance and scalability in large-scale distributed systems (e.g., clouds). However, published EC approaches are ad-hoc and error-prone. Under a formal Strong Eventual Consistency (SEC) model, we study sufficient conditions for convergence. A data type that satisfies these conditions is called a Conflict-free Replicated Data Type (CRDT). Replicas of any CRDT are guaranteed to converge in a self-stabilising manner, despite any number of failures. This paper formalises two popular approaches (state- and operation-based) and their relevant sufficient conditions. We study a number of useful CRDTs, such as sets with clean semantics, supporting both add and remove operations, and consider in depth the more complex Graph data type. CRDT types can be composed to develop large-scale distributed applications, and have interesting theoretical properties.

Stream Processing: Continuous Processing of Data Streams
Explore the Stream Processing design pattern for continuous asynchronous data flow, enhancing real-time data processing capabilities in enterprise applications using Clojure and leveraging functional programming principles.
Home | cse223b
CSE 223B is a 4-unit graduate subject with lectures, paper discussions, a midterm, and technical report exercise, and a major term research project culminating in writing a research paper of your own. It will present abstractions and implementation techniques that facilitate the design of distributed systems–including both operating systems and sophisticated Internet servers–that can deal with the demands of real-world workloads. Topics will include efficient operating system primitives, high-performance network servers, load shedding, storage systems, security, and fault tolerance.