Peer to peer and decentralized applications have been popular lately, but almost all of them rely on synchronizing append only logs of operations (or an equivalent). This leads to performance degredation over time as data accumulates and needs to be processed on new peers before they can start querying and updating data within an existing swarm. This post will talk about how pre-indexed peer to peer databases can be built and how they can sidestep the need to process operation logs and query data more efficiently. The short of it is that with this new data structure, the network becomes your database instead of needing to build a database after loading everything from the network.
Willow - Willow’25
Peer-to-peer protocols which scale up, down, and sideways. Sychronisable data storage, fine-grained access control, private and efficient synchronisation, and secure data delivery by any means possible.
Willow - Home
Peer-to-peer protocols which scale up, down, and sideways. Sychronisable data storage, fine-grained access control, private and efficient synchronisation, and secure data delivery by any means possible.
WillSearch – GuardianDB. A peer-to-peer database for the Decentralized Web.
A High-performance, local-first decentralized database built on Rust and Iroh
AWS re:Invent 2018: Amazon DynamoDB Under the Hood: How We Built a Hyper-Scale Database (DAT321)
Willow - Protocols for an uncertain future (FOSDEM'26)
Centralised systems were designed with the best of intentions, but were turned against us anyway. And peer-to-peer systems will be exactly the same. How do we make the next generation of protocols ...
How We Built an Offline-First Data Pipeline for Rural Cooperatives | HackerNoon
Learn how an offline-first data pipeline using edge computing and SQLite enabled reliable synchronization in low-connectivity regions.
neodb-social/neodb
🧩 a self-hosted server tracking what you read/watch/listen/play, powering a global distributed community federating via ActivityPub and ATProto.
FOSDEM 2026 - Willow - Protocols for an uncertain future
Centralised systems were designed with the best of intentions, but were turned against us anyway. And peer-to-peer systems will be exactly the same.
PowerSync: Backend DB - SQLite sync engine | For Postgres, MongoDB, MySQL, SQL Server
Automatically sync your backend database with in-app SQLite and avoid the complexities of using APIs to move app state over the network.
Personal sync servers for composable data
Exploring the possibilities of interoperability and composability for local-first software & data by using a personal sync server tied to an atproto identity
Personal sync servers for composable data
Exploring the possibilities of interoperability and composability for local-first software & data by using a personal sync server tied to an atproto identity
Serving DNS using a Peer-to-Peer Lookup Service
Download Citation | Serving DNS using a Peer-to-Peer Lookup Service | The current domain name system (DNS) couples ownership of domains with the responsibility of serving data for them. The DNS security extensions... | Find, read and cite all the research you need on ResearchGate
Fed up with Big Tech, communities turn to data collectives for control
Data collectives and cooperatives, which let creators control the collection and distribution of their data, are emerging as preferred alternatives to big tech companies.
Peter van Hardenberg - Ink and Switch, Automerge
Brendan O'Brien (number 0) - Can Sync Be Network-optional?