DuckLake is a next generation data lakehouse and open table format. It is significantly simpler and faster than Apache Iceberg or Delta Lake because it uses a SQL database for storing the catalog and metadata. This post covers an architecture deep dive with a detailed Q&A section. DuckLake consists of 3 components: storage, catalog, and compute. Each can be scaled independently, hosted locally with ease, and deployed to the cloud for production. MotherDuck offers managed DuckLake lakehouses for additional simplicity and performance.
Understanding new Cloud Storage hierarchical namespace | Google Cloud Blog
The new hierarchical namespace capabilities bring file system optimizations to Cloud Storage buckets.
Willow - Home
Peer-to-peer protocols which scale up, down, and sideways. Sychronisable data storage, fine-grained access control, private and efficient synchronisation, and secure data delivery by any means possible.
Wildland – an open data management protocol
Wildland is a docker for your data. You can store, organize and access your data however and wherever you want.
AWS re:Invent 2018: Amazon DynamoDB Under the Hood: How We Built a Hyper-Scale Database (DAT321)
Apache Iceberg: The Definitive Guide | Dremio
Learn everything about Apache Iceberg, the open table format for big data, in this definitive guide by Dremio. Discover best practices, architecture insights, and implementation strategies.
Dremel: interactive analysis of web-scale datasets: Proceedings of the VLDB Endowment: Vol 3, No 1-2
Dremel is a scalable, interactive ad-hoc query system for analysis of read-only nested data. By combining multi-level execution trees and columnar data layout, it is capable of running aggregation queries over trillion-row tables in seconds. The system ...
Build Bigger With Small Ai: Running Small Models Locally
designing a storage engine for AT Protocol backlinks - charlotte!
economical full-network-scale application-agnostic data storage
Ryan Dahl on Twitter / X
Introducing celld: a self-hosted, distributed Durable Objects and Workers implementation- celld = V8 + S3 + SQLite + LTX+ Tokio- programmed with exactly the Cloudflare Workers/DO JavaScript APIs and config- order of magnitude cheaper at scale- writes are durable before… pic.twitter.com/KCBf6U5DQw— Ryan Dahl (@rough__sea) August 5, 2026
Comparator | Reservoir
Reservoir is the package registry for Lake, the build system and package manager of the Lean programming language and theorem prover.
Cloudflare Containers - Open Beta Launch Event Recording
Watch our container platform open beta launch event! Learn about the platform, see demos, explore the road map, and get your questions answered.
Microsoft reveals findings from Project Natick, its experimental undersea datacenter
A #DuckDB file doesn't have to contain any data. It can store nothing but view definitions pointing at files stored somewhere else, such as Parquet on object storage. The file stays a few hundred KBs no matter how large the data it describes. In this post, we create such a small shareable catalog:
A DuckDB Database with No Data in It
duckdb.org