D2TS enables really powerful streaming joins, aggregations, etc. and will be powering a lot of Electric features in the future!This is an early preview but very cool tech. First Typescript implementation of Differential Dataflow afaik. https://t.co/i4qSJnVZWV— Kyle Mathews (@kylemathews) February 28, 2025
Stream Processing: Continuous Processing of Data Streams
Explore the Stream Processing design pattern for continuous asynchronous data flow, enhancing real-time data processing capabilities in enterprise applications using Clojure and leveraging functional programming principles.
Dremel: interactive analysis of web-scale datasets: Proceedings of the VLDB Endowment: Vol 3, No 1-2
Dremel is a scalable, interactive ad-hoc query system for analysis of read-only nested data. By combining multi-level execution trees and columnar data layout, it is capable of running aggregation queries over trillion-row tables in seconds. The system ...
Track your Data Pipelines
Track and document dplyr data pipelines. As you filter, mutate, and join your way through a data set, dtrackr seamlessly keeps track of your data flow and makes publication ready documentation of a data pipeline simple.
Overview — atex v0.9.1
Looking to use a data subscription service like the Firehose, Jetstream, or Tap? Check out Drinkup.
Delta-state CRDTs: indexed sequences with YATA
In this blog post we're coming back to indexed sequence CRDTs - we already discussed some operation-based approaches in the past. This time we'll cover YATA (Yet Another Transformation Approach): a delta-state based variant, introduced [https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=
FlowLog - Efficient and Extensible Datalog | FlowLog
FlowLog: Efficient and Extensible Datalog via Incrementality
protolab
A patchbay for your schemas. Bidirectional data transformations, drawn as circuits.
protolab
A patchbay for your schemas. Bidirectional data transformations, drawn as circuits.
Graft
Graft is an open-source transactional storage engine designed for efficient data synchronization at the edge.
Patrick Collison on Twitter / X
I want some kind of LLM workflow tool.• Ability to manage a set of input files (Markdown or similar), plus other general-purpose context.• With real-time collaboration. (And maybe some concept of snapshots or VCS integration.)• And the ability to create/manage a inference…— Patrick Collison (@patrickc) June 6, 2026
Johannes Schickling on Twitter / X
After 4 years of work, I'm incredibly excited to introduce LiveStore, the next-gen data layer I'm building for Overtone.It's based on reactive SQLite and has a built-in sync engine. Give it a try - would love your feedback! https://t.co/DB0cEXY9MD— Johannes Schickling (@schickling) May 27, 2025
Components in Markdown
Fast, streaming-ready markdown parser with Vue, React, and Svelte component support. Parse Comark content from strings or streams with TypeScript support.
I'll be talking about @astrosky.eco's nebra package, which makes it super easy to post & stream scientific data on the AT Protocol - including the two month-long tech demo of doing this that we've been running with NASA's astronomical transients feed!
Robin Berjon
Friends from the Internet! This Thursday, join us for CID Congress — with a session dedicated to SCIENCE and what fun content-addressed data can do there! luma.com/ptrjn16w
