







Recently there has been a lot of development in realtime data processing systems, including Twitter's Storm and Heron, Google's Millwheel, a...
Facebook Reveals Final Piece In Scalable Data Center Vision | TechCrunch
Facebook revealed the final piece in its scalable data redesign today, one that completes its vision of redefining traditional hardware and software to

surrealdb/surrealdb
A scalable, distributed, collaborative, document-graph database, for the realtime web
Liquid AI on Twitter / X
Today, we announce 𝙻𝚒𝚚𝚞𝚒𝚍 𝚁𝙸𝙿𝙻 (real-time inference pipeline), our ultra low-latency inference engine built to put LFMs directly in the request path of real-time workloads like search, ads, fraud, recommendations, and payments.> complete generated responses end-to-end… pic.twitter.com/m8zzApzOCT— Liquid AI (@liquidai) October 22, 2026
Stream Processing: Continuous Processing of Data Streams
Explore the Stream Processing design pattern for continuous asynchronous data flow, enhancing real-time data processing capabilities in enterprise applications using Clojure and leveraging functional programming principles.
Data Science of the Facebook World
Stephen Wolfram shares interesting Facebook data analysis finds from the Data Donor program of Wolfram|Alpha Personal Analytics for Facebook.
Bluesky Firehose
Real-time Jetstream analytics for sentiment, hashtags, and network health.

Speeding Up RSS | TechCrunch
I'm sorry, but RSS feeds are way too slow. I know this first-hand. As part of my job here at TechCrunch, I monitor a lot of RSS feeds for breaking news. We also produce our own feed and I can see how quickly it propagates to various feed readers and feed-powered news aggregation services. The lag time between posting a story and seeing it pop up in the RSS feed is usually a few minutes, and then it can take another 10 to 15 minutes or so for it to appear in something like Google Reader. And the TechCrunch feed is probably checked more frequently for updates than most other feeds. In our business, every second counts and RSS just isn't cutting it. While there is an argument to be made that RSS is dying, being replaced by more instantaneous forms of content delivery such as Twitter and other real time streams, many people aren't quite yet ready to give up on it. Instead, they want to save it by speeding it up. Tomorrow, at our Real Time Stream CrunchUp, we will see three demos of projects that do just that in slightly different ways.
Two Facebook and Google geniuses are combining search and AI to transform HR | TechCrunch
Two former product wizards from Facebook and Google are combining Silicon Valley's buzziest buzz words -- search, artificial intelligence, and big data --

Spiral on Twitter / X
4/ Spiral is our database built on Vortex: • Direct S3 → GPU data loading (skip the CPU bottleneck) • One API for 10KB embeddings AND 4GB videos • Time-bounded, audited permissions (no more credentials passed to AI agents) • Actually saturates your GPUs— Spiral (@SpiralDB) September 11, 2025
The Real-Time Collaboration Engine
Convergence is a next generation API that allows developers to build rich, real-time collaboration into their applications.

Your Data Fits in Memory (GraphD Part 1)
We need a fast way to query multiple potentially large sets of data on-demand at interactive speeds. Sometimes the easiest solution to a hard problem is to build the right tool for the job.
BlueSky - The Future of Social Media
Watch BlueSky's user base grow in real-time. Innovative, decentralized social networking is here!

The blacksky.community web application now uses our own API servers to load posts, timelines and profiles. When data is missing (accounts on the edges of the network, outside of our primary community, etc) we leverage @microcosm.blue
Blacksky
blacksky.communityI know I’ve said this before and recently, but I’m over the skeuomorphic UX of Bluesky that makes it look and feel like a 20 year old social media app. I’m ready for new experiences for this kind of media/data. This information architecture is played out. Let’s try some new ideas with other clients.