Inference engine
Dria on Twitter / X
Introducing Inference Arena v2.0.An agentic experience that searches, analyzes, and delivers insights about LLM inference.When we first launched, our goal was simple: make it easier for developers to compare models, engines, and hardware without digging through scattered… pic.twitter.com/fgWgos48lW— Dria (@driaforall) September 30, 2025
Open Models Inference for Coding · Umans AI
Hosted Kimi K3, GLM 5.2, and DeepSeek V4 Flash. Pay per token, on infrastructure we own.
Overview - GroqDocs
Fast LLM inference, OpenAI-compatible. Simple to integrate, easy to scale. Start building in minutes.
reinterpretcat/qwen3-rs
An educational Rust project for exporting and running inference on Qwen3 LLM family
Structured Outputs with Will Kurt and Cameron Pfiffer - Weaviate Podcast #119!
Running inference in web extensions | The Mozilla Blog
Image generated by DALL*E We’re shipping a new API in Firefox Nightly that will let you use our Firefox AI runtime to run offline machine learning tasks
tanishqkumar/ssd
A lightweight inference engine supporting speculative speculative decoding (SSD).
Introduction - How to Write an Inference Engine
A zero-to-hero guide to Muse Glimmer on Apple Metal, kvpack, and disaggregated NVFP4 prefill.
Part 4: Brief history of Apple ML Stack
By Mirai Labs, frontier on-device AI lab. Building the models, inference runtime, and quantization stack from the device constraint up.
Reproducible Execution Environment (REE) | Tech | Gensyn
Run AI model inference in a machine-agnostic environment where the same model and inputs produce the same outputs across supported hardware.
videlalvaro/ane-book
Production LLM inference on the Apple Neural Engine — a practitioner's guide, complete with converters, Swift runtimes, and validated model manifests
Hatice Ozen on Twitter / X
PSA: @OpenAI is putting the Open back in OpenAI and @GroqInc has Day 0 support. 🤗GPT-OSS 20B and 120B, hybrid-reasoning models with built-in browser search and code execution are now live for instant inference.P.S. We've also launched OpenAI Responses API compatibility. pic.twitter.com/CK7StvMSpr— Hatice Ozen (@ozenhati) August 5, 2025
