Open-source platform for edge AI accelerator development
Bringing Edge AI to the Raspberry Pi GPU | Igalia
Igalia is an open source consulting firm specialised in the development of innovative projects and solutions. Our engineers have expertise in a wide range of technological areas, including browsers and client-side web technologies, graphics pipeline, compilers and virtual machines. We have the most WPE, WebKit, Chromium/Blink and Firefox expertise found in the consulting business, including many reviewers and committers. Igalia designs, develops, customises and optimises GNU/Linux-based solutions for companies across the globe. Our work and contributions are present in many projects such as GStreamer, Mesa 3D, WebKit, Chromium, etc.
google-ai-edge/LiteRT
LiteRT, successor to TensorFlow Lite. is Google's On-device framework for high-performance ML & GenAI deployment on edge platforms, via efficient conversion, runtime, and optimization
Together AI | The AI Native Cloud
Build what's next on the AI Native Cloud. Full-stack AI platform for inference, fine-tuning, and GPU clusters — powered by cutting-edge research.
Teaching AI to Optimize AI Models for Edge Deployment
How our agent, Möbius automated a Core ML port in ~12 h (vs. 2 weeks), hit 0.99998 parity, and made it 3.5× faster, while staying on the CPU.
TheStage AI – Faster, Cheaper AI Inference
Accelerate models on NVIDIA & edge. Full guides for setup, optimization & deploy. ANNA, QLIP, Elastic Models, CLI & API. Built for AI teams & devs.
ggml
AI inference at the edge. ggml has 22 repositories available. Follow their code on GitHub.
Microsoft is opening its on-device AI models up to web apps in Edge
Edge continues to compete with Chrome.
Google AI Edge Gallery launches on macOS, letting Mac users run Gemini models locally
In addition to Google AI Edge Gallery, the company also released the Gemma 4 12B model and the Google AI Edge Eloquent dictation app for the Mac.
Google AI Edge Gallery App - App Store
Download Google AI Edge Gallery by Google on the App Store. See screenshots, ratings and reviews, user tips and more games like Google AI Edge Gallery.
Why I hope Apple keeps investing in on-device AI
Edge intelligence is safer, more private, and less resource-intensive than cloud-based AI services.
mudler/LocalAI
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
OpenAI partners with Cerebras
OpenAI partners with Cerebras to add 750MW of high-speed AI compute, reducing inference latency and making ChatGPT faster for real-time AI workloads.
raullenchai/Rapid-MLX
The fastest local AI engine for Apple Silicon. 4.2x faster than Ollama, 0.08s cached TTFT, 100% tool calling. 17 tool parsers, prompt cache, reasoning separation, cloud routing. Drop-in OpenAI replacement. Works with Claude Code, Cursor, Aider.
raullenchai/Rapid-MLX
The fastest local AI engine for Apple Silicon. 4.2x faster than Ollama, 0.08s cached TTFT, 100% tool calling. 17 tool parsers, prompt cache, reasoning separation, cloud routing. Drop-in OpenAI replacement. Works with Claude Code, Cursor, Aider.
Liquid AI Launches LEAP and Liquid Apollo: The Easiest Way to Build with On-Device AI | Liquid AI
Today marks a pivotal milestone in the evolution of edge AI. Liquid AI is thrilled to announce LEAP v0, our first developer-ready platform for on-device AI deployment—and Liquid Apollo, a lightweight iOS-native application built to showcase and stress-test small foundation models directly on your phone.
Cloudflare Workers AI | Open-source AI inference
Workers AI facilitates the scalable development & deployment of AI applications at the edge.
