Models, runtime & infrastructure to make on-device AI interactive, ambient & continuous.
Part 4: Brief history of Apple ML Stack
By Mirai Labs, frontier on-device AI lab. Building the models, inference runtime, and quantization stack from the device constraint up.
Part 3: iPhone Hardware and How It Powers On-Device AI
By Mirai Labs, frontier on-device AI lab. Building the models, inference runtime, and quantization stack from the device constraint up.
Melange | On-device AI for Mobile
Select. Benchmark. Deploy | End-to-end on-device AI deployment tool for mobile devs.
Mirai for MacOS: A faster, simpler alternative to Ollama and LM Studio
Chat with your favorite AI models directly on your Mac. Privately and securely. Built natively for macOS and Apple Silicon.
Introducing On device AI capabilities inside the Craft Assistant
A first look at the future of on-device AI models integrated into productivity tools
Introducing Pipette: A benchmarking suite for on-device intelligence — Blog
Meet Pipette, an open-source platform for reproducible on-device AI benchmarks across models, quantization, runtimes and hardware.
Desktop, Touch, Browser, Now AI? The Next OS in Computing
Explore how AI is reshaping human-computer interaction, from command lines to modern SaaS. Key insights on the next computing paradigm for startups and tech leaders.
Osaurus — Own Your AI on Apple Silicon
Own your AI: local-first agents with memory, tools, and identity on Apple Silicon. Offline, open source, and API-compatible with OpenAI, Anthropic, and Ollama.
Osaurus — Own Your AI on Apple Silicon
Own your AI: local-first agents with memory, tools, and identity on Apple Silicon. Offline, open source, and API-compatible with OpenAI, Anthropic, and Ollama.
Play for On-device AI (beta) | Other Play guides | Android Developers
Play for On-device AI enables developers to efficiently distribute custom machine learning models via Android App Bundles and Google Play, offering various delivery modes and device targeting capabilities to optimize deployment on Android devices.
Sentient OS - Proactive Intelligence with on-device AI
An on-device LLM understands your entire life, then proactively offers to get your work done through computer use. Private by design. Free and open source.
Locally AI - Run AI models locally on your iPhone, iPad, and Mac.
Run Llama, Gemma, Qwen, DeepSeek, and more on your iPhone, iPad, and Mac. Optimized for Apple Silicon. Offline. Private.
LukeW | Common AI Product Issues
At this point, almost every software domain has launched or explored AI features. Despite the wide range of use cases, most of these implementations have been t...
Google for Developers Blog - News about Web, Mobile, AI and Cloud
LiteRT is the universal framework for on-device AI. The production stack delivers 1.4x faster cross-platform GPU performance, streamlined NPU acceleration, and superior GenAI support for open models like Gemma.
Building AI apps? You need sync | Electric
AI apps are collaborative. Building them requires solving resumability, interruptibility, multi‑tab, multi‑device and multi‑user.
