Vaibhav (VB) Srivastav on Twitter / X

Vaibhav (VB) Srivastav on Twitter / X

🚨 Apple just released FastVLM on Hugging Face - 0.5, 1.5 and 7B real-time VLMs with WebGPU support 🤯> 85x faster and 3.4x smaller than comparable sized VLMs> 7.9x faster TTFT for larger models> designed to output fewer output tokens and reduce encoding time for high… pic.twitter.com/7cPBWdTQw3— Vaibhav (VB) Srivastav (@reach_vb) August 29, 2025

Vaibhav (VB) Srivastav on Twitter / X

I do agree to some extent - I do use variety of proprietary models for day to day use both as a soundboard and for workHowever, majority of the issues with local LLMs today is in the scaffolding/ runner - in most cases if you’re getting sub-par outputs - it’s the chat template,…— Vaibhav (VB) Srivastav (@reach_vb) November 25, 2025

**An Edge-First Generalized LLM LoRA Fine-Tuning Framework for Heterogeneous GPUs**

A Blog post by QVAC on Hugging Face

Thireus/GGUF-Tool-Suite

Produce your own Dynamic 3.0 Quants and achieve optimum accuracy & SOTA quantization performance! Input a target size and the toolchain will create a GGUF recipe tuned to your hardware within seconds — flexible model sizing and lowest achievable perplexity/kld for GGUF enthusiasts seeking precise and automated dynamic quant production.

Georgi Gerganov on Twitter / X

HuggingFace just shipped in-browser GGUF editingIt allows you to edit GGUF metadata in the comfort of your browser, without having to even download the full model. This feature is enabled via the Xet technology that makes partial file updates possible. pic.twitter.com/uKqsvfLHcT— Georgi Gerganov (@ggerganov) October 7, 2025

FOSDEM 2022 - LibVF.IO: vGPU & SR-IOV on Consumer GPUs using Nim

I'd like to showcase LibVF.IO's new LIME Runtime feature (Lime Is Mediated Emulation) and do a deep dive on open source vGPU technology in general.

GPU Poor LLM Arena - a Hugging Face Space by k-mktr

Compact LLM Battle Arena: Frugal AI Face-Off!

The State of On-Device LLMs

Xuan-Son Nguyen, an engineer at Hugging Face, specializes in on-device large language models (LLMs) and runtime optimization, working extensively with llam...

The State of On-Device LLMs

Xuan-Son Nguyen, an engineer at Hugging Face, specializes in on-device large language models (LLMs) and runtime optimization, working extensively with llam...

Dynamic 1-bit DeepSeek-R1-0528 GGUFs out now!

118 votes, 16 comments. Hey guys sorry for the wait, but now you can now run DeepSeek-R1-0528 with our Dynamic 1-bit GGUFs!…

Llama 4: How to Run & Fine-tune | Unsloth Documentation

How to run Llama 4 locally using our dynamic GGUFs which recovers accuracy compared to standard quantization.

v0 App

Download v0 by Vercel, Inc on the App Store. See screenshots, ratings and reviews, user tips, and more apps like v0.

Ellora: Enhancing LLMs with LoRA - Standardized Recipes for Capability Enhancement

A Blog post by Asankhaya Sharma on Hugging Face