Convert any PEFT LoRA adapter into GGUF and run it with any GGUF base model
Gnat LoRa+GNSS Asset Tracker
Ultra-small, ultra-low-power LoRa/LoRaWAN + Concurrent GNSS Asset Tracker
Thireus/GGUF-Tool-Suite
Produce your own Dynamic 3.0 Quants and achieve optimum accuracy & SOTA quantization performance! Input a target size and the toolchain will create a GGUF recipe tuned to your hardware within seconds — flexible model sizing and lowest achievable perplexity/kld for GGUF enthusiasts seeking precise and automated dynamic quant production.
Arcee AI | Use MergeKit to Extract LoRA Adapters from any Fine-Tuned Model
We show you how to use Arcee's MergeKit to extract LoRA adapters from fine-tuned models, then leverage the Hugging Face Hub to create a library of general and task-specific LoRA adapters.
FOSDEM 2022 - LibVF.IO: vGPU & SR-IOV on Consumer GPUs using Nim
I'd like to showcase LibVF.IO's new LIME Runtime feature (Lime Is Mediated Emulation) and do a deep dive on open source vGPU technology in general.
Llama 4: How to Run & Fine-tune | Unsloth Documentation
How to run Llama 4 locally using our dynamic GGUFs which recovers accuracy compared to standard quantization.
Vaibhav (VB) Srivastav on Twitter / X
Hello local LLM enjoyers, starting today you should be able to find if you can run a GGUF directly from the Hugging Face page! 🔥Super psyched to see this out in the wild - this has been a big ask from the community!P.S. It'll pick all the hardwares you've defined under your… pic.twitter.com/7PTFCUHftl— Vaibhav (VB) Srivastav (@reach_vb) April 1, 2025
Benjamin Marie (@bnjmnmarie)
A new alternative to Ollama: You can now run models directly through Unsloth (with Docker): https://docs.unsloth.ai/models/how-to-run-llms-with-docker It supports the same models as llama.cpp, which I guess means it runs on llama.cpp… But this way you don’t need to set up anything, if you already have Docker installed.
HipScript: Run HIP and CUDA code with WebGPU
Online compiler for HIP and NVIDIA® CUDA® code to WebGPU
android/android-grpc/python/aemu-grpc - platform/external/qemu - Git at Google