Convert any PEFT LoRA adapter into GGUF and run it with any GGUF base model
Gnat LoRa+GNSS Asset Tracker
Ultra-small, ultra-low-power LoRa/LoRaWAN + Concurrent GNSS Asset Tracker
Thireus/GGUF-Tool-Suite
Produce your own Dynamic 3.0 Quants and achieve optimum accuracy & SOTA quantization performance! Input a target size and the toolchain will create a GGUF recipe tuned to your hardware within seconds — flexible model sizing and lowest achievable perplexity/kld for GGUF enthusiasts seeking precise and automated dynamic quant production.
Arcee AI | Use MergeKit to Extract LoRA Adapters from any Fine-Tuned Model
We show you how to use Arcee's MergeKit to extract LoRA adapters from fine-tuned models, then leverage the Hugging Face Hub to create a library of general and task-specific LoRA adapters.
FOSDEM 2022 - LibVF.IO: vGPU & SR-IOV on Consumer GPUs using Nim
I'd like to showcase LibVF.IO's new LIME Runtime feature (Lime Is Mediated Emulation) and do a deep dive on open source vGPU technology in general.
Llama 4: How to Run & Fine-tune | Unsloth Documentation
How to run Llama 4 locally using our dynamic GGUFs which recovers accuracy compared to standard quantization.
Vaibhav (VB) Srivastav on Twitter / X
Hello local LLM enjoyers, starting today you should be able to find if you can run a GGUF directly from the Hugging Face page! 🔥Super psyched to see this out in the wild - this has been a big ask from the community!P.S. It'll pick all the hardwares you've defined under your… pic.twitter.com/7PTFCUHftl— Vaibhav (VB) Srivastav (@reach_vb) April 1, 2025
Benjamin Marie (@bnjmnmarie)
A new alternative to Ollama: You can now run models directly through Unsloth (with Docker): https://docs.unsloth.ai/models/how-to-run-llms-with-docker It supports the same models as llama.cpp, which I guess means it runs on llama.cpp… But this way you don’t need to set up anything, if you already have Docker installed.
If you build it (together), they will come…
Mozilla and the Khronos Group collaborate to bring glTF capabilities to Blender
Zamzar - video converter, audio converter, image converter, eBook converter
Free online video converter, audio converter, image converter, eBook converter. No download or account required.
HipScript: Run HIP and CUDA code with WebGPU
Online compiler for HIP and NVIDIA® CUDA® code to WebGPU