Go ahead and axolotl questions
Olmo Hybrid and future LLM architectures
The latest Olmo model and discussions at the frontier of open-source post training tools.
OpenAI's open source LLM is a reasoning model, coming Next Thursday!
1.1K votes, 257 comments. 756K subscribers in the LocalLLaMA community. Subreddit to discuss locally hostable AI.
Training great LLMs entirely from ground up in the wilderness as a startup — Yi Tay
Chronicles of training strong LLMs from scratch in the wild
open-slopware
Free/Open Source Software choosing to use and/or support LLM usage/AI, as well as alternatives and tips to requesting better policies or forking.
Histomat of F/OSS: We should reclaim LLMs, not reject them
A few days ago, I came across a blog post titled On FLOSS and training LLMs that articulates a growing frustration within the free and open source software…
Jan-Nano : 1st Deep Research LLM
Sakana AI on Twitter / X
We’re excited to introduce Text-to-LoRA: a Hypernetwork that generates task-specific LLM adapters (LoRAs) based on a text description of the task. Catch our presentation at #ICML2025!Paper: https://t.co/2FRiVF1UXJCode: https://t.co/rx4G7dq1SWBiological systems are capable of… pic.twitter.com/UdUYfqRXBS— Sakana AI (@SakanaAILabs) June 12, 2025
10 Easy Ways to Enhance Your LLM Wiki or Knowledge Base
Sebastian Raschka on Twitter / X
Pretty cool. I think 2025-2026 will be a stronger focus on these in open source tooling.I.e. having LLMs delegate knowledge-based queries to search, which in turn frees up model capacity to improve reasoning capabilities and tool use. https://t.co/wNTg283mb2— Sebastian Raschka (@rasbt) August 12, 2025
Announcing Burn-LM (alpha): LLM Inference Engine
We're happy to announce the Burn-LM, an LLM inference engine based on Burn! The goal is to support any large model, LLM, VLM, and others, for inference but also for training (pre-training, post-training, and fine-tuning).
Activation Oracles: Training and Evaluating LLMs as General-Purpose Activation Explainers
Clément Dumas4, Kit Fraser-Taliente6, Subhash Kantamneni6, Julian Minder3, Euan Ong6, Arnab Sen Sharma5, Daniel Wen1
Andrej Karpathy on Twitter / X
LLM Knowledge BasesSomething I'm finding very useful recently: using LLMs to build personal knowledge bases for various topics of research interest. In this way, a large fraction of my recent token throughput is going less into manipulating code, and more into manipulating…— Andrej Karpathy (@karpathy) April 2, 2026
Sakana AI on Twitter / X
We’re excited to introduce Doc-to-LoRA and Text-to-LoRA, two related research exploring how to make LLM customization faster and more accessible.https://t.co/wGKDNhBcJXBy training a Hypernetwork to generate LoRA adapters on the fly, these methods allow models to instantly… pic.twitter.com/gId3J6hgEr— Sakana AI (@SakanaAILabs) February 27, 2026
The Ultimate Guide to Fine-Tuning LLMs from Basics to Breakthroughs: An Exhaustive Review of Technologies, Research, Best Practices, Applied Research Challenges and Opportunities (Version 1.0)
