hyperfine

Speed Comparison - Programming Languages

Benchmarks run on GitHub Actions. Results may vary based on runner hardware.

tinylibs/tinybench

🔎 A simple, tiny and lightweight benchmarking library!

eugr/llama-benchy

llama-benchy - llama-bench style benchmarking tool for all backends

Wolfram LLM Benchmarking Project

Results from Wolfram's ongoing tracking of LLM performance. The benchmark is based on a Wolfram Language code generation task.

jondot/hygen

The simple, fast, and scalable code generator that lives in your project.

leobeeson/llm_benchmarks

A collection of benchmarks and datasets for evaluating LLM.

Benchmarks | EXO

Transparent benchmarks for LLMs tested on real hardware. Coming soon.

harbor-framework/terminal-bench

A benchmark for LLMs on complicated tasks in the terminal

Compiling Models to Megakernels

Fine-grained synchronization, deep pipelines, and zero kernel launch overheads, automatically.

AI Coding Agent Benchmarks & Leaderboard | Artificial Analysis

We measure real-world performance of coding agents on software engineering tasks, including cost, token usage, and execution time. We compare how performance changes across agents, models, and execution settings.

Performance Explorer — oMLX

Compare model performance across context lengths with community benchmark data.

Towards a Better GUI Programming Benchmark | HackerNoon

GUI <a href="https://hackernoon.com/tagged/programming" target="_blank">programming</a> is <a href="https://medium.com/@eugenkiss/challenges-in-gui-programming-65d360466e3f" target="_blank">challenging</a>. We strive to find better ways to program GUIs and we do make progress. The fact that countless GUI toolkits with different ways to develop GUIs exist indicates that the road ahead is still long. If only there was a benchmark to compare GUI programs with one another. Then identifying good ideas would become much easier.

Model Performance Evaluation to SubQ 1.1 Small Preview Performance Evaluation | Appen

A third-party benchmark assessment of Subquadratic's preview models, conducted by Appen across long-context retrieval, code generation, business-workflow automation, and graduate-level reasoning benchmarks.

Code Galaxies Visualization

Code galaxies visualization allows you to explore huge graphs of software package managers (npm, go, ruby gems, composer, etc.)