Benchmarks run on GitHub Actions. Results may vary based on runner hardware.
Wolfram LLM Benchmarking Project
Results from Wolfram's ongoing tracking of LLM performance. The benchmark is based on a Wolfram Language code generation task.
WarpBuild - 2x faster, 50% cheaper Github Actions runners
WarpBuild is a drop in replacement for Github runners that are 2x faster and 50% cheaper.
Towards a Better GUI Programming Benchmark | HackerNoon
GUI <a href="https://hackernoon.com/tagged/programming" target="_blank">programming</a> is <a href="https://medium.com/@eugenkiss/challenges-in-gui-programming-65d360466e3f" target="_blank">challenging</a>. We strive to find better ways to program GUIs and we do make progress. The fact that countless GUI toolkits with different ways to develop GUIs exist indicates that the road ahead is still long. If only there was a benchmark to compare GUI programs with one another. Then identifying good ideas would become much easier.
The Fastest Way to Run GitHub Actions | Blacksmith
Speed up your GitHub actions with Blacksmith. Run CI/CD 2x faster, download caches 4x faster, build Docker images 40x faster, and eliminate queue times. Start free today.
AI Coding Agent Benchmarks & Leaderboard | Artificial Analysis
We measure real-world performance of coding agents on software engineering tasks, including cost, token usage, and execution time. We compare how performance changes across agents, models, and execution settings.
MirrorCode: A benchmark for real-world software projects
Playwright on GitHub Actions: The setup that actually runs fast
Playwright CI should not crawl. Learn how to cache browsers, run tests in parallel, and cut GitHub Actions time fast.
GitHub Accelerator
We want to jumpstart more ways for developers to work on open source full-time.
I made a build visualizer to understand Bun’s compile times
I built buildprof (Github), an open-source tracing tool that shows where the time goes when you compile software on Linux. Here’s a realtime video of it profiling a clean build of ripgrep: Watch the …
Slow Software
What it means for software to be fast, and why most software is not.
Wirth's law
Wirth's law is Niklaus Wirth's variant of the Jevons paradox: Software is getting slower more rapidly than hardware is getting faster.
Compiling Models to Megakernels
Fine-grained synchronization, deep pipelines, and zero kernel launch overheads, automatically.
GitHub - AbdelStark/jev-benchmarks at 0d610cc53e79bcbec691312b0c4adb4a0e371642
Probability-aware evaluation for typed decision models: calibration, selective risk, latency, and reproducible benchmarks. - AbdelStark/jev-benchmarks