







Case studies in scientific reproducibility
Konrad Hinsen's blog
Thirty years after my first contact with computational (ir)reproducibility, I am happy to note that many things have improved. Reproducibility, computational and otherwise, is increasingly recognized as an important aspect of scientific quality control, and mostly considered worth striving for. However, I also note that more and more people, including reproducibility activists, have lost contact with the day-to-day reality in which reproducibility matters. Reproducibility is becoming an item on a checklist, and its precise incarnation the subject of political bickering aimed at making it easy to check off that item. So let's take a look at why computational reproducibility matters for researchers.
Reproducibility in Machine Learning-based Research: Overview, Barriers and Drivers
The concept of reproducibility can have different interpretations across various research fields and even within the same field [39]. To avoid confusion, we first specify our terms, broadly defining reproducibility and then further categorizing it into various types and degrees. The first distinction comes from Goodman et al. [42], who specify a fundamental division between whether we (i) mean reproducible in principle (termed “methods” reproducibility) due to sufficient description/sharing of methodologies, materials, etc., or (ii) whether results/conclusions actually prove to be reproducible when experiments or analyses are re-done. In the second category, they distinguish “results” and “inferential” reproducibility, depending on whether the analyses or inferences to broader conclusions are reproduced.
GRN · German Reproducibility Network
Working together for trustworthy and useful research
Open Science Retreat 2027 - REWIRE Edition
New to Open Science or already an open science champion? Researcher or research support professional? You're all welcome! Curious about computational reproducibility? Join us to explore what it takes to rerun an analysis and reproduce the same results. Looking for a week of fresh ideas, renewed energy and inspiration? Come join us! AN UNCONFERENCE FOR THE OPEN SCIENCE COMMUNITY The Open Science Retreat is a week dedicated to scientific discussions and reflection, getting work done, making...

Nature is expanding Registered Reports to all the fields in which we publish
Registered Reports improve the credibility of scientific claims by rewarding big questions, sound methods and solid analyses. They need to become a standard tool in research.

Speculations on the Future of the Scientific Method
The following essay was published 20 years ago (January, 2006) on my blog The Technium. I edited the intro here, but the speculations are basically unchanged.

Keynote: Reproducibility and replicability of computer simulations | Canal U
Since the early days of the reproducibility crisis, much progress has been made in understanding and improving computational reproducibility and replicability (R and R)...

ReScience organization
Reproducible Science is good. Replicated Science is better. - ReScience organization

Perspectives on Scientific Error 2027 · PSE9
The Scientific Contribution Graph: Automated Literature-based Technological Roadmapping at Scale
Sir Isaac Newton famously wrote, “If I have seen further, it is by standing on the shoulders of giants”. Scientific contributions are rarely developed in isolation, but build upon prior contributions, such as problem framings, experimental methods, and empirical findings. Understanding these prerequisite relationships is important for studying scientific progress, and for automated scientific discovery systems that must reason about which existing capabilities can be used to develop new ones (e.g. Lu et al., 2024; Jansen et al., 2025b; Baek et al., 2025).
Institute for Replication (I4R)
The Institute for Replication improves the credibility of science by systematically reproducing and replicating empirical research.
Science has been in a “replication crisis” for a decade. Have we learned anything?
Bad papers are still published. But some other things might be getting better.

The Robyn Dawes Institute for the Improvement of Science
Making research quality visible so everyone can act on reliable evidence.

Hyperproblems: New Ways of Doing and Communicating Science - Hyperproblems
Hyperproblems: Hyperproblems are scientific challenges whose scale, complexity, novelty and interdependence overwhelm traditional research models, requiring…
Konrad Hinsen's blog
Home Page - Software Heritage
GNU Guix transactional package manager and distribution — GNU Guix

Keynote: Reproducibility and replicability of computer simulations | Canal U
Reproducible research: methodological principles for transparent…
Reproducible Research II: Practices and tools for managing compu…