With Snakemake, data analysis workflows are defined via an easy to read, adaptable, yet powerful specification language on top of Python. Steps are defined by "rules", which denote how to generate a set of output files from a set of input files (e.g. using a shell command). Wildcards (in curly braces) provide generalization. Dependencies between rules are determined automatically.
Build Reproducible Analytical Pipelines with Nix
Streamlines the creation of reproducible analytical pipelines using default.nix expressions generated via the rix package for reproducibility. Define derivations in R, Python or Julia, chain them into a composition of pure functions and build the resulting pipeline using Nix as the underlying end-to-end build tool. Functions to plot the pipeline as a directed acyclic graph are included, as well as functions to load and inspect intermediary results for interactive analysis. User experience heavily inspired by the targets package.
Jupyter Notebooks – a publishing format for reproducible computational workflows
It is increasingly necessary for researchers in all fields to write computer code, and in order to reproduce research results, it is important that this code is published. We present Jupyter notebooks, a document format for publishing code, results and explanations in a form that is both readable and executable. We discuss various tools and use cases for notebook documents.
kellyjonbrazil/jc
CLI tool and python library that converts the output of popular command-line tools, file-types, and common strings to JSON, YAML, or Dictionaries. This allows piping of output to tools like jq and simplifying automation scripts.
Dagu: The workflow engine that doesn't turn into an SRE project.
Dagu is a lightweight alternative to Airflow or Cron with a Web UI. Define DAGs in a simple declarative YAML format. It supports shell commands, docker containers, k8s jobs, remote commands via SSH, and more. It was designed to be easy to use, self-contained, and require no coding, making it ideal for small teams.
What Is DSPy? How It Works, Use Cases, and Resources
DSPy is an open-source Python framework that allows developers to build language model applications using modular and declarative programming instead of relying on one-off prompting techniques.
SciPy 1.0: fundamental algorithms for scientific computing in Python
SciPy is an open-source scientific computing library for the Python programming language. Since its initial release in 2001, SciPy has become a de facto standard for leveraging scientific algorithms in Python, with over 600 unique code contributors, thousands of dependent packages, over 100,000 dependent repositories and millions of downloads per year. In this work, we provide an overview of the capabilities and development practices of SciPy 1.0 and highlight some recent technical developments.
Python Tutorial | Learn Python Programming Language - GeeksforGeeks
Your All-in-One Learning Portal: GeeksforGeeks is a comprehensive educational platform that empowers learners across domains-spanning computer science and programming, school education, upskilling, commerce, software tools, competitive exams, and more.
Track your Data Pipelines
Track and document dplyr data pipelines. As you filter, mutate, and join your way through a data set, dtrackr seamlessly keeps track of your data flow and makes publication ready documentation of a data pipeline simple.
Automatisch - Open Source Zapier Alternative
Build workflow automation without spending time and money. No code is required.
Vercel Workflow
Build durable, reliable, and observable applications and AI agents with the Workflow Development Kit (WDK).
marimo | a next-generation Python notebook
Explore data and build apps seamlessly with marimo, a next-generation Python notebook.
Cookiecutter Data Science
A project template and directory structure for Python data science projects.
Documentation — Terminal Graph
Download Terminal Graph beta, learn the shortcuts, nodes, and dataflow model.
The fish language — fish-shell 4.7.1 documentation
This document is a comprehensive overview of fish’s scripting language.