Tool to easily start up an IPython cluster on different schedulers.
🖥 ipyparallel.Client package for a PBS or SLURM cluster with a headnode
Run many functions (adaptively) on many cores (>10k-100k) using mpi4py.futures, ipyparallel, loky...
IPython Parallel: Interactive Parallel Computing in Python
Making sbatch more user-friendly (for python users of Jean-Zay).
A low-impact profiler to figure out how much memory each task in Dask is using
An API for scheduling interactive and batch jobs
CleanRL's implementation of DeepMind's Podracer Sebulba Architecture for Distributed DRL
Distributed segmentation for bio-image-analysis
High-Performance Symbolic Regression in Python and Julia
super-slick Slurm and Condor cluster execution for Python
Python 3.8+ toolbox for submitting jobs to Slurm
Tool for writing large xarray datasets to zarr stores with independent processes
Fast algorithm for determined blind source separation with update of demixing filters with joint ...
a Python client/master/worker system for distributing jobs in a cluster