ipython-cluster-helper

hpc05

🖥 ipyparallel.Client package for a PBS or SLURM cluster with a headnode

adaptive-scheduler

Run many functions (adaptively) on many cores (>10k-100k) using mpi4py.futures, ipyparallel, loky...

ipyparallel

IPython Parallel: Interactive Parallel Computing in Python

spython

Making sbatch more user-friendly (for python users of Jean-Zay).

SGGM

dask-memusage

A low-impact profiler to figure out how much memory each task in Dask is using

jobsched-api

An API for scheduling interactive and batch jobs

cleanba

CleanRL's implementation of DeepMind's Podracer Sebulba Architecture for Distributed DRL

cluster_tools

Distributed segmentation for bio-image-analysis

PySR

High-Performance Symbolic Regression in Python and Julia

clusterfutures

super-slick Slurm and Condor cluster execution for Python

submitit

Python 3.8+ toolbox for submitting jobs to Slurm

xpartition

Tool for writing large xarray datasets to zarr stores with independent processes

auxiva-ipa

Fast algorithm for determined blind source separation with update of demixing filters with joint ...

cluster-workers

a Python client/master/worker system for distributing jobs in a cluster