pydatatask

Library for constructing data-centric processing pipelines

MIT License

Downloads
598
Stars
6
View Code on GitHub Visit Website
Ecosystems: Python

Issue Statistics

Past Year

All Time

Total Pull Requests
19
23
Merged Pull Requests
15
19
Total Issues
16
17
Time to Close Issues
5 days
5 days
Package Rankings
Top 19.92% on Pypi.org
Related Projects
pipefunc

Lightweight function pipeline creation: 📚 Less Bookkeeping, 🎯 More Doing

16 Jul 2023 7
futureproof

Bulletproof concurrent.futures

08 Jun 2019 52
pyjava

This library is an ongoing effort towards bringing the data exchanging ability between Java/Scal...

13 Aug 2019 46
recon-pipeline

An automated target reconnaissance pipeline.

02 Sep 2019 425
datatrove

Freeing data processing from scripting madness by providing a set of platform-agnostic customizab...

14 Jun 2023 1,761
procrastinate

PostgreSQL-based Task Queue for Python

14 Feb 2019 725
pipeline-example

example ruffus pipeline

28 Aug 2011 18
mara-pipelines

A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow

31 Mar 2018 2,056
py3line

UNIX command-line tool for python line-based stream processing

22 Jul 2016 4
riko

A Python stream processing engine modeled after Yahoo! Pipes

02 Jun 2016 1,607
py-taskcontrol

Control, Create, Run named workflows & tasks with before/after middlewares support, data persiste...

15 Apr 2020 4
RunForrest

Batch and run your code in parallel. Simply.

06 Oct 2017 12
fgo-game-data-api

HTTP API for FGO game data. Transform the raw game data into something a bit more manageable.

15 May 2020 73
JobFunnel

Scrape job websites into a single spreadsheet with no duplicates.

25 Aug 2017 1,730
pypette

Ridiculously simple flow controller for building complex pipelines

22 Oct 2017 263