pypeln

Concurrent data pipelines in Python >>>

MIT License

Downloads
94.8K
Stars
1.5K
Committers
12

Bot releases are hidden (Show)

pypeln - 0.4.9 Latest Release

Published by cgarciae almost 3 years ago

Changes

  • @metataro: Fixes AttributeError when using process workers with mp start method 'spawn' #74
  • @SimonBiggs: Fixes for Python 3.9 #78
  • @cgarciae: Update dependencies + minimal python version support to 3.6.2 #89
pypeln - 0.4.7

Published by cgarciae almost 4 years ago

Fixed bugs:

  • [Bug] maxsize not being respected for thread.map #64

Closed issues:

  • maxsize not being respected for process.map #55

Merged pull requests:

pypeln - 0.4.6

Published by cgarciae about 4 years ago

  • Introduces the maxsize as an argument to to_stage and to_iterable.
  • ordered now takes an optinal maxsize parameter.
pypeln - 0.4.5

Published by cgarciae about 4 years ago

  • Fixed pl.task.from_iterable to solve #56
  • pl.*.ordered implementations now based on bisect.insort.
pypeln - 0.4.4

Published by cgarciae over 4 years ago

  • Lazily creates MANAGER object in pl.process to potentially avoid errors on Windows and OSX.
pypeln - 0.4.3

Published by cgarciae over 4 years ago

  • flat_map now also allows the return argument to be an Awaitable[Iterable] consisten with pypeln < 0.4 versions.
pypeln - 0.4.2

Published by cgarciae over 4 years ago

  • Includes some conditional depedencies & imports to support Python >= 3.6
pypeln - 0.4.1

Published by cgarciae over 4 years ago

  • Lowered Python version requirement to 3.5, however to use the task module will only be available for versions >= 3.7.
pypeln - 0.4.0

Published by cgarciae over 4 years ago

  • Big internal refactor:
    • Reduces the risk of potential zombie workers
    • New internal Worker and Supervisor classes which make code more readable / maintainable.
    • Code is now split into individual files for each API function to make contribution easier and improve maintainability.
  • API Reference docs are now shown per function and a new Overview page was created per module.

Breaking Changes

  • maxsize arguement is removed from all from_iterable functions as it was not used.
  • worker_constructor parameter was removed from all from_iterable functions in favor of the simpler use_thread argument.
pypeln - 0.3.3

Published by cgarciae over 4 years ago

  • Adds to_iterable function back to the API #35 (@PromyLOPh)
pypeln - 0.3.0

Published by cgarciae over 4 years ago

Adds

  • ordered function in all modules, this orders output elements based on the order of creation on the source iterable.
  • Additional options and rules for the depending injection mechanism. See Advanced Usage.
  • All pl.*.Stage classes now inherit from pl.BaseStage.
pypeln - 0.2.5

Published by cgarciae over 4 years ago

pypeln -

Published by cgarciae over 4 years ago

pypeln - 0.2.0

Published by cgarciae over 4 years ago

Refactor + Update documentation

Package Rankings
Top 2.68% on Pypi.org
Top 28.3% on Conda-forge.org
Badges
Extracted from project README
Coverage