xyzpy

Efficiently generate and analyse high dimensional data.

MIT License

Downloads
1.1K
Stars
67
xyzpy - 1.0.0 Latest Release

Published by jcmgray about 4 years ago

Breaking changes

  • Remove all the data processing functionality which can now pretty much all be found in xarray. This also
    removes the numba, scipy and cytoolz dependencies completely.

Enhancements

  • Generalize (and deprecate) :meth:xyzpy.Crop.qsub_grow to :meth:xyzpy.Crop.grow_cluster (#10)
  • Add SLURM support to :meth:xyzpy.Crop.grow_cluster (#10)
  • Add PBS support to :meth:xyzpy.Crop.grow_cluster
  • Fix PBS crop submission for job arrays of size 1
  • Add :func:xyzpy.save_merge_ds for manually aggregating datasets to disk
  • Add allow_incomplete=True option to :meth:xyzpy.Crop.reap for gathering data even if the crop is not fully grown (#7)
  • Make new :class:~xyzpy.Crop instances by default automatically load information from disk if they have been already prepared/sown (#7)
  • Automatically load Crops in the current (or specified) directory with :func:xyzpy.load_crops.
  • Add 'joblib' and 'zarr' as possible engines for saving and loading datasets
  • Add utility :func:xyzpy.getsizeof to quite accurately get a python objects size
  • Keep a running track of covariance using :class:~xyzpy.utils.RunningCovariance.
xyzpy -

Published by jcmgray almost 6 years ago

Breaking changes

  • (#5) combo_runner key argument pool renamed to executor

Enhancements

  • (#5) Support multiprocessing.pool in combo_runner
  • Document timing and estimation utilities
  • Use loky as the default parallel executor
  • plotting: add xjitter and yjitter

Bug fixes:

  • make sure Crop._batch_remainder synced with disk.
  • update pytest marking parametrizations to xfail for recent pytest
  • compatibility updates for dask and numba
  • fix farming example which wasn't appearing
Package Rankings
Top 10.72% on Pypi.org
Badges
Extracted from project README
tests codecov Codacy Badge Docs PyPI Anaconda-Server Badge