Bounded-memory serverless distributed N-dimensional array processing
APACHE-2.0 License
wait_dur_sec
to speed up tests by @tomwhite in https://github.com/cubed-dev/cubed/pull/456
max_total_source_arrays
by @tomwhite in https://github.com/cubed-dev/cubed/pull/463
map_overlap
by @tomwhite in https://github.com/cubed-dev/cubed/pull/462
pad
by @tomwhite in https://github.com/cubed-dev/cubed/pull/461
roll
by @tomwhite in https://github.com/cubed-dev/cubed/pull/465
map_overlap
in case of single chunk in overlap dimension by @tomwhite in https://github.com/cubed-dev/cubed/pull/466
unify_chunks
to return regular chunks in all cases by @tomwhite in https://github.com/cubed-dev/cubed/pull/470
Full Changelog: https://github.com/cubed-dev/cubed/compare/0.14.3...0.15.0
Published by tomwhite 6 months ago
groupby_blockwise
function for use in Flox by @tomwhite in https://github.com/cubed-dev/cubed/pull/448
Full Changelog: https://github.com/cubed-dev/cubed/compare/0.14.2...0.14.3
Published by tomwhite 6 months ago
drop_axis
to default to None
rather than an empty list in map_blocks
by @tomwhite in https://github.com/cubed-dev/cubed/pull/446
groupby_reduction
function for use in Flox by @tomwhite in https://github.com/cubed-dev/cubed/pull/442
Full Changelog: https://github.com/cubed-dev/cubed/compare/0.14.1...0.14.2
Published by tomwhite 7 months ago
aggegrate_func
in favour of aggregate_func
by @tomwhite in https://github.com/cubed-dev/cubed/pull/444
Full Changelog: https://github.com/cubed-dev/cubed/compare/0.14.0...0.14.1
Published by tomwhite 7 months ago
lazy_full
function (replaced by virtual_full
) by @tomwhite in https://github.com/cubed-dev/cubed/pull/409
block_function
to key_function
in blockwise by @tomwhite in https://github.com/cubed-dev/cubed/pull/426
total_nbytes
to total_nbytes_written
by @tomwhite in https://github.com/cubed-dev/cubed/pull/433
logger.warn
by @tomwhite in https://github.com/cubed-dev/cubed/pull/434
Full Changelog: https://github.com/cubed-dev/cubed/compare/0.13.0...0.14.0
Published by tomwhite 8 months ago
finalize_dag
method in Plan
that caches DAG optimization by @tomwhite in https://github.com/cubed-dev/cubed/pull/340
map_blocks
with no input arrays by @tomwhite in https://github.com/cubed-dev/cubed/pull/343
stack
using general_blockwise
by @tomwhite in https://github.com/cubed-dev/cubed/pull/353
reshape_chunks
using general_blockwise
by @tomwhite in https://github.com/cubed-dev/cubed/pull/354
show_hidden
option to visualize
by @tomwhite in https://github.com/cubed-dev/cubed/pull/360
function_nargs
to BlockwiseSpec
by @tomwhite in https://github.com/cubed-dev/cubed/pull/363
partial_reduce
and tree_reduce
using generalized blockwise by @tomwhite in https://github.com/cubed-dev/cubed/pull/365
allowed_mem
into account when fusing primitive operations by @tomwhite in https://github.com/cubed-dev/cubed/pull/366
max_total_num_input_blocks
as a heuristic to control fusion by @tomwhite in https://github.com/cubed-dev/cubed/pull/376
array_name
to name
in runtime following #337 by @tomwhite in https://github.com/cubed-dev/cubed/pull/377
array_names
parameter in executors by @tomwhite in https://github.com/cubed-dev/cubed/pull/380
compute_id
for each computation by @tomwhite in https://github.com/cubed-dev/cubed/pull/382
fuse_multiple
to avoid materializing array blocks in _partial_reduce
by @tomwhite in https://github.com/cubed-dev/cubed/pull/386
from_zarr
and to_zarr
by @tomwhite in https://github.com/cubed-dev/cubed/pull/391
minimum_workers
in Coiled by @tomwhite in https://github.com/cubed-dev/cubed/pull/398
Full Changelog: https://github.com/cubed-dev/cubed/compare/0.12.0...0.13.0
Published by tomwhite 11 months ago
f.call(...)
by @tomwhite in https://github.com/tomwhite/cubed/pull/320
arange
to use map_direct
, which avoids writing a Zarr array by @tomwhite in https://github.com/tomwhite/cubed/pull/332
Full Changelog: https://github.com/tomwhite/cubed/compare/0.11.0...0.12.0
Published by tomwhite about 1 year ago
RetryingFunctionExecutor
by @tomwhite in https://github.com/tomwhite/cubed/pull/292
__abs__
method for complex inputs by @tomwhite in https://github.com/tomwhite/cubed/pull/294
__setitem__
from Array
by @tomwhite in https://github.com/tomwhite/cubed/pull/302
VirtualFullArray
by @tomwhite in https://github.com/tomwhite/cubed/pull/303
shape
is an int for empty
by @tomwhite in https://github.com/tomwhite/cubed/pull/306
nansum
and nanmean
functions by @tomwhite in https://github.com/tomwhite/cubed/pull/308
moveaxis
by @tomwhite in https://github.com/tomwhite/cubed/pull/313
Full Changelog: https://github.com/tomwhite/cubed/compare/0.10.0...0.11.0
Published by tomwhite about 1 year ago
compute_arrays_in_parallel
option to Modal and Python async executors by @tomwhite in https://github.com/tomwhite/cubed/pull/263
merge_chunks
function in reduction
by @tomwhite in https://github.com/tomwhite/cubed/pull/256
virtual_offsets
function by @tomwhite in https://github.com/tomwhite/cubed/pull/265
projected_mem
and num_tasks
from DAG by @tomwhite in https://github.com/tomwhite/cubed/pull/271
reserved_mem
in create_lazy_zarr_arrays
by @tomwhite in https://github.com/tomwhite/cubed/pull/273
Full Changelog: https://github.com/tomwhite/cubed/compare/0.9.0...0.10.0
Published by tomwhite over 1 year ago
map_unordered
by @tomwhite in https://github.com/tomwhite/cubed/pull/242
consolidate_reads
by @tomwhite in https://github.com/tomwhite/cubed/pull/249
Full Changelog: https://github.com/tomwhite/cubed/compare/0.8.0...0.9.0
Published by tomwhite over 1 year ago
Full Changelog: https://github.com/tomwhite/cubed/compare/0.7.0...0.8.0
Published by tomwhite over 1 year ago
peak_memory
to peak_measured_mem
in line with other memory settings by @tomwhite in https://github.com/tomwhite/cubed/pull/182
Full Changelog: https://github.com/tomwhite/cubed/compare/0.6.3...0.7.0
Published by tomwhite over 1 year ago
Full Changelog: https://github.com/tomwhite/cubed/compare/0.6.2...0.6.3
Published by tomwhite over 1 year ago
Full Changelog: https://github.com/tomwhite/cubed/compare/0.6.1...0.6.2
Published by tomwhite over 1 year ago
Full Changelog: https://github.com/tomwhite/cubed/compare/0.6.0...0.6.1
Published by tomwhite over 1 year ago
Full Changelog: https://github.com/tomwhite/cubed/compare/0.5.0...0.6.0
Published by tomwhite over 1 year ago
take
and support for integer array indexing. by @tomwhite in https://github.com/tomwhite/cubed/pull/146
apply_gufunc
by @tomwhite in https://github.com/tomwhite/cubed/pull/149
output_sizes
in apply_gufunc
by @tomwhite in https://github.com/tomwhite/cubed/pull/151
Full Changelog: https://github.com/tomwhite/cubed/compare/0.4.1...0.5.0
Published by tomwhite about 2 years ago
apply_blockwise
handled structured case by @tomwhite in https://github.com/tomwhite/cubed/pull/137
make_blockwise_graph
to make_blockwise_function
by @tomwhite in https://github.com/tomwhite/cubed/pull/142
Full Changelog: https://github.com/tomwhite/cubed/compare/0.4.0...0.4.1
Published by tomwhite about 2 years ago
meshgrid
so it passes array API tests by @tomwhite in https://github.com/tomwhite/cubed/pull/129
PythonDagExecutor
by @tomwhite in https://github.com/tomwhite/cubed/pull/132
Full Changelog: https://github.com/tomwhite/cubed/compare/0.3.0...0.4.0
Published by tomwhite about 2 years ago
tensordot
and vecdot
by @tomwhite in https://github.com/tomwhite/cubed/pull/78
index
by @tomwhite in https://github.com/tomwhite/cubed/pull/84
from_array
by @tomwhite in https://github.com/tomwhite/cubed/pull/91
asarray
in from_array
by @tomwhite in https://github.com/tomwhite/cubed/pull/94
compute
and visualize
functions that take multiple arrays by @tomwhite in https://github.com/tomwhite/cubed/pull/99
return_stored
from public API for compute
and to_zarr
by @tomwhite in https://github.com/tomwhite/cubed/pull/100
store
function by @tomwhite in https://github.com/tomwhite/cubed/pull/101
random
by @tomwhite in https://github.com/tomwhite/cubed/pull/108
axis=None
to flatten arrays in concat
by @tomwhite in https://github.com/tomwhite/cubed/pull/112
measure_baseline_memory
function by @tomwhite in https://github.com/tomwhite/cubed/pull/113
Full Changelog: https://github.com/tomwhite/cubed/compare/0.2.0...0.3.0