TileDB

The Universal Storage Engine

MIT License

Stars
1.8K
Committers
73

Bot releases are hidden (Show)

TileDB - TileDB v2.2.1-rc1

Published by joe-maley almost 4 years ago

Pre-release for upcoming 2.2.1. This version is not guaranteed to have a stable API or format, only the final 2.2.1 release will be covered by the backwards compatible guarantees.

Please see HISTORY.md for current list of changes.

TileDB - TileDB v2.1.6

Published by Shelnutt2 almost 4 years ago

TileDB v2.1.6 Release Notes

Bug fixes

  • Fix deadlock in ThreadPool::wait_or_work #1994
  • Fix "[TileDB::ChunkedBuffer] Error: Cannot init chunk buffers; Total size must be non-zero." in read path #1992
TileDB - TileDB v2.1.5

Published by Shelnutt2 almost 4 years ago

TileDB v2.1.5 Release Notes

Improvements

  • Optimize consolidated fragment metadata loading #1975
  • Optimize Reader::load_tile_offsets for loading only relevant fragments #1976 #1983
  • Optimize locking in FragmentMetadata::load_tile_offsets and FragmentMetadata::load_tile_var_offsets #1979
  • Exit early in Reader::copy_coordinates/Reader::copy_attribute_values when no results #1984

Bug fixes

  • Fix segfault in optimized compute_results_sparse<char> #1969
  • Fix GCS "Error:: Read object failed"#1966
  • Fix segfault in ResultTile::str_coords_intersects #1981
TileDB - TileDB v2.1.4

Published by Shelnutt2 almost 4 years ago

TileDB v2.1.4 Release Notes

Improvements

  • Optimize ResultTile::compute_results_sparse<char> resulting in significant performance increases in certain cases with string dimensions #1963
TileDB - TileDB v2.1.3

Published by joe-maley almost 4 years ago

TileDB v2.1.3 Release Notes

Improvements

  • Optimized string dimension performance. #1922

Bug fixes

  • Updated the AWS SDK to v1.8.84 to fix an uncaught exception when using S3 #1899TileDB-Py #409
  • Fixed bug where a read on a sparse array may return duplicate values. #1905
  • Fixed bug where an array could not be opened if created with an array schema from an older version #1889
TileDB - TileDB v2.1.2

Published by joe-maley almost 4 years ago

TileDB v2.1.2 Release Notes

Bug fixes

  • Fix ArraySchema not write protecting fill values for only schema version 6 or newer #1868
  • Fix segfault that may occur in the VFS read-ahead cache #1871
TileDB - TileDB v2.1.1

Published by joe-maley about 4 years ago

TileDB v2.1.1 Release Notes

Bug fixes

  • The result size estimation routines will no longer return non-zero sizes that can not contain a single value. #1849
  • Fix serialization of dense writes that use ranges #1860
  • Fixed a crash from an unhandled SIGPIPE signal that may raise when using S3 #1856
TileDB - TileDB v2.1.0

Published by joe-maley about 4 years ago

TileDB v2.1.0 Release Notes

Breaking behavior

  • Empty dense arrays now return cells with fill values. Also the result estimator is adjusted to work properly with this new behavior.

New features

  • Added configuration option "sm.compute_concurrency_level" #1766
  • Added configuration option "sm.io_concurrency_level" #1766
  • Added configuration option "sm.sub_partitioner_memory_budget" #1729
  • Added configuration option "vfs.read_ahead_size" #1785
  • Added configuration option "vfs.read_ahead_cache_size" #1785
  • Added support for getting/setting Apache Arrow buffers from a Query #1816

Improvements

  • Source built curl only need HTTP support #1712
  • AWS SDK version bumped to 1.8.6 #1718
  • Split posix permissions into files and folers permissions #1719
  • Support seeking for CURL to allow redirects for posting to REST #1728
  • Changed default setting for vfs.s3.proxy_scheme from https to http to match common usage needs #1759
  • Enabled parallelization with native system threads when TBB is disabled #1760
  • Subarray ranges will be automatically coalesced as they are added #1755
  • Update GCS SDK to v1.16.0 to fixes multiple bugs reported #1768
  • Read-ahead cache for cloud-storage backends #1785
  • Allow multiple empty values at the end of a variable-length write #1805
  • Build system will raise overridable error if important paths contain regex character #1808
  • Lazily create AWS ClientConfiguration to avoid slow context creations for non S3 usage after the AWS SDK version bump #1821
  • Moved Status, ThreadPool, and Logger classes from folder tiledb/sm to tiledb/common #1843

Deprecations

  • Deprecated config option "sm.num_async_threads" #1766
  • Deprecated config option "sm.num_reader_threads" #1766
  • Deprecated config option "sm.num_writer_threads" #1766
  • Deprecated config option "sm.num_vfs_threads" #1766
  • Support for MacOS older than 10.13 is being dropped when using the AWS SDK. Prebuilt Binaries now target 10.13 #1753
  • Use of Intel's Thread Building Blocks (TBB) will be discontinued in the future. It is now disabled by default #1762
  • No longer building release artifacts with Intel's Thread Building Blocks (TBB) enabled #1825

Bug fixes

  • Fixed bug in setting a fill value for var-sized attributes.
  • Fixed a bug where the cpp headers would always produce compile-time warnings about using the deprecated c-api "tiledb_coords()" #1765
  • Only serialize the Array URI in the array schema client side. #1806
  • Fix C++ api consolidate_metadata function uses incorrect config #1841 #1844

API additions

C API

  • Added functions tiledb_attribute_{set,get}_fill_value to get/set default fill values

C++ API

  • Added functions Attribute::{set,get}_fill_value to get/set default fill values
TileDB - 2.1.0-rc5

Published by joe-maley about 4 years ago

Pre-release for upcoming 2.1.0. This version is not guaranteed to have a stable API or format, only the final 2.1.0 release will be covered by the backwards compatible guarantees.

Please see HISTORY.md for current list of changes.

TileDB - 2.1.0-rc4

Published by joe-maley about 4 years ago

Pre-release for upcoming 2.1.0. This version is not guaranteed to have a stable API or format, only the final 2.1.0 release will be covered by the backwards compatible guarantees.

Please see HISTORY.md for current list of changes.

TileDB - 2.1.0-rc3

Published by joe-maley about 4 years ago

Pre-release for upcoming 2.1.0. This version is not guaranteed to have a stable API or format, only the final 2.1.0 release will be covered by the backwards compatible guarantees.

Please see HISTORY.md for current list of changes.

TileDB - 2.1.0-rc2

Published by joe-maley about 4 years ago

Pre-release for upcoming 2.1.0. This version is not guaranteed to have a stable API or format, only the final 2.1.0 release will be covered by the backwards compatible guarantees.

Please see HISTORY.md for current list of changes.

TileDB - 2.1.0-rc1

Published by joe-maley about 4 years ago

Pre-release for upcoming 2.1.0. This version is not guaranteed to have a stable API or format, only the final 2.1.0 release will be covered by the backwards compatible guarantees.

Please see HISTORY.md for current list of changes.

TileDB - TileDB v2.0.8

Published by Shelnutt2 about 4 years ago

TileDB v2.0.8 Release Notes

Improvements

  • Split posix permissions into files and folders permissions #1719
  • Support seeking for CURL to allow redirects for posting to REST #1728
  • Add additional release artifacts which include disabling TBB #1753
  • Lazy initialization for GCS backend #1752

Bug fixes

  • Fix crash during GCS backend initialization due to upstream bug. #1752
TileDB - TileDB v2.0.7

Published by ihnorton about 4 years ago

TileDB v2.0.7 Release Notes

Improvements

Bug fixes

  • Fixed error "Error: Out of bounds read to internal chunk buffer of size 65536" that may occur when writing var-sized attributes. #1732
  • Fixed error "Error: Chunk read error; chunk unallocated error" that may occur when reading arrays with more than one dimension. #1736
  • Fixed a small memory leak when opening arrays. #1690
  • Fixed an overflow in the partioning path that may result in a hang or poor read performance. #1725#1707
  • Fix Catch2 detection of system install #1733
  • Use libtiledb-detected certificate path for Google Cloud Storage, for better linux binary/wheel portability. #1741
  • Fix compilation on gcc 10.1 for blosc #1740
  • Fixed a rare hang in the usage of load_tile_var_sizes. #1748
TileDB - TileDB v2.0.6

Published by Shelnutt2 over 4 years ago

TileDB v2.0.6 Release Notes

Improvements

  • Add new config option vfs.file.posix_permissions #1710

Bug fixes

  • Return possible env config variables in config iter #1714
TileDB - TileDB v2.0.5

Published by Shelnutt2 over 4 years ago

TileDB v2.0.5 Release Notes

Improvements

  • Don't include curl's linking to libz, avoids build issue with double libz linkage #1682
TileDB - https://github.com/TileDB-Inc/TileDB/releases/tag/2.0.5_testing

Published by Shelnutt2 over 4 years ago

TileDB - TileDB v2.0.4

Published by Shelnutt2 over 4 years ago

TileDB v2.0.4 Release Notes

Improvements

  • Fix typo in GCS cmake file for superbuild #1665
  • Don't error on GCS client init failure #1667
  • Don't include curl's linking to ssl, avoids build issue on fresh macos 10.14/10.15 installs #1671
  • Handle ubuntu's cap'n proto package not providing cmake targets #1659

Bug fixes

  • The C++ Attribute::create API now correctly builds from an STL array #1670
  • Allow opening arrays with read-only permission on posix filesystems #1676
  • Fixed build issue caused by passing std::string to an Aws method #1678
TileDB - TileDB v2.0.3

Published by Shelnutt2 over 4 years ago

TileDB v2.0.3 Release Notes

Improvements

  • Add robust retries for S3 SLOW_DOWN errors #1651
  • Improve GCS build process #1655
  • Add generation of pkg-config file #1656
  • S3 should use HEADObject for file size #1657
  • Improvements to stats #1652
  • Add artifacts to releases from CI #1663

Bug fixes

  • Remove to unneeded semicolons noticed by the -pedantic flag #1653
  • Fix cases were TILEDB_FORCE_ALL_DEPS picked up system builds #1654
  • Allow errors to be show in cmake super build #1658
  • Properly check vacuum files and limit fragment loading #1661
  • Fix edge case where consolidated but unvacuumed array can have coordinates report twice #1662

API additions

  • Add c-api tiledb_stats_raw_dump[_str] function for raw stats dump #1660
  • Add c++-api Stats::raw_dump function for raw stats dump #1660
Package Rankings
Top 8.57% on Conda-forge.org
Top 17.89% on Anaconda.org
Badges
Extracted from project README
Full CI Azure Pipelines Anaconda download count badge