TileDB v2.2.1 Release Notes

Breaking behavior

• The tile extent can now be set to null, in which case internally TileDB sets the extent to the dimension domain range. #1880
• The C++ API std::pair<uint64_t, uint64_t> Query::est_result_size_var has been changed to 1) a return type of std::array<uint64_t, 2> and 2) returns the offsets as a size in bytes rather than elements. #1946

New features

• Support for nullable attributes. #1895 #1938 #1948 #1945
• Support for Hilbert order sorting for sparse arrays. #1880
• Support for AWS S3 "AssumeRole" temporary credentials #1882
• Support for zero-copy import/export with the Apache Arrow adapter #2001
• Experimental support for an in-memory backend used with bootstrap option "--enable-memfs" #1873
• Support for element offsets when reading var-sized attributes. #1897
• Support for an extra offset indicating the size of the returned data when reading var-sized attributes. #1932
• Support for 32-bit offsets when reading var-sized attributes. #1950

Improvements

• Optimized string dimension performance.
• Added functionality to get fragment information from an array. #1900
• Prevented unnecessary sorting when (1) there is a single fragment and (i) either the query layout is global order, or (ii) the number of dimensions is 1, and (2) when there is a single range for which the result coordinates have already been sorted. #1880
• Added extra stats for consolidation. #1880
• Disabled checking if cells are written in global order when consolidating, as it was redundant (the cells are already being read in global order during consolidation). #1880
• Optimize consolidated fragment metadata loading #1975

Bug fixes

• Fix tiledb_dimension_alloc returning a non-null pointer after error #1959
• Fixed issue with string dimensions and non-set subarray (which implies spanning the whole domain). There was an assertion being triggered. Now it works properly.
• Fixed bug when checking the dimension domain for infinity or NaN values. #1880
• Fixed bug with string dimension partitioning. #1880

API additions

C API

• Added functions for getting fragment information. #1900
• Added APIs for getting and setting ranges of queries using a dimension name. #1920

C++ API

• Added class FragmentInfo and functions for getting fragment information. #1900
• Added function Dimension::create that allows not setting a space tile extent. #1880
• Added APIs for getting and setting ranges of queries using a dimension name. #1920
• Changed std::pair<uint64_t, uint64_t> Query::est_result_size_var to std::array<uint64_t, 2> Query::est_result_size_var. Additionally, the size estimate for the offsets have been changed from elements to bytes. #1946

Pre-release for upcoming 2.2.1. This version is not guaranteed to have a stable API or format, only the final 2.2.1 release will be covered by the backwards compatible guarantees.

Please see HISTORY.md for current list of changes.

TileDB v2.1.6 Release Notes

Bug fixes

• Fix deadlock in ThreadPool::wait_or_work #1994
• Fix "[TileDB::ChunkedBuffer] Error: Cannot init chunk buffers; Total size must be non-zero." in read path #1992

TileDB v2.1.5 Release Notes

Improvements

• Optimize consolidated fragment metadata loading #1975
• Optimize Reader::load_tile_offsets for loading only relevant fragments #1976 #1983
• Optimize locking in FragmentMetadata::load_tile_offsets and FragmentMetadata::load_tile_var_offsets #1979
• Exit early in Reader::copy_coordinates/Reader::copy_attribute_values when no results #1984

Bug fixes

• Fix segfault in optimized compute_results_sparse<char> #1969
• Fix GCS "Error:: Read object failed"#1966
• Fix segfault in ResultTile::str_coords_intersects #1981

TileDB v2.1.4 Release Notes

Improvements

• Optimize ResultTile::compute_results_sparse<char> resulting in significant performance increases in certain cases with string dimensions #1963

TileDB v2.1.3 Release Notes

Improvements

• Optimized string dimension performance. #1922

Bug fixes

• Updated the AWS SDK to v1.8.84 to fix an uncaught exception when using S3 #1899TileDB-Py #409
• Fixed bug where a read on a sparse array may return duplicate values. #1905
• Fixed bug where an array could not be opened if created with an array schema from an older version #1889

TileDB v2.1.2 Release Notes

Bug fixes

• Fix ArraySchema not write protecting fill values for only schema version 6 or newer #1868
• Fix segfault that may occur in the VFS read-ahead cache #1871

TileDB v2.1.1 Release Notes

Bug fixes

• The result size estimation routines will no longer return non-zero sizes that can not contain a single value. #1849
• Fix serialization of dense writes that use ranges #1860
• Fixed a crash from an unhandled SIGPIPE signal that may raise when using S3 #1856

TileDB v2.1.0 Release Notes

Breaking behavior

• Empty dense arrays now return cells with fill values. Also the result estimator is adjusted to work properly with this new behavior.

New features

• Added configuration option "sm.compute_concurrency_level" #1766
• Added configuration option "sm.io_concurrency_level" #1766
• Added configuration option "sm.sub_partitioner_memory_budget" #1729
• Added configuration option "vfs.read_ahead_size" #1785
• Added configuration option "vfs.read_ahead_cache_size" #1785
• Added support for getting/setting Apache Arrow buffers from a Query #1816

Improvements

• Source built curl only need HTTP support #1712
• AWS SDK version bumped to 1.8.6 #1718
• Split posix permissions into files and folers permissions #1719
• Support seeking for CURL to allow redirects for posting to REST #1728
• Changed default setting for vfs.s3.proxy_scheme from https to http to match common usage needs #1759
• Enabled parallelization with native system threads when TBB is disabled #1760
• Subarray ranges will be automatically coalesced as they are added #1755
• Update GCS SDK to v1.16.0 to fixes multiple bugs reported #1768
• Read-ahead cache for cloud-storage backends #1785
• Allow multiple empty values at the end of a variable-length write #1805
• Build system will raise overridable error if important paths contain regex character #1808
• Lazily create AWS ClientConfiguration to avoid slow context creations for non S3 usage after the AWS SDK version bump #1821
• Moved Status, ThreadPool, and Logger classes from folder tiledb/sm to tiledb/common #1843

Deprecations

• Deprecated config option "sm.num_async_threads" #1766
• Deprecated config option "sm.num_reader_threads" #1766
• Deprecated config option "sm.num_writer_threads" #1766
• Deprecated config option "sm.num_vfs_threads" #1766
• Support for MacOS older than 10.13 is being dropped when using the AWS SDK. Prebuilt Binaries now target 10.13 #1753
• Use of Intel's Thread Building Blocks (TBB) will be discontinued in the future. It is now disabled by default #1762
• No longer building release artifacts with Intel's Thread Building Blocks (TBB) enabled #1825

Bug fixes

• Fixed bug in setting a fill value for var-sized attributes.
• Fixed a bug where the cpp headers would always produce compile-time warnings about using the deprecated c-api "tiledb_coords()" #1765
• Only serialize the Array URI in the array schema client side. #1806
• Fix C++ api consolidate_metadata function uses incorrect config #1841 #1844

API additions

C API

• Added functions tiledb_attribute_{set,get}_fill_value to get/set default fill values

C++ API

• Added functions Attribute::{set,get}_fill_value to get/set default fill values

Pre-release for upcoming 2.1.0. This version is not guaranteed to have a stable API or format, only the final 2.1.0 release will be covered by the backwards compatible guarantees.

Please see HISTORY.md for current list of changes.

Pre-release for upcoming 2.1.0. This version is not guaranteed to have a stable API or format, only the final 2.1.0 release will be covered by the backwards compatible guarantees.

Please see HISTORY.md for current list of changes.

Pre-release for upcoming 2.1.0. This version is not guaranteed to have a stable API or format, only the final 2.1.0 release will be covered by the backwards compatible guarantees.

Please see HISTORY.md for current list of changes.

Pre-release for upcoming 2.1.0. This version is not guaranteed to have a stable API or format, only the final 2.1.0 release will be covered by the backwards compatible guarantees.

Please see HISTORY.md for current list of changes.

Pre-release for upcoming 2.1.0. This version is not guaranteed to have a stable API or format, only the final 2.1.0 release will be covered by the backwards compatible guarantees.

Please see HISTORY.md for current list of changes.

TileDB v2.0.8 Release Notes

Improvements

• Split posix permissions into files and folders permissions #1719
• Support seeking for CURL to allow redirects for posting to REST #1728
• Add additional release artifacts which include disabling TBB #1753
• Lazy initialization for GCS backend #1752

Bug fixes

• Fix crash during GCS backend initialization due to upstream bug. #1752

TileDB v2.0.7 Release Notes

Improvements

• Various performance optimizations in the read path. #1689 #1692 #1693 #1694 #1695
• Google Cloud SDK bumped to 1.14. #1687, #1742

Bug fixes

• Fixed error "Error: Out of bounds read to internal chunk buffer of size 65536" that may occur when writing var-sized attributes. #1732
• Fixed error "Error: Chunk read error; chunk unallocated error" that may occur when reading arrays with more than one dimension. #1736
• Fixed a small memory leak when opening arrays. #1690
• Fixed an overflow in the partioning path that may result in a hang or poor read performance. #1725#1707
• Fix Catch2 detection of system install #1733
• Use libtiledb-detected certificate path for Google Cloud Storage, for better linux binary/wheel portability. #1741
• Fix compilation on gcc 10.1 for blosc #1740
• Fixed a rare hang in the usage of load_tile_var_sizes. #1748

TileDB v2.0.6 Release Notes

Improvements

• Add new config option vfs.file.posix_permissions #1710

Bug fixes

• Return possible env config variables in config iter #1714

TileDB v2.0.5 Release Notes

Improvements

• Don't include curl's linking to libz, avoids build issue with double libz linkage #1682

TileDB v2.0.4 Release Notes

Improvements

• Fix typo in GCS cmake file for superbuild #1665
• Don't error on GCS client init failure #1667
• Don't include curl's linking to ssl, avoids build issue on fresh macos 10.14/10.15 installs #1671
• Handle ubuntu's cap'n proto package not providing cmake targets #1659

Bug fixes

• The C++ Attribute::create API now correctly builds from an STL array #1670
• Allow opening arrays with read-only permission on posix filesystems #1676
• Fixed build issue caused by passing std::string to an Aws method #1678