TileDB

The Universal Storage Engine

MIT License

Stars
1.8K
Committers
73

Bot releases are hidden (Show)

TileDB - TileDB 2.22.0-rc1 Latest Release

Published by KiterLuc 6 months ago

TileDB v2.22.0 Release Notes

Deprecation announcements

  • Support for downloading dependencies with CMake ExternalProjects by specifying -DTILEDB_VCPKG=OFF will be removed in 2.23. Vcpkg will be downloaded and used to manage dependencies by default. See https://github.com/TileDB-Inc/TileDB/blob/dev/doc/dev/BUILD.md for help on how to disable automatically downloading vcpkg and acquire dependencies from the system.

Configuration changes

  • Add vfs.gcs.service_account_credential config option that specifies a Google Cloud service account credential JSON string. #4855
  • Add vfs.gcs.external_account_credential config option that specifies a Google Cloud Workload Identity Federation credential JSON string. #4855

New features

  • Support Microsoft Entra ID authentication to Azure. #4126

Improvements

  • Allow to set buffers for geometry types with CPP API more easily. #4826

Defects removed

  • Throw error when an upload fails due to bad state. #4815
  • Single-process sub-millisecond temporal disambiguation of random labels. #4800
  • Expose VFSExperimental and relocate CallbackWrapperCPP. #4820
  • Do not load group metadata when getting it from REST. #4821
  • Fix crash getting file size on non existent blob on Azure. #4836

TileDB v2.21.1 Release Notes

Defects removed

  • Do not load group metadata when getting it from REST. #4821
TileDB - TileDB 2.21.2

Published by KiterLuc 7 months ago

TileDB v2.21.2 Release Notes

Defects removed

  • Fix crash getting file size on non existent blob on Azure. #4836
TileDB - TileDB 2.22.0-rc0

Published by KiterLuc 7 months ago

TileDB v2.22.0 Release Notes

Deprecation announcements

  • Support for downloading dependencies with CMake ExternalProjects by specifying -DTILEDB_VCPKG=OFF will be removed in 2.23. Vcpkg will be downloaded and used to manage dependencies by default. See https://github.com/TileDB-Inc/TileDB/blob/dev/doc/dev/BUILD.md for help on how to disable automatically downloading vcpkg and acquire dependencies from the system.

New features

  • Support Microsoft Entra ID authentication to Azure. #4126

Improvements

  • Allow to set buffers for geometry types with CPP API more easily. #4826

Defects removed

  • Throw error when an upload fails due to bad state. #4815
  • Single-process sub-millisecond temporal disambiguation of random labels. #4800
  • Expose VFSExperimental and relocate CallbackWrapperCPP. #4820
  • Do not load group metadata when getting it from REST. #4821
  • Fix crash getting file size on non existent blob on Azure. #4836
TileDB - TileDB 2.21.1

Published by KiterLuc 7 months ago

TileDB v2.21.1 Release Notes

Defects removed

  • Do not load group metadata when getting it from REST. #4821
TileDB - TileDB 2.21.0

Published by KiterLuc 7 months ago

TileDB v2.21.0 Release Notes

Deprecation announcements

  • Building with Visual Studio 2019 (MSVC toolchains v14.29 and earlier) will become unsuported in version 2.28, to be released in Q3 2024.
  • HDFS support will be removed in version 2.28, to be released in Q3 2024.
  • Support for GLIBC 2.17 (manylinux2014, based on CentOS 7) will be removed in TileDB version 2.31, to be released in Q4 2024. It will be replaced by support for GLIBC 2.28 (manylinux_2_28; RHEL8; Rocky Linux 8).

New features

  • Add datatypes GEOM_WKB and GEOM_WKT. #4640

TileDB backend API support:

  • Query Plan REST support. #4519
  • Consolidation Plan REST support. #4537

Improvements

  • Optimize sparse reads when full non empty domain is requested. #4710
  • Lazily initialize the Azure SDK client. #4703
  • Remove QueryCondition requirement for Enumeration values to be valid. #4707
  • Convert dimension function pointer members to subclass methods. #4774
  • Implement dense dimension aggregates. #4801

Defects removed

  • Fix documentation of Subarray::set_config to match tiledb_subarray_set_config. #4672
  • Fix stats bug in StorageManager. #4708
  • Add explicit casts to fix compile errors. #4712
  • Fix bug with new minio behavior. #4725
  • Support reading V1 group details with explicit version in the name. #4744
  • Update crop_range to clamp to domain range. #4781
  • Fix segfault in ArraySchema::check. #4787
  • Fix crash in aggregates on dimensions. #4794
  • Fix defects with query channels. #4786
  • Remove trailing slash from rest.server_address configuration option. #4790
  • Provide a clear exception message when performing remote incomplete queries with aggregates. #4798

API changes

C API

  • Support VFS ls_recursive API for posix filesystem. #4778

Test only changes

  • Add unit_vfs to tests for windows/osx/linux. #4748

Build System Changes

TileDB - TileDB 2.21.0-rc1

Published by KiterLuc 7 months ago

TileDB v2.21.0 Release Notes

Deprecation announcements

  • Building with Visual Studio 2019 (MSVC toolchains v14.29 and earlier) will become unsuported in version 2.28, to be released in Q3 2024.
  • HDFS support will be removed in version 2.28, to be released in Q3 2024.
  • Support for GLIBC 2.17 (manylinux2014, based on CentOS 7) will be removed in TileDB version 2.31, to be released in Q4 2024. It will be replaced by support for GLIBC 2.28 (manylinux_2_28; RHEL8; Rocky Linux 8).

New features

  • Add datatypes GEOM_WKB and GEOM_WKT. #4640

TileDB backend API support:

  • Query Plan REST support. #4519
  • Consolidation Plan REST support. #4537

Improvements

  • Optimize sparse reads when full non empty domain is requested. #4710
  • Lazily initialize the Azure SDK client. #4703
  • Remove QueryCondition requirement for Enumeration values to be valid. #4707
  • Convert dimension function pointer members to subclass methods. #4774
  • Implement dense dimension aggregates. #4801

Defects removed

  • Fix documentation of Subarray::set_config to match tiledb_subarray_set_config. #4672
  • Fix stats bug in StorageManager. #4708
  • Add explicit casts to fix compile errors. #4712
  • Fix bug with new minio behavior. #4725
  • Support reading V1 group details with explicit version in the name. #4744
  • Update crop_range to clamp to domain range. #4781
  • Fix segfault in ArraySchema::check. #4787
  • Fix crash in aggregates on dimensions. #4794
  • Fix defects with query channels. #4786
  • Remove trailing slash from rest.server_address configuration option. #4790
  • Provide a clear exception message when performing remote incomplete queries with aggregates. #4798

API changes

C API

  • Support VFS ls_recursive API for posix filesystem. #4778

Test only changes

  • Add unit_vfs to tests for windows/osx/linux. #4748

Build System Changes

TileDB - TileDB 2.21.0-rc0

Published by KiterLuc 7 months ago

TileDB v2.21.0 Release Notes

Deprecation announcements

  • Building with Visual Studio 2019 (MSVC toolchains v14.29 and earlier) will become unsuported in version 2.28, to be released in Q3 2024.
  • HDFS support will be removed in version 2.28, to be released in Q3 2024.
  • Support for GLIBC 2.17 (manylinux2014, based on CentOS 7) will be removed in TileDB version 2.31, to be released in Q4 2024. It will be replaced by support for GLIBC 2.28 (manylinux_2_28; RHEL8; Rocky Linux 8).

New features

  • Add datatypes GEOM_WKB and GEOM_WKT. #4640

TileDB backend API support:

  • Query Plan REST support. #4519
  • Consolidation Plan REST support. #4537

Improvements

  • Optimize sparse reads when full non empty domain is requested. #4710
  • Lazily initialize the Azure SDK client. #4703
  • Remove QueryCondition requirement for Enumeration values to be valid. #4707
  • Convert dimension function pointer members to subclass methods. #4774
  • Implement dense dimension aggregates. #4801

Defects removed

  • Fix documentation of Subarray::set_config to match tiledb_subarray_set_config. #4672
  • Fix stats bug in StorageManager. #4708
  • Add explicit casts to fix compile errors. #4712
  • Fix bug with new minio behavior. #4725
  • Support reading V1 group details with explicit version in the name. #4744
  • Update crop_range to clamp to domain range. #4781
  • Fix segfault in ArraySchema::check. #4787
  • Fix crash in aggregates on dimensions. #4794
  • Fix defects with query channels. #4786
  • Remove trailing slash from rest.server_address configuration option. #4790
  • Provide a clear exception message when performing remote incomplete queries with aggregates. #4798

API changes

C API

  • Support VFS ls_recursive API for posix filesystem. #4778

Test only changes

  • Add unit_vfs to tests for windows/osx/linux. #4748

Build System Changes

TileDB - TileDB 2.19.2

Published by KiterLuc 8 months ago

TileDB v2.19.2 Release Notes

Defects removed

  • Fix bug with new minio behavior. #4725
  • Support reading V1 group details with explicit version in the name. #4744

Build System Changes

  • Fix regression where release artifacts had 8-digit commit hashes. #4599
  • Fix linker errors when building with MSVC. #4759
TileDB - TileDB 2.20.1

Published by KiterLuc 8 months ago

TileDB v2.20.1 Release Notes

Defects removed

  • Support reading V1 group details with explicit version in the name. #4744

Build System Changes

  • Reintroduce the TILEDB_STATIC option under a deprecation warning. #4732
TileDB - TileDB 2.20.0

Published by KiterLuc 8 months ago

TileDB v2.20.0 Release Notes

Breaking behavior

  • The minimum supported macOS version on x64 is 11. #4561

New features

  • Add internal definitions for S3 ls recursive #4467
  • Add experimental C API for ls_recursive. #4615
  • Add experimental CPP API for ls_recursive. #4625

Improvements

  • Keep opened array resources alive until query ends. #4601
  • Avoid needless buffer reallocations when consolidating fragments. #4614
  • Update the AWS SDK to version 1.11.215. #4551
  • Fix consolidation plan to print relative paths in output. #4604
  • Fix traversal limit in array deserialization. #4606
  • Add function random_label to utilize PRNG for random string generation. #4564
  • Improve large dense aggregate reads with tile metadata only. #4657

Defects removed

  • Fix regression when libraries were sometimes installed in the lib64 directory. #4562
  • Don't segfault in ArraySchema::dump when enums are not loaded. #4583
  • Fix out of order consolidation. #4597
  • Finalize should error out for remote global order writes. #4600
  • Fix aggregate leak when field doesn't exist. #4610
  • Fix HTTP requests for AWS assume role not honoring config options. #4616
  • Fix recursively dumping a group with a nonexistent subgroup. #4582
  • Fix HTTP requests for AWS assume role with web identity not honoring config options. #4641

Build System Changes

  • Adds centos stream 9 dockerfile that builds tiledb #4591
  • Export a TileDB::tiledb CMake target regardless of static or dynamic linkage. #4528
  • Add a document with build instructions. #4581
  • Remove the TILEDB_STATIC option and replace it with BUILD_SHARED_LIBS. #4528
  • The build system supports building only a static or shared library from the same buildtree. #4528
  • BUILD_SHARED_LIBS is enabled by default. #4569
  • Add packaging tests into linux and mac CI pipelines. #4567
  • Add vcpkg triplets for Address Sanitizer. #4515
  • Fix regression where release artifacts had 8-digit commit hashes. #4599
  • Fix importing TileDB in CMake versions prior to 3.18. #4671
TileDB - TileDB 2.20.0-rc2

Published by KiterLuc 8 months ago

TileDB v2.20.0 Release Notes

Breaking behavior

  • The minimum supported macOS version on x64 is 11. #4561

New features

  • Add internal definitions for S3 ls recursive #4467
  • Add experimental C API for ls_recursive. #4615
  • Add experimental CPP API for ls_recursive. #4625

Improvements

  • Keep opened array resources alive until query ends. #4601
  • Avoid needless buffer reallocations when consolidating fragments. #4614
  • Update the AWS SDK to version 1.11.215. #4551
  • Fix consolidation plan to print relative paths in output. #4604
  • Fix traversal limit in array deserialization. #4606
  • Add function random_label to utilize PRNG for random string generation. #4564
  • Improve large dense aggregate reads with tile metadata only. #4657

Defects removed

  • Fix regression when libraries were sometimes installed in the lib64 directory. #4562
  • Don't segfault in ArraySchema::dump when enums are not loaded. #4583
  • Fix out of order consolidation. #4597
  • Finalize should error out for remote global order writes. #4600
  • Fix aggregate leak when field doesn't exist. #4610
  • Fix HTTP requests for AWS assume role not honoring config options. #4616
  • Fix recursively dumping a group with a nonexistent subgroup. #4582
  • Fix HTTP requests for AWS assume role with web identity not honoring config options. #4641

Build System Changes

  • Adds centos stream 9 dockerfile that builds tiledb #4591
  • Export a TileDB::tiledb CMake target regardless of static or dynamic linkage. #4528
  • Add a document with build instructions. #4581
  • Remove the TILEDB_STATIC option and replace it with BUILD_SHARED_LIBS. #4528
  • The build system supports building only a static or shared library from the same buildtree. #4528
  • BUILD_SHARED_LIBS is enabled by default. #4569
  • Add packaging tests into linux and mac CI pipelines. #4567
  • Add vcpkg triplets for Address Sanitizer. #4515
  • Fix regression where release artifacts had 8-digit commit hashes. #4599
  • Fix importing TileDB in CMake versions prior to 3.18. #4671
TileDB - TileDB 2.20.0-rc1

Published by KiterLuc 9 months ago

TileDB v2.20.0 Release Notes

Breaking behavior

  • The minimum supported macOS version on x64 is 11. #4561

New features

  • Add internal definitions for S3 ls recursive #4467
  • Add experimental C API for ls_recursive. #4615
  • Add experimental CPP API for ls_recursive. #4625

Improvements

  • Keep opened array resources alive until query ends. #4601
  • Avoid needless buffer reallocations when consolidating fragments. #4614
  • Update the AWS SDK to version 1.11.215. #4551
  • Fix consolidation plan to print relative paths in output. #4604
  • Fix traversal limit in array deserialization. #4606
  • Add function random_label to utilize PRNG for random string generation. #4564
  • Remove uuid in favor of random_label. #4589
  • Improve large dense aggregate reads with tile metadata only. #4657

Defects removed

  • Fix regression when libraries were sometimes installed in the lib64 directory. #4562
  • Don't segfault in ArraySchema::dump when enums are not loaded. #4583
  • Fix out of order consolidation. #4597
  • Finalize should error out for remote global order writes. #4600
  • Fix aggregate leak when field doesn't exist. #4610
  • Fix HTTP requests for AWS assume role not honoring config options. #4616
  • Fix recursively dumping a group with a nonexistent subgroup. #4582
  • Fix HTTP requests for AWS assume role with web identity not honoring config options. #4641

Build System Changes

  • Adds centos stream 9 dockerfile that builds tiledb #4591
  • Export a TileDB::tiledb CMake target regardless of static or dynamic linkage. #4528
  • Add a document with build instructions. #4581
  • Remove the TILEDB_STATIC option and replace it with BUILD_SHARED_LIBS. #4528
  • The build system supports building only a static or shared library from the same buildtree. #4528
  • BUILD_SHARED_LIBS is enabled by default. #4569
  • Add packaging tests into linux and mac CI pipelines. #4567
  • Add vcpkg triplets for Address Sanitizer. #4515
  • Fix regression where release artifacts had 8-digit commit hashes. #4599
  • Fix importing TileDB in CMake versions prior to 3.18. #4671
TileDB - TileDB 2.19.1

Published by KiterLuc 9 months ago

TileDB v2.19.1 Release Notes

Improvements

  • Improve large dense aggregate reads with tile metadata only. #4657

Defects removed

  • Fix HTTP requests for AWS assume role with web identity not honoring config options. #4641
  • Fix HTTP requests for AWS assume role not honoring config options. #4616
TileDB - TileDB 2.20.0-rc0

Published by KiterLuc 9 months ago

TileDB v2.20.0 Release Notes

Breaking behavior

  • The minimum supported macOS version on x64 is 11. #4561

New features

  • Add internal definitions for S3 ls recursive #4467
  • Add experimental C API for ls_recursive. #4615
  • Add experimental CPP API for ls_recursive. #4625

Improvements

  • Keep opened array resources alive until query ends. #4601
  • Avoid needless buffer reallocations when consolidating fragments. #4614
  • Update the AWS SDK to version 1.11.215. #4551
  • Fix consolidation plan to print relative paths in output. #4604
  • Fix traversal limit in array deserialization. #4606
  • Add function random_label to utilize PRNG for random string generation. #4564
  • Remove uuid in favor of random_label. #4589
  • Improve large dense aggregate reads with tile metadata only. #4657

Defects removed

  • Fix regression when libraries were sometimes installed in the lib64 directory. #4562
  • Don't segfault in ArraySchema::dump when enums are not loaded. #4583
  • Fix out of order consolidation. #4597
  • Finalize should error out for remote global order writes. #4600
  • Fix aggregate leak when field doesn't exist. #4610
  • Fix HTTP requests for AWS assume role not honoring config options. #4616
  • Fix recursively dumping a group with a nonexistent subgroup. #4582
  • Fix HTTP requests for AWS assume role with web identity not honoring config options. #4641

Build System Changes

  • Adds centos stream 9 dockerfile that builds tiledb #4591
  • Export a TileDB::tiledb CMake target regardless of static or dynamic linkage. #4528
  • Add a document with build instructions. #4581
  • Remove the TILEDB_STATIC option and replace it with BUILD_SHARED_LIBS. #4528
  • The build system supports building only a static or shared library from the same buildtree. #4528
  • BUILD_SHARED_LIBS is enabled by default. #4569
  • Add packaging tests into linux and mac CI pipelines. #4567
  • Add vcpkg triplets for Address Sanitizer. #4515
  • Fix regression where release artifacts had 8-digit commit hashes. #4599
TileDB - TileDB 2.18.4

Published by KiterLuc 9 months ago

TileDB v2.18.4 Release Notes

Defects removed

  • Fix HTTP requests for AWS assume role not honoring config options. #4616
  • Fix HTTP requests for AWS assume role with web identity not honoring config options. #4641
TileDB - TileDB 2.19.0

Published by KiterLuc 10 months ago

TileDB v2.19.0 Release Notes

Announcements

  • TileDB 2.19, targeted for release in December 2023, includes performance improvements to the aggregate pushdown APIs.

Breaking behavior

  • The Windows release artifacts no longer include static libraries. #4469

New features

  • Allow aggregates to pipeline the processing of full tiles. #4465
  • Add class TemporaryDirectory to generate a PRNG-seeded unique directory. #4498
  • Add sm.consolidation.total_buffer_size setting. #4550
  • Use tile metadata in aggregates. #4468
  • Load validity tiles only for null count aggregates when possible. #4513
  • Prevent reading tiles when using fragment metadata in aggregates. #4481

Improvements

  • Refactor the fragment info loading code to reduce coupling. #4453
  • Fragment metadata: adding get_tile_metadata. #4466
  • Improve error reporting when performing too large GCS direct uploads. #4047
  • Refactor filestore API so that it uses internal TileDB library calls. #3763
  • Encode Win32 error messages in UTF-8. #3987
  • Remove unused compression defines. #4480
  • Integrate baseline object library into the main build. #4446
  • Internal clean-up of array timestamps. #3633
  • Add base class for VFS filesystems. #4497
  • Remove extraneous TILEDB_EXPORT tags. #4507
  • Query Plan REST support - part 1: handler. #4516
  • Use StorageFormat APIs to generate timestamped uris. #4530
  • Refactor the group code. #4378
  • Consolidation plan REST support - part1: handler. #4534
  • Use constexpr to check for filesystem support. #4548
  • Add vfs.gcs.max_direct_upload_size config option. #4047
  • Migrate fragment_name parsing into StorageFormat. #4520
  • Add setting to disable install_sigpipe_handler on S3. #4573

Defects removed

  • Group metadata doesn't get serialized. #3147
  • Added #include <array> to tiledb/sm/cpp_api/type.h. #4504
  • Fix broken linking tests against a shared WebP library. #4525
  • Fix delta filter deserialization for format ver 19. #4541
  • Fix array schema selection when time traveling. #4549

Documentation

  • Add a table with the history of the storage format versions. #4487
  • Add timestamped_name file to the Format Spec. #4533

API changes

C API

  • Add tiledb_group_get_member_by{index|name}v2 (and deprecate tiledb_group_get_member_by{index|name}). #4019
  • tiledb_group_create is no longer marked as deprecated. #4522

C++ API

  • Improve error message in C++ API for bad filter option type. #4503

Build System Changes

  • Improve building the Windows binaries for the R API. #4448
  • Update curl to version 8.4.0. #4523
  • Clean-up unused build system code. #4527
  • Cache more information when configuring the CMake project. #4449
  • Remove the vcpkg submodule and download it automatically when configuring. #4484
  • Use the provided CMake packages to import the compression libraries when vcpkg is enabled. #4500
  • Remove bundling our static library dependencies; they are now found from the CMake config file. #4505
  • Remove the CMake and bootstrap script options related to abseil and crc32c linkage tests. #4527
  • Move documentation generation and source formatting into dedicated CMake modules. #4538
  • Fix regression when libraries were sometimes installed in the lib64 directory. #4572

Test only changes

  • Remove UnitTestConfig::array_encryption_key_length. #4482
TileDB - TileDB 2.19.0-rc1

Published by KiterLuc 10 months ago

TileDB v2.19.0 Release Notes

Announcements

  • TileDB 2.19, targeted for release in December 2023, includes performance improvements to the aggregate pushdown APIs.

Breaking behavior

  • The Windows release artifacts no longer include static libraries. #4469

New features

  • Allow aggregates to pipeline the processing of full tiles. #4465
  • Add class TemporaryDirectory to generate a PRNG-seeded unique directory. #4498
  • Add sm.consolidation.total_buffer_size setting. #4550
  • Use tile metadata in aggregates. #4468
  • Load validity tiles only for null count aggregates when possible. #4513
  • Prevent reading tiles when using fragment metadata in aggregates. #4481

Improvements

  • Refactor the fragment info loading code to reduce coupling. #4453
  • Fragment metadata: adding get_tile_metadata. #4466
  • Improve error reporting when performing too large GCS direct uploads. #4047
  • Refactor filestore API so that it uses internal TileDB library calls. #3763
  • Encode Win32 error messages in UTF-8. #3987
  • Remove unused compression defines. #4480
  • Integrate baseline object library into the main build. #4446
  • Internal clean-up of array timestamps. #3633
  • Add base class for VFS filesystems. #4497
  • Remove extraneous TILEDB_EXPORT tags. #4507
  • Query Plan REST support - part 1: handler. #4516
  • Use StorageFormat APIs to generate timestamped uris. #4530
  • Refactor the group code. #4378
  • Consolidation plan REST support - part1: handler. #4534
  • Use constexpr to check for filesystem support. #4548
  • Add vfs.gcs.max_direct_upload_size config option. #4047
  • Migrate fragment_name parsing into StorageFormat. #4520
  • Add setting to disable install_sigpipe_handler on S3. #4573

Defects removed

  • Group metadata doesn't get serialized. #3147
  • Added #include <array> to tiledb/sm/cpp_api/type.h. #4504
  • Fix broken linking tests against a shared WebP library. #4525
  • Fix delta filter deserialization for format ver 19. #4541
  • Fix array schema selection when time traveling. #4549

Documentation

  • Add a table with the history of the storage format versions. #4487
  • Add timestamped_name file to the Format Spec. #4533

API changes

C API

  • Add tiledb_group_get_member_by{index|name}v2 (and deprecate tiledb_group_get_member_by{index|name}). #4019
  • tiledb_group_create is no longer marked as deprecated. #4522

C++ API

  • Improve error message in C++ API for bad filter option type. #4503

Build System Changes

  • Improve building the Windows binaries for the R API. #4448
  • Update curl to version 8.4.0. #4523
  • Clean-up unused build system code. #4527
  • Cache more information when configuring the CMake project. #4449
  • Remove the vcpkg submodule and download it automatically when configuring. #4484
  • Use the provided CMake packages to import the compression libraries when vcpkg is enabled. #4500
  • Remove bundling our static library dependencies; they are now found from the CMake config file. #4505
  • Remove the CMake and bootstrap script options related to abseil and crc32c linkage tests. #4527
  • Move documentation generation and source formatting into dedicated CMake modules. #4538
  • Fix regression when libraries were sometimes installed in the lib64 directory. #4572

Test only changes

  • Remove UnitTestConfig::array_encryption_key_length. #4482
TileDB - TileDB 2.18.3

Published by KiterLuc 10 months ago

TileDB v2.18.3 Release Notes

New features

  • Add setting to disable install_sigpipe_handler on S3. #4573
TileDB - TileDB 2.19.0-rc0

Published by KiterLuc 11 months ago

TileDB v2.19.0 Release Notes

Announcements

  • TileDB 2.19, targeted for release in December 2023, includes performance improvements to the aggregate pushdown APIs.

Breaking behavior

  • The Windows release artifacts no longer include static libraries. #4469

New features

  • Allow aggregates pipeline the processing of full tiles. #4465
  • Add class TemporaryDirectory to generate a PRNG-seeded unique directory. #4498
  • Add sm.consolidation.total_buffer_size setting. #4550
  • Use tile metadata in aggregates. #4468
  • Load validity tiles only for null count aggregates when possible. #4513
  • Prevent reading tiles when using fragment metadata in aggregates. #4481

Improvements

  • Refactor the fragment info loading code to reduce coupling. #4453
  • Fragment metadata: adding get_tile_metadata. #4466
  • Improve experience when performing too large GCS direct uploads. #4047
  • Refactor filestore API so that it uses internal TileDB library calls. #3763
  • Encode Win32 error messages in UTF-8. #3987
  • Remove unused compression defines. #4480
  • Integrate baseline object library into the main build. #4446
  • Internal clean-up of array timestamps. #3633
  • Add base class for VFS filesystems. #4497
  • Remove extraneous TILEDB_EXPORT tags. #4507
  • Query Plan REST support - part 1: handler. #4516
  • Use StorageFormat APIs to generate timestamped uris. #4530
  • Refactor the group code. #4378
  • Consolidation plan REST support - part1: handler. #4534
  • Use constexpr to check for filesystem support. #4548
  • Add vfs.gcs.max_direct_upload_size config option. #4047
  • Migrate fragment_name parsing into StorageFormat. #4520

Defects removed

  • Group metadata doesn't get serialized. #3147
  • Added #include <array> to tiledb/sm/cpp_api/type.h. #4504
  • Fix broken linking tests against a shared WebP library. #4525
  • Fix delta filter deserialization for format ver 19. #4541
  • Fix array schema selection when time traveling. #4549

Documentation

  • Add a table with the history of the storage format versions. #4487
  • Add timestamped_name file to the Format Spec. #4533

API changes

C API

  • Add new C API functions to get group members and deprecate the existing ones. #4019
  • tiledb_group_create is no longer marked as deprecated. #4522

C++ API

  • Improve error message in C++ API for bad filter option type. #4503

Build System Changes

  • Improve building the Windows binaries for the R API. #4448
  • Update curl to version 8.4.0. #4523
  • Clean-up unused build system code. #4527
  • Cache more information when configuring the CMake project. #4449
  • Remove the vcpkg submodule and download it automatically when configuring. #4484
  • Use the provided CMake packages to import the compression libraries when vcpkg is enabled. #4500
  • Remove bundling our static library dependencies; they are now found from the CMake config file. #4505
  • Remove the CMake and bootstrap script options related to abseil and crc32c linkage tests. #4527
  • Move documentation generation and source formatting into dedicated CMake modules. #4538

Test only changes

  • Remove UnitTestConfig::array_encryption_key_length. #4482
TileDB - TileDB 2.18.2

Published by KiterLuc 11 months ago

TileDB v2.18.2 Release Notes

Defects removed

  • Fix delta filter deserialization for format ver 19. #4541

Build System Changes

  • Remove the externals/vcpkg submodule. Vcpkg is always downloaded by CMake. #4543
Package Rankings
Top 8.57% on Conda-forge.org
Top 17.89% on Anaconda.org
Badges
Extracted from project README
Full CI Azure Pipelines Anaconda download count badge