v2.4.17

BUG FIXES

• skip CopyObject execution for keys which have zero size, to allow properly backup S3, GCS over S3 and Azure disks

v2.4.16

BUG FIXES

• increase AZBLOB_TIMEOUT to 4h, instead 15m to allow download long size data parts
• change S3_MAX_PARTS_COUNT from 5000 to 1000 and minimal S3_PART_SIZE from 5Mb to 25Mb by default to improve speedup S3 uploading / downloading

v2.4.15

BUG FIXES

• fix create and restore command for ReplicatedMergeTree tables with frozen_metadata.txt parsing

v2.4.14

IMPROVEMENTS

• refactoring semaphore.NewWeighted() to errgroup.SetLimit()
• add parallelization to create and restore command during call CopyObject

v2.4.13

BUG FIXES

• fix object_disk.CopyObject during restore to allow use properly S3 endpoint
• fix AWS IRSA environments handler, fix 798

v2.4.12

BUG FIXES

• fix CopyObject to use simple CopyObject call, instead of multipart for zero object size, for backup S3 disks

v2.4.11

BUG FIXES

• fix CopyObject multipart upload complete Parts must be ordered by part number, for backup S3 disks

v2.4.10

IMPROVEMENTS

• update go modules to latest versions
• add S3_REQUEST_PAYER config parameter, look https://docs.aws.amazon.com/AmazonS3/latest/userguide/RequesterPaysBuckets.html for details, fix 795

v2.4.9

BUG FIXES

• fix list remote command date parsing for all remote_storage: custom integration examples
• clickhouse-backup should not fail when --rbac used but rbac object is not present in backup, but it should log warnings/errors, partial fix 793

v2.4.8

BUG FIXES

• fix Object Disks path parsing from config, remove unnecessary "/"
• if S3_ACL is empty then will not use ACL in PutObject, fix 785

v2.4.7

BUG FIXES

• --partitions=(v1,'v2') could calculate wrong partition expression if system.columns will return fields in different order than they described in PARTITION BY clause, fix 791

v2.4.6

IMPROVEMENTS

• make 'kopia' custom scripts really increment fix 781
• add force_http and improve retries in GCS upload 784, thanks @minguyen9988

BUG FIXES

• add Array(Tuple()) to exclude list for `check_parts_columns:true' fix 789
• fix delete remote command for s3 buckets with enabled versioning fix 782
• fix panic during create integration tables when API_LISTEN doesn't contain ":" character, fix 790

v2.4.5

BUG FIXES

• add aws.LogResponse for S3_DEBUG (affected 2.4.4+ versions)

v2.4.4

BUG FIXES

• remove aws.LogResponseWithBody for S3_DEBUG to avoid too many logs (affected 2.4.0+ versions)

v2.4.3

IMPROVEMENTS

• add list command to API /backup/actions, fix 772

BUG FIXES

• fix behavior for restore_as_attach: true for non-replicated MergeTree, fix 773
• tables with ENGINE=Dictionary shall create after all dictionaries to avoid retry, fix 771

v2.4.2

IMPROVEMENTS

• add cpu_nice_priority and io_nice_priority to general config section, which allow us to throttle CPU and IO usage for the whole clickhouse-backup process, fix 757

BUG FIXES

• fix restore for object disk frozen_metadata.txt fix 752
• fix more corner cases for check_parts_columns: true, fix 747
• fix applying macros to s3 endpoint in object disk during restore embedded backups, fix 750
• rewrite GCS clients pool, set default GCS_CLIENT_POOL_SIZE as max(upload_concurrency, download_concurrency) * 3 to avoid stuck, fix 753, thanks @minguyen-jumptrading

v2.4.1

IMPROVEMENTS

• switch to go-1.21
• add clickhouse-server:23.8 for integration and testflows tests
• add FTP_SKIP_TLS_VERIFY config option fix 742

BUG FIXES

• fix calculation part size for S3 and buffer size for Azure to avoid errors for upload big files, fix 739 thanks @rodrigargar
• fix GetFileReader for SSE encryption in S3, again fix 709

v2.4.0

IMPROVEMENTS

• first implementation for properly backup S3/GCS/Azure disks, support server-side copy to back up bucket during clickhouse-backup create and during clickhouse-backup restore, requires add object_disk_path to s3,gcs,azblob section, fix 447
• Implementation blacklist for table engines during backup / download / upload / restore 537
• restore RBAC / configs, refactoring restart clickhouse-server via sql:SYSTEM SHUTDOWN or exec:systemctl restart clickhouse-server, add --rbac-only and --configs-only options to create, upload, download, restore command. fix 706
• Backup/Restore RBAC related objects from Zookeeper via direct connection to zookeeper/keeper, fix 604
• Add SHARDED_OPERATION_MODE option, to easy create backup for sharded cluster, available values none (no sharding), table (table granularity), database (database granularity), first-replica (on the lexicographically sorted first active replica), thanks @mskwon, fix 639, fix 648
• Add support for compression_format: none for upload and download backups created with --rbac / --rbac-only or --configs / --configs-only options, fix 713
• Add support for s3 GLACIER storage class, when GET return error, then, it requires 5 minutes per key and restore could be slow. Use GLACIER_IR, it looks more robust, fix 614
• restore functions via CREATE OR REPLACE for more atomic behavior
• prepare to Make ./tests/integration/ test parallel fix 721
• touch /var/lib/clickhouse/flags/force_drop_table before every DROP TABLE execution, fix 683
• add support connection pool for google cloud storage, GCS_CLIENT_POOL_SIZE, fix 724

BUG FIXES

• fix possible create backup failures during UNFREEZE not exists tables, affected 2.2.7+ version, fix 704
• fix too strict system.parts_columns check when backup create, exclude Enum and Tuple (JSON) and Nullable(Type) vs Type corner cases, fix 685, fix 699
• fix --rbac behavior when /var/lib/clickhouse/access not exists
• fix skip_database_engines behavior
• fix skip_databases behavior during restore for corner case db.prefix* and corner cases when conflict with --tables="*pattern.*", fix 663
• fix S3 head object Server Side Encryption parameters, fix 709

v2.3.2

BUG FIXES

• fix error when backups_to_keep_local: -1, fix 698
• minimal value for download_concurrency and upload_concurrency 1, fix 688
• do not create UDF when use --data flag, fix 697

v2.3.1

IMPROVEMENTS

• add support use_environment_credentials option inside clickhouse-server backup object disk definition, fix 691
• add but skip tests for azure_blob_storage backup disk for use_embbeded_backup_restore: true, it works, but slow, look https://github.com/ClickHouse/ClickHouse/issues/52088 for details

BUG FIXES

• fix static build for FIPS compatible mode fix 693
• complete success/failure server callback notification even when main context canceled, fix 680
• clean command will not return error when shadow directory not exists, fix 686