v2.2.8

BUG FIXES

• hotfix wrong empty files when disk_mapping contains not exists during create, affected 2.2.7 version, look details 676

v2.3.0

IMPROVEMENTS

• add FIPS compatible builds and examples, fix 656, fix 674
• improve support for use_embedded_backup_restore: true, applied ugly workaround in test to avoid https://github.com/ClickHouse/ClickHouse/issues/43971, and applied restore workaround to resolve https://github.com/ClickHouse/ClickHouse/issues/42709
• migrate to clickhouse-go/v2, fix 540, close 562
• add documentation for AWS_ARN_ROLE and AWS_WEB_IDENTITY_TOKEN_FILE, fix 563

BUG FIXES

• hotfix wrong empty files when disk_mapping contains not exists during create, affected 2.2.7 version, look details 676
• add FTP_ADDRESS and SFTP_PORT in Default config Readme.md section fix 668
• when use --tables=db.materialized_view pattern, then create/restore backup also for .inner.materialized_view or .inner_id.uuid, fix 613

v2.2.7

IMPROVEMENTS

• Auto-tuning concurrency and buffer size related parameters depending on remote storage type, fix 658
• add CLICKHOUSE_BACKUP_MUTATIONS and CLICKHOUSE_RESTORE_AS_ATTACH config options to allow backup and properly restore table with system.mutations is_done=0 status. fix 529
• add CLICKHOUSE_CHECK_PARTS_COLUMNS config option and --skip-check-parts-column CLI parameter to watch, create and create_remote commands to disallow backup with inconsistent column data types fix 529
• add test coverage reports for unit, testflows and integration tests, fix 644
• use UNFREEZE TABLE in ClickHouse after backup finished to allow s3 and other object storage disks unlock and delete remote keys during merge, fix 423

BUG FIXES

• apply SETTINGS check_table_dependencies=0 to DROP DATABASE statement, when pass --ignore-dependencies together with --rm in restore command, fix 651
• add support for masked secrets for ClickHouse 23.3+, fix 640

v2.2.6

BUG FIXES

• fix panic for resume upload after restart API server for boolean parameters, fix 653
• apply SETTINGS check_table_dependencies=0 to DROP DATABASE statement, when pass --ignore-dependencies together with --rm in restore command, fix 651

v2.2.5

BUG FIXES

• fix error after restart API server for boolean parameters, fix 646
• fix corner cases when restore_schema_on_cluster: cluster, fix 642, error happens on 2.2.0-2.2.4
• fix Makefile targets build-docker and build-race-docker for old clickhouse-server version
• fix typo retries_pause config definition in general section

v2.2.4

BUG FIXES

• fix wrong deletion on S3 for versioned buckets, use s3.HeadObject instead of s3.GetObjectAttributes, fix 643

v2.2.3

BUG FIXES

• fix wrong parameters parsing from *.state file for resumable upload \ download after restart, fix 641

v2.2.2

IMPROVEMENTS

• add callback parameter to upload, download, create, restore API endpoints, fix 636

BUG FIXES

• add system.macros could be applied to path config section to ReadMe.md, fix 638
• fix connection leaks for S3 versioned buckets during execution upload and delete command, fix 637

v2.2.1

IMPROVEMENTS

• add additional server-side encryption parameters to s3 config section, fix 619
• restore_remote will not return error when backup already exists in local storage during download check, fix 625

BUG FIXES

• fix error after restart API server when .state file present in backup folder, fix 623
• fix upload / download files from projections multiple times, cause backup create wrong create *.proj as separate data part, fix 622

v2.2.0

IMPROVEMENTS

• switch to go 1.20
• after API server startup, if /var/lib/clickhouse/backup/*/(upload|download).state present, then operation will continue in background, fix 608
• make use_resumable_state: true behavior for upload and download, fix 608
• improved behavior --partitions parameter, for cases when PARTITION BY clause return hashed value instead of numeric prefix for partition_id in system.parts, fix 602
• apply system.macros values when use restore_schema_on_cluster and replace cluster name in engine=Distributed tables, fix 574
• switch S3 storage backend to https://github.com/aws/aws-sdk-go-v2/, fix 534
• added S3_OBJECT_LABLES and GCS_OBJECT_LABELS to allow setup each backup object metadata during upload fix 588
• added clickhouse-keeper as zookeeper replacement for integration test during reproduce 416
• decrease memory buffers for S3 and GCS, change default value for upload_concurrency and download_concurrency to round(sqrt(MAX_CPU / 2)), fix 539
• added ability to set up custom storage class for GCS and S3 depends on backupName pattern, fix 584

BUG FIXES

• fix ssh connection leak for SFTP remote storage, fix 578
• fix wrong Content-Type header, fix 605
• fix wrong behavior for download with --partitions fix 606
• fix wrong size of backup in list command if upload or download was break and resume, fix 526
• fix _successful_ and _failed_ metrics counter issue, happens after 2.1.0, fix 589
• fix wrong calculation date of last remote backup during startup
• fix wrong duration, status for metrics after 2.1.0 refactoring, fix 599
• fix panic on LIVE VIEW tables with option --restore-database-mapping db:db_new enabled), thanks @php53unit

v2.1.3

IMPROVEMENTS

• during upload sort tables descending by total_bytes if this field present
• improve ReadMe.md add description for all CLI commands and parameters
• add use_resumable_state to config to allow default resumable behavior in create_remote, upload, restore_remote and download commands, fix 576

BUG FIXES

• fix --watch-backup-name-template command line parsing, overridden after config reload, fix 548
• fix wrong regexp, when restore_schema_on_cluster: cluster_name, fix 552
• fix wrong clean command and API behavior, fix 533
• fix getMacro usage in Examples for backup / restore sharded cluster.
• fix deletion files from S3 versioned bucket, fix 555
• fix --restore-database-mapping behavior for ReplicatedMergeTree (replace database name in replication path) and Distributed (replace database name in underlying table) tables, fix 547
• MaterializedPostgreSQL doesn't support FREEZE, fix 550, see also https://github.com/ClickHouse/ClickHouse/issues/32902, https://github.com/ClickHouse/ClickHouse/issues/44252
• create and restore commands will respect skip_tables config options and --table cli parameter, to avoid create unnecessary empty databases, fix 583
• fix watch unexpected connection closed behavior, fix 568
• fix watch validation parameters corner cases, close 569
• fix --restore-database-mapping behavior for ATTACH MATERIALIZED VIEW and restore --data corner cases, fix 559

v2.1.2

IMPROVEMENTS

• add watch description to Examples.md

BUG FIXES

• fix panic when use --restore-database-mapping=db1:db2, fix 545
• fix panic when use --partitions=XXX, fix 544

v2.1.1

BUG FIXES

• return bash and clickhouse usergroup to Dockerfile image short, fix 542

v2.1.0

IMPROVEMENTS

• complex refactoring to use contexts, AWS and SFTP storage not full supported
• complex refactoring for logging to avoid race condition when change log level during config reload
• improve kubernetes example for adjust incremental backup, fix 523
• add storage independent retries policy, fix 397
• add clickhouse-backup-full docker image with integrated kopia, rsync, restic and clickhouse-local, fix 507
• implement GET /backup/kill?command=XXX API to allow kill, fix 516
• implement kill "full command" in POST /backup/actions handler, fix 516
• implement watch in POST /backup/actions handler API and CLI command, fix 430
• implement clickhouse-backup server --watch to allow server start watch after start, fix 430
• update metric last_{create|create_remote|upload}_finish metrics values during API server startup, fix 515
• implement clean_remote_broken command and POST /backup/clean/remote_broken API request, fix 520
• add metric number_backups_remote_broken to calculate broken remote backups, fix 530

BUG FIXES

• fix keep_backups_remote behavior for recursive incremental sequences, fix 525
• for restore command call DROP DATABASE IF EXISTS db SYNC when pass --schema and --drop together, fix 514
• close persistent connections for remote backup storage after command execution, fix 535
• lot of typos fixes

v2.0.0

IMPROVEMENTS

• implements remote_storage: custom, which allow us to adopt any external backup system like restic, kopia, rsync, rclone etc. fix 383
• add example workflow hot to make backup / restore on sharded cluster, fix 469
• add use_embedded_backup_restore to allow BACKUP and RESTORE SQL commands usage, fix 323, need 22.7+ and resolve https://github.com/ClickHouse/ClickHouse/issues/39416
• add timeout to azure config AZBLOB_TIMEOUT to allow download with bad network quality, fix 467
• switch to go 1.19
• refactoring to remove legacy storage package
• add table parameter to tables cli command and /backup/tables API handler, fix 367
• add --resumable parameter to create_remote, upload, restore_remote, donwload commands to allow resume upload or download after break. Ignored for remote_storage: custom, fix 207
• add --ignore-dependencies parameter to restore and restore_remote, to allow drop object during restore schema on server where schema objects already exists and contains dependencies which not present in backup, fix 455

BUG FIXES

• fix wrong upload / download behavior for compression_format: none and remote_storage: ftp

v1.6.2

IMPROVEMENTS

• add Azure to every CI/CD run, testing with Azurite

BUG FIXES

• fix azblob.Walk with recursive=True, for properly delete remote backups

v1.6.1

BUG FIXES

• fix system.macros detect query

v1.6.0

IMPROVEMENTS

• add storage_class (GCS_STORAGE_CLASS) support for remote_storage: gcs fix 502
• upgrade aws golang sdk and gcp golang sdk to latest versions

v1.5.2

IMPROVEMENTS

• switch to go 1.19
• refactoring to remove legacy storage package

v1.5.1

BUG FIXES

• properly execute CREATE DATABASE IF NOT EXISTS ... ON CLUSTER when setup restore_schema_on_cluster, fix 486