v1.5.0

IMPROVEMENTS

• try to improve implementation check_replicas_before_attach configuration to avoid concurrent ATTACH PART execution during restore command on multi-shard cluster, fix 474
• add timeout to azure config AZBLOB_TIMEOUT to allow download with bad network quality, fix 467

v1.4.9

BUG FIXES

• fix download behavior for parts which contains special characters in name, fix 462

v1.4.8

IMPROVEMENTS

• add check_replicas_before_attach configuration to avoid concurrent ATTACH PART execution during restore command on multi-shard cluster, fix 474
• allow backup list when clickhouse server offline, fix 476
• add use_custom_storage_class (S3_USE_CUSTOM_STORAGE_CLASS) option to s3 section, thanks @realwhite

BUG FIXES

• resolve {uuid} marcos during restore for ReplicatedMergeTree table and ClickHouse server 22.5+, fix 466

v1.4.7

IMPROVEMENTS

• PROPERLY restore to default disk if disks not found on destination clickhouse server, fix 457

v1.4.6

BUG FIXES

• fix infinite loop error can't acquire semaphore during Download: context canceled, and error can't acquire semaphore during Upload: context canceled all 1.4.x users recommends upgrade to 1.4.6

v1.4.5

IMPROVEMENTS

• add CLICKHOUSE_FREEZE_BY_PART_WHERE option which allow freeze by part with WHERE condition, thanks @vahid-sohrabloo

v1.4.4

IMPROVEMENTS

• download and restore to default disk if disks not found on destination clickhouse server, fix 457

v1.4.3

IMPROVEMENTS

• add API_INTEGRATION_TABLES_HOST option to allow use DNS name in integration tables system.backup_list, system.backup_actions

BUG FIXES

• fix upload_by_part: false max file size calculation, fix 454

v1.4.2

BUG FIXES

• fix --partitions parameter parsing, fix 425

v1.4.1

BUG FIXES

• fix upload data go routines waiting, expect the same upload speed as 1.3.2

v1.4.0

IMPROVEMENTS

• add S3_ALLOW_MULTIPART_DOWNLOAD to config, to improve download speed, fix 431
• add support backup/restore user defined functions, fix 420
• add clickhouse_backup_number_backups_remote, clickhouse_backup_number_backups_local, clickhouse_backup_number_backups_remote_expected,clickhouse_backup_number_backups_local_expected prometheus metric, fix 437
• add ability to apply system.macros values to path field in all types of remote_storage, fix 438
• use all disks for upload and download for mutli-disk volumes in parallel when upload_by_part: true fix #400

BUG FIXES

• fix wrong warning for .gz, .bz2, .br archive extensions during download, fix 441

v1.3.2

IMPROVEMENTS

• add TLS certificates and TLS CA support for clickhouse connections, fix 410
• switch to go 1.18
• add clickhouse version 22.3 to integration tests
• add S3_MAX_PARTS_COUNT and AZBLOB_MAX_PARTS_COUNT for properly calculate buffer sizes during upload and download
• add multithreading GZIP implementation

BUG FIXES

• fix 406, properly handle path for S3, GCS for case when it begins from "/"
• fix 409, avoid delete partially uploaded backups via backups_keep_remote option
• fix 422, avoid cache broken (partially uploaded) remote backup metadata.
• fix 404, properly calculate S3_PART_SIZE to avoid freeze after 10000 multi parts uploading, properly handle error when upload and download go-routine failed to avoid pipe stuck

v1.2.2

IMPROVEMENTS

• Add REST API POST /backup/tables/all, fix POST /backup/tables to respect CLICKHOUSE_SKIP_TABLES

BUG FIXES

• fix #297, properly restore tables where have fields with the same name as table name
• fix #298, properly create system.backup_actions and system.backup_list integration tables for ClickHouse before 21.1
• fix #303, ignore leading and trailing spaces in skip_tables and --tables parameters

v1.3.1

IMPROVEMENTS

• fix 387, improve documentation related to memory and CPU usage

BUG FIXES

• fix 392, correct download for recursive sequence of diff backups when DOWNLOAD_BY_PART true
• fix 390, respect skip_tables patterns during restore and skip all INFORMATION_SCHEMA related tables even skip_tables don't contain INFORMATION_SCHEMA pattern
• fix 388, improve restore ON CLUSTER for VIEW with TO clause
• fix 385, properly handle multiple incremental backup sequences + BACKUPS_TO_KEEP_REMOTE

v1.2.3

HOT FIXES

• fix 390, respect skip_tables patterns during restore and skip all INFORMATION_SCHEMA related tables even skip_tables don't contain INFORMATION_SCHEMA pattern

v1.3.0

IMPROVEMENTS

• Add API_ALLOW_PARALLEL to support multiple parallel execution calls for, WARNING, control command names don't try to execute multiple same commands and be careful, it could allocate much memory
  during upload / download, fix #332
• Add support for --partitions on create, upload, download, restore CLI commands and API endpoint fix #378 properly implementation
  of #356
• Add implementation --diff-from-remote for upload command and properly handle required on download command, fix #289
• Add print-config cli command fix #366
• Add UPLOAD_BY_PART (default: true) option for improve upload/download concurrency fix #324
• Add ARM support for Docker images and pre-compiled binary files, fix #312
• KeepRemoteBackups should respect differential backups, fix #111
• Add SFTP_DEBUG option, fix #335
• Add ability to restore schema ON CLUSTER, fix #145
• Add support encrypted disk (include s3 encrypted disks), fix #260
• API Server optimization for speed of last_backup_size_remote metric calculation to make it async during REST API startup and after download/upload,
  fix #309
• Improve list remote speed via local metadata cache in $TEMP/.clickhouse-backup.$REMOTE_STORAGE, fix #318
• Add CLICKHOUSE_IGNORE_NOT_EXISTS_ERROR_DURING_FREEZE option, fix #319
• Add support for PROJECTION, fix #320
• Return clean cli command and API POST /backup/clean endpoint, fix #379

BUG FIXES

• fix #300, allow GCP properly work with empty GCP_PATH
  value
• fix #340, properly handle errors on S3 during Walk() and
  delete old backup
• fix #331, properly restore tables where have table name
  with the same name as database name
• fix #311, properly run clickhouse-backup inside docker
  container via entrypoint
• fix #317, properly upload large files to Azure Blob
  Storage
• fix #220, properly handle total_bytes for uint64 type
• fix #304, properly handle archive extension during download instead of use config settings
• fix #375, properly REMOTE_STORAGE=none error handle
• fix #379, will try to clean shadow if create fail during moveShadow
• more precise calculation backup size during upload, for backups created with --partitions, fix bug after #356
• fix restore --rm behavior for 20.12+ for tables which have dependent objects (like dictionary)
• fix concurrency by FTP creation directories during upload, reduce connection pool usage
• properly handle --schema parameter for show local backup size after download
• fix restore bug for WINDOW VIEW, thanks @zvonand

EXPERIMENTAL

• Try to add experimental support for backup MaterializedMySQL and MaterializedPostgeSQL tables, restore MySQL tables not impossible now without replace table_name.json to Engine=MergeTree,
  PostgreSQL not supported now, see https://github.com/ClickHouse/ClickHouse/issues/32902

v1.2.2

IMPROVEMENTS

• Add REST API POST /backup/tables/all, fix POST /backup/tables to respect CLICKHOUSE_SKIP_TABLES

BUG FIXES

• fix #297, properly restore tables where have fields with the same name as table name
• fix #298, properly create system.backup_actions and system.backup_list integration tables for ClickHouse before 21.1
• fix #303, ignore leading and trailing spaces in skip_tables and --tables parameters

v1.2.1

IMPROVEMENTS

• Add REST API integration tests

BUG FIXES

• fix #290
• fix #291
• fix CLICKHOUSE_DEBUG settings behavior (now we can see debug log from clickhouse-go)

v1.2.0

INCOMPATIBLE CHANGES

• REST API /backup/status now return only latest executed command with status and error message

IMPROVEMENTS

• Added REST API /backup/list/local and /backup/list/remote to allow list backup types separately
• Decreased background backup creation time via REST API /backup/create, during avoid list remote backups for update metrics value
• Decreased backup creation time, during avoid scan whole system.tables when set table query string parameter or --tables cli parameter
• Added last and filter query string parameters to REST API /backup/actions, to avoid pass to client long JSON documents
• Improved FTP remote storage parallel upload / download
• Added FTP_CONCURRENCY to allow, by default MAX_CPU / 2
• Added FTP_DEBUG setting, to allow debug FTP commands
• Added FTP to CI/CD on any commit
• Added race condition check to CI/CD

BUG FIXES

• environment variable LOG_LEVEL now apply to clickhouse-backup server properly
• fix #280, incorrect prometheus metrics measurement for /backup/create, /backup/upload, /backup/download
• fix #273, return S3_PART_SIZE back, but calculates it smartly
• fix #252, now you can pass last and filter query string parameters
• fix #246, incorrect error messages when use REMOTE_STORAGE=none
• fix #283, properly handle error message from FTP server
• fix #268, properly restore legacy backup for schema without database name

v1.1.1

BUG FIXES

• fix broken system.backup_list integration table after add required field in https://github.com/AlexAkulov/clickhouse-backup/pull/263
• fix #274 invalid SFTP_PASSWORD environment usage