yugabyte-db

Download and Release notes https://docs.yugabyte.com/latest/releases/release-notes/v2.8/#v2.8.2.0

v2.11.2.0 - January 26, 2022

Build: 2.11.2.0-b89

Downloads

Docker

docker pull yugabytedb/yugabyte:2.11.2.0-b89

New Features

Yugabyte Platform

• [PLAT-1885] Hashicorp Vault Integration
• [PLAT-2341] UI support for Multiple on-prem provider instances
• [PLAT-2362] Maintenance windows API and backend
• [PLAT-2382] New backups API
• [PLAT-2401] [PLAT-2404] New GFlag form component and validation for user entries
• [PLAT-2402] UI form for user to add/edit gflags in more accurate way
• [PLAT-2403] Add Multiple G-flags from free text(json)
• [PLAT-2479] LDAP Integration with Platform
• [PLAT-2535] Add API endpoint for aborting tasks
• [PLAT-2553] Node Comparison Feature in Metrics Page (Backend)
• [PLAT-2562] UI support for abort task capability
• [PLAT-2658] Integrate t3 instance type support
• [PLAT-2750] YSQL_DUMP based backup-create and backup-restore
• [PLAT-2766] Can now delete paused GCP instances

Database

• [8032] [YSQL] Add support for ALTER TYPE .. RENAME TO
• [10451] [ysql] Add support for ADD CONSTRAINT .. UNIQUE .. USING INDEX
• [10509] [10510] [YSQL] Add support for CREATE, DROP, and REFRESH MATERIALIZED VIEW

Improvements

Yugabyte Platform

• [PLAT-501] [PLAT-1850] Add Custom CA cert start and expiry in backend and add extra validations for custom certs
• [PLAT-580] Add API to sync platform XClusterConfig state with universe
• [PLAT-2058] Add Custom Port UI Validation
• [PLAT-2066] Read write alert
• [PLAT-2131] Addition of Default GFlags while GFlags updating
• [PLAT-2152] Task Improvement - changes in task framework to wait for previous subtask, ability to send abort signal to a task
• [PLAT-2236] Add leader blacklisting to kubernetesUpgradeTaskBase
• [PLAT-2296] Timezone Selector on user profile (UI)
• [PLAT-2324] Universe with RF=3 and 3 nodes could be updated to have 2 nodes only
• [PLAT-2362] Active alert notification period
• [PLAT-2435] Task Improvement - Make CreateUniverse retryable.
• [PLAT-2460] Task Improvement - Make EditUniverse retryable
• [PLAT-2461] [UI] Enhance KMS Config listing UI
• [PLAT-2467] [UI] XCluster UI Changes
• [PLAT-2480] Change in request payload and response format for G-Flag validation API
• [PLAT-2500] [UI] Add support to edit KMS configs
• [PLAT-2501] [Alerts-UI] Rename the "Edit" button to "Save" in Edit Notification Channels
• [PLAT-2572] Task Improvement - Move/Include retryable and abortable in CustomerTask API response payload
• [PLAT-2577] UI - Edit KMS, handling values that user want to empty and masked values.
• [PLAT-2613] Adding a runtime config flag to retain shellprocess cmdOutputLogs.
• [PLAT-2641] Task Improvement - CreateUniverse retry for onprem nodes does not work due to precheck failure
• [PLAT-2690] Run upgrade_ysql during universe upgrade
• [PLAT-2719] Allow path style access for non-standard endpoints in S3 backup configs
• [PLAT-2784] Add support for dev db-versions while listing gflags
• [PLAT-2821] Change default instance type to c5.4xlarge in universe creation
• [Platform] GFlags validation Improvements

Database

• [5755] [DocDB] Transaction cleanup improvements
• [7977] [DocDB] Load balance leaders across disks
• [8730] [dst] Enable compaction and flush of sys catalog tablet from admin CLI.
• [8978] [docdb] Generate system.partitions vtable proactively instead of via a background task
• [9468] [YSQL] Perform indefinite retries on kReadRestart for each statement in READ COMMITTED isolation (Part-2)
• [9956] [ysql] support ybgin index in hstore extension
• [10076] [docdb] [DST] Enhance rocksdb UI page with info about OPTIONS
• [10159] [ysql] Tablegroup placement
• [10168] [ysql] support tablegroup dumps
• [10217] [10791] [docdb] Bootstrap from tablet with leader in same AZ, remove skip leader code.
• [10456] [ysql] Import Fix detaching partitions with cloned row triggers
• [10479] [docdb] Multi-RAFT V0 - Batch Heartbeat Requests (Bypass Heartbeats)
• [10510] [YSQL] Improve performance of concurrent refreshes for matviews
• [10527] [ycql] Upgrade Cassandra driver to 4.6.0-yb-10
• [10548] [Spark Connector] Upgrade to Spark Connector 3.0-yb-10
• [10571] A separate flag to check for large clock skew on hybrid clock reads
• [10584] [DocDB] Add support for precompiled headers
• [10584] [DocDB] Generate protobuf forward headers
• [10584] [DocDB] Split complex proto files into smaller parts
• [10584] [DocDB] Split master service into multiple services
• [10643] [10642] Create tool to modify hybrid time in SST and WAL files
• [10668] [ysql] Import Adjust pg_dump's priority ordering for casts.
• [10717] [YSQL] Reduce execution time of OpenTable by table_id
• [10748] [ysql] Import Warning on SET of nonexisting setting with a prefix reserved by an extension
• [10775] [ysql] Import Avoid leaking memory during large-scale REASSIGN OWNED BY operations.
• [10857] [DocDB] Lightweight protobuf generation
• [10862] [ysql] Tab Completion for Tablegroups
• [10883] [YSQL] Rename the GUC for disabling transactional writes
• [10920] Support build with Clang 12 and Linuxbrew

Bug Fixes

Yugabyte Platform

• [PLAT-32] provision_instance.py should not have any version specific dir paths (#5538)
• [PLAT-580] Fix sync api bug with previously-existing xcluster configs
• [PLAT-1955] Preflight checks also take into account free space
• [PLAT-2007] Do not enable leader blacklisting for RF1 clusters
• [PLAT-2055] [UI] Fix UI on clicking Retry Task button
• [PLAT-2080] Set Universe keys before starting tserver on encryption at rest enabled universes.
• [PLAT-2099] Fix abort Multi-namespace backup task
• [PLAT-2241] Replace non-unicode symbols in a tool output decode
• [PLAT-2252] fixing Oracle8 ntpd health check
• [PLAT-2316] Fix local privilege escalation issue with collect_metrics script
• [PLAT-2331] Install s3cmd/gsutil on graviton
• [PLAT-2342] [UI] Make sure "Desired Home Directory" and Mount path are different for on-prem providers
• [PLAT-2420] ".local" as a TLD in AWS host base
• [PLAT-2424] [UI] Encryption At Rest setting is not persistent while configuring Read replica
• [PLAT-2434] Disabling logging config customization
• [PLAT-2434] Fix omitted log configurations after application start
• [PLAT-2457] Fix overwriting of username and password for slow queries
• [PLAT-2478] Add synchronization to release APIs
• [PLAT-2481] Fix log filtering error
• [PLAT-2484] Set incrementVersion to false in unlockUniverseUpdate
• [PLAT-2497] Disable cert checking when using s3client for backups
• [PLAT-2498] Fix for Wrong timestamps in Health Check and Users Tab
• [PLAT-2514] Fix leaderless and underreplicated tablet alerts in case master quorum is missing
• [PLAT-2517] Fix typo (missing backslash) in the priority-regex for Prometheus in replicated.yaml
• [PLAT-2521] Health checks failing for universe with read replica after full move
• [PLAT-2528] adding architecture suffix to node_exporter role
• [PLAT-2530] Use DB transaction to lock Universe and any DB changes in the callback during the locking
• [PLAT-2533] Fix build version health check for invalid build names
• [PLAT-2537] Fix alert count for read-only user Summary: Alert count endpoint is using POST request, which is not available by default for read-only user. Need to add it manually to the exclusion list.
• [PLAT-2541] CreateUniverse retry - ServerSetup state match missing
• [PLAT-2568] universe_configure doesn't return a good/detailed message in case of errors
• [PLAT-2569] ignoring squashfs in disk utilization health check
• [PLAT-2570] Add run_node_action.py and node_client_utils.py scripts to platform release
• [PLAT-2579] Disable strict host checking for run_node_action.py
• [PLAT-2580] When decrypt universe key is called, also attempt to renew token and update KMSConfig.
• [PLAT-2586] Fix logs download
• [PLAT-2587] Error during create universe for yugabundle
• [PLAT-2590] Some tasks create multiple SubTaskGroupQueue in the same run() method with the expectation to run only the subtasks added to the queue.
• [PLAT-2602] Fix various write read table creation issues
• [PLAT-2612] Health check not stopped for the Universe being edited
• [PLAT-2626] Fix backup deletion issue during destroy universe
• [PLAT-2634] Fix xcluster APIs for HA-enabled platform deployments
• [PLAT-2634] Log exception on cluster config version increment failure
• [PLAT-2658] [Hc-Vault] Validation for vault address field not working
• [PLAT-2672] Skip system_platform DB in 'All namespaces' YSQL backup
• [PLAT-2681] Hashicorp config - attempting to add a config fails when transit mount path specified does not have any keys
• [PLAT-2700] Fix OOM kills alert for cron universe + fix QueryAlerts execution
• [PLAT-2701] Instances getting added to incorrect provider in onprem multi-provider config
• [PLAT-2752] Increase running task beating time interval from 1sec to 10secs.
• [PLAT-2754] Add run_node_action.py to the bin section of yb_release_manifest.json
• [PLAT-2765] Redact GCP creds in provider creation audit log
• [PLAT-2791] RunYsqlUpgrade subtask should not be run on upgrades of universes with YSQL disabled
• [Platform] [10950] [Backups] Allow TS to have no tablets for the table
• [Platform] Reset pg_stat_statements after creating/updating db credentials
• [Platorm] [CLOUDGA-2711] wait for boot script completion + save vm console output if provisioning fails
• [Platorm] Wait for boot script completion + save vm console output if provisioning fails

Database

• [2266] [YSQL] Fix YSQL PG crypto function crash issue
• [6149] [10587] [YSQL] Partitioned table primary key is not correctly inherited by partitions
• [10096] [ycql] Error out when ignore_null_jsonb_attributes is misspelled
• [10482] [DST] Rate-limit Create/Delete Snapshot requests
• [10547] [YBASE] [DocDB] Avoid unnecessary GetTransactionStatus calls during reads #10547
• [10589] [YSQL] ysql_dump duplicates primary key for partition table
• [10602] [DocDB] Initialize new fs root dirs
• [10742] [Spark Connector] Accommodate extra backticks in Spark 3.2.0 Plan
• [10773] [YSQL] [Backups] Change YSQLDump during the backup restoring
• [10792] [ysql] Add YB operations to validate replication info
• [10845] [xCluster] Fix rename universe replication with multiple renames
• [10858] [YSQL] Disable sending DocDB requests with trivially false ANY filters
• [10868] [YSQL] Make ALTER ADD PK persist reloptions
• [10881] [DocDB] Fix "loop variable is always a copy because the range of type"
• [10907] [Backup] [platform] Prevent double config file uploading.
• [10943] [YSQL] Masking ldapbindpasswd in logs after authentication fails
• [10962] Use random_generator_mt19937 which is seeded via /dev/urandom
• [10963] Avoid float division by zero error
• [11008] [YSQL] Fix failures in concurrent refreshes for matviews
• [11054] [YCQL] Aggregate updates to JSONB column before inserting Subdoc
• [adhoc] [DST] Downgrade noisy log when there are no memtables to flush

Known Issues

Yugabyte Platform

N/A

Database

N/A

v2.8.1.0 - January 4, 2022

Build: 2.8.1.0-b37

Downloads

Docker

docker pull yugabytedb/yugabyte:2.8.1.0-b37

New features

Yugabyte Platform

• [PLAT-2295] [PLAT-2296] Timezone Selector on user profile
• [PLAT-2306] Add UI support for GCP user tags

Database

• [7809] [YSQL] Add session flag to enable non-transactional writes on COPY
• [10094] [DocDB] Implemented advanced delta encoding/decoding optimized for DocDB-specific rocksdb keys
• [10204] [YSQL] Add functionality for the yb_fdw role
• [10473] Implement YSQL Follower reads.
• [10563] [xCluster] Create Rename Replication Command

Improvements

Yugabyte Platform

• [PLAT-506] Allow custom port in AWS host base
• [PLAT-2103] [UI] [Encr at rest] AWS credentials enabled when IAM is checked in
• [PLAT-2298] Allow outOfOrder migrations and ignoreMissingMigrations
• [PLAT-2420] ".local" as a TLD in AWS host base
• [PLAT-2522] Backport Migrations for LDAP support
• Add leader blacklisting to UpgradeTaskBase, Stop Processes, upgradeKubernetes, and handling rf1 universes
• Update certs to use certLabel as CN

Database

• [10428] [DocDB] Improve logging for SST file expiration
• [10482] [DST] Rate-limit Create/Delete Snapshot requests
• [10503] [DocDB] Add GFlag to trust value-level TTL metadata during file expiration.
• [10543] [YCQL] Allow NULL in filtering clauses WHERE/IF inside IN/NOT IN operators in SELECT statement.
• [10579] [YSQL] Import libpq: reject extraneous data after SSL or GSS encryption handshake.
• [10655] [YSQL] Add --postmaster_cgroup gflag to tserver
• [10883] [YSQL] Rename the GUC for disabling transactional writes

Bug fixes

Yugabyte Platform

• [10907] [Backup] Prevent double config file uploading.
• [PLAT-1990] Ensure universe size doesn't change dramatically during a full move
• [PLAT-2080] Set Universe keys before starting tserver on encrption at rest enabled universes.
• [PLAT-2101] Save button doesn't throw field errors when all the fields are empty
• [PLAT-2102] Stop creation of KMS configs with duplicate name
• [PLAT-2298] Disable third-party flyway plugin in yugabundle
• [PLAT-2121] [UI] [KMS UI] displaying Successfully added even when it fails to add KMS config
• [PLAT-2177] Avoid adding duplicate delete backup tasks to tasks queue
• [PLAT-2246] Fix Timezone UI Bugs
• [PLAT-2311] API Should return region active status
• [PLAT-2314] [PLAT-2321] Fix backup util behavior on error for onprem providers
• [PLAT-2339] [UI] Disable toggle TLS / cert rotation dialogs in UI for k8s universes
• [PLAT-2351] Disable upgrade to systemd for manually provisioned universes
• [PLAT-2373] Get rid of repeated migrations
• [PLAT-2400] Universe scaling out by adding nodes keeps new nodes in blacklisted state.
• [PLAT-2427] [UI] No way to remove region from provider
• [PLAT-2498] Fix for Wrong timestamps in Health Check and Users Tab
• [PLAT-2517] Fix typo (missing backslash) in the priority-regex for prometheus in replicated.yaml

Database

• [10256] [PITR] Fix Incorrect Restore logic for System Catalog tables
• [10591] [YSQL] COPY for partitioned table writes to parent instead of child nodes
• [10646] [YSQL] fix client backfill timeout

Known issues

Yugabyte Platform

• N/A

Database

• N/A

v2.11.1.0 - December 15, 2021

Build: 2.11.1.0-b305

Downloads

Docker

docker pull yugabytedb/yugabyte:2.11.1.0-b305

New Features

Yugabyte Platform

• [PLAT-526] [UI] UI support for xCluster replication management phase-1
• [PLAT-529] GFlags validation APIs

Database

• [6639] [YSQL] Add ALTER TABLE SET TABLESPACE
• [8242] [DST] Enable automatic tablet splitting by default
• [9468] [YSQL] [Part-1] READ COMMITTED isolation level
• [9984] Support arm64 build on macOS
• [10563] [xCluster] Create Rename Replication Command
• [10655] [YSQL] Add --postmaster_cgroup gflag to tserver
• [10671] [yugabyted] use env var YB_DISABLE_CALLHOME

Improvements

Yugabyte Platform

• [8517] [6302] [5355] Auto populate provider dropdown, remove parenthesis around range partition and adjust DB version margin (#10229)
• [8517] Add handling for provider input in edit universe scenario
• [PLAT-506] Allow custom port in AWS host base
• [PLAT-1773] Auto refresh of metrics page with intervals dropdown
• [PLAT-1783] Add loading icon for universe list page
• [PLAT-1923] [PLAT-1924] Ability to create universes with AZs count > RF + definition of default region
• [PLAT-1931] Add Prometheus links to metrics panels
• [PLAT-1941] Add status quick filter and table actions
• [PLAT-1944] Allow customers to modify platform log rollover and retention settings
• [PLAT-1950] Collect additional metrics
• [PLAT-1957] Check ports availability in preflight check
• [PLAT-1993] [UI] Show backup config name in list of backups
• [PLAT-2004] Add leader blacklisting to UpgradeTaskBase
• [PLAT-2061] Add PagerDuty and WebHook channels
• [PLAT-2063] YSQL connections count, Leaderless tablets, Under-replicated tablets, Missing master leader alerts
• [PLAT-2064] DB Overload alerts
• [PLAT-2108] NFS backup with Encryption at rest enabled
• [PLAT-2143] [UI] Add an optional field AWS KMS Endpoint while creating KMS config
• [PLAT-2154] Add UI support for new log search API endpoint
• [PLAT-2173] Task Improvement - implement ways to save and read states changed by subtasks
• [PLAT-2195] Add support for multi-universe filter alert count endpoint
• [PLAT-2227] Added a runtime config setting for disabling all the cert validations
• [PLAT-2229] Retrieve YB version via ssh/kubectl during health check
• [PLAT-2237] Add leader blacklisting to stop node in universe
• [PLAT-2244] Update instance creation and listing to accept and return node UUID and Universe UUID.
• [PLAT-2261] Enhancements to /logs UI endpoint
• [PLAT-2303] Change Prometheus link icon in Metrics Page
• [PLAT-2306] Add UI support for GCP user tags
• [PLAT-2345] Show metrics for paused universes
• [PLAT-2348] Increase the configuration name max size to 100
• [PLAT-2361] Filter and sort alert configurations on various fields + return alert count in page API
• [PLAT-2467] [UI] XCluster UI Changes
• Update certs to use certLabel as CN

Database

• [1127] [YSQL] Improve collation upgrade performance.
• [1127] [YSQL] Use attribute collation for SPLIT AT clause
• [1979] Support PG11 text search configuration
• [5395] [docdb] Add metrics for master async tasks
• [7809] [YSQL] Add session flag to enable non-transactional writes on COPY
• [8597] [YSQL] Changing Catalog Version Mismatch in Postgres layer as retryable error
• [10158] [Geo] Selecting different txn status table based on local vs global requirements
• [10190] [YSQL] create and use the pg_yb_tablegroup table
• [10159] [Geo] Added global_transaction session variable
• [10352] [YSQL] Import Invalidate partitions of table being attached/detached
• [10358] [xCluster] [Tablet-splitting] Handle consumer side splits
• [10428] [DocDB] Improve logging for SST file expiration
• [10388] [YSQL] Import Fix pg_dump for disabled triggers on partitioned tables
• [10431] [YSQL] Import pg_dump: fix mis-dumping of non-global default privileges.
• [10433] [YSQL] Catalog cache refresh improvements
• [10435] [DocDB] Display split depth in the master Tables UI
• [10503] [DocDB] Add GFlag to trust value-level TTL metadata during file expiration.
• [10543] [YCQL] Allow NULL in filtering clauses WHERE/IF inside IN/NOT IN operators in SELECT statement.
• [10576] [YSQL] Import Reject extraneous data after SSL or GSS encryption handshake.
• [10579] [YSQL] Import libpq: reject extraneous data after SSL or GSS encryption handshake.
• [10586] [YSQL] Reduce number of reads from the pg_yb_catalog_version table on staring new connection
• [10604] [YCQL] Handle DeleteIndex while backfilling
• Update cassandra driver version to 3.10.3-yb-2 towards vulnerabilities fixes.

Bug Fixes

Yugabyte Platform

• [PLAT-1643] On-prem provider configuration, "Desired Home Directory" can't be equal to the first mount paths item
• [PLAT-1678] Multitable backup fails with NPE
• [PLAT-1702] [UI] Azure YW provider does not allow port customization
• [PLAT-1795] /home/yugabyte not getting cleared out with a custom home dir for onprem universe
• [PLAT-1891] [Backup] [IAM-Platform] Backup is hanging for universe with read replicas on IAM-enabled platform
• [PLAT-1948] [UI] Delete release should call delete API, not update release API
• [PLAT-2088] Some primary cluster fields not inherited properly into add read replica page
• [PLAT-2098] fix: Certificate details page shows 'invalid date' for certificate start and expiration fields on Safari Browser only
• [PLAT-2099] Remove taskUUID from audit entry while aborting backup
• [PLAT-2101] fix: Save button doesn't throw field errors when all the fields are empty
• [PLAT-2102] Stop creation of KMS configs with duplicate name
• [PLAT-2103] [UI] [Encr at rest] AWS credentials enabled when IAM is checked in
• [PLAT-2109] Skip hostname validation in certificate
• [PLAT-2121] [UI] [KMS] UI displaying Successfully added even when it fails to add KMS config
• [PLAT-2133] Need to allow platform to repair a server that's stuck in a OOM state
• [PLAT-2148] Unable to change availability zone while configuring new universe
• [PLAT-2158] Getting rid of useHostnames
• [PLAT-2177] Avoid adding duplicate delete backup tasks to tasks queue
• [PLAT-2184] Fix a bug where new leader thinks of itself as remote instance
• [PLAT-2189] Fix universe creation on airgap install
• [PLAT-2214] fix: Cloud provider section overlapping with universe details
• [PLAT-2218] Removing and adding a single AZ to univ placement triggers a full move
• [PLAT-2241] Replace non-unicode symbols on traceback output decode
• [PLAT-2243] Fix chrony for airgap install (aws, gcp)
• [PLAT-2246] Fix Timezone UI Bugs
• [PLAT-2250] [Alerts] [UI] Alert Creation page is in loading state in brand new portal
• [PLAT-2251] Make health check run and store results to DB without health config
• [PLAT-2253] Skip delete release from local filesystem step in case of non-local release
• [PLAT-2257] Provision in AnsibleSetupServer cannot be retried if it fails in the middle because the default SSH port is no longer reachable.
• [PLAT-2259] [xcluster] [UI] Master Node Address unavailable on replication tab
• [PLAT-2265] Resolve missing list key and clean up YBMultiSelect styling.
• [PLAT-2269] Hide quick filter
• [PLAT-2270] Non-transactional backup with list of tables in YCQL fails
• [PLAT-2274] [UI] No way to remove region from provider
• [PLAT-2294] [UI] Disable toggle TLS / cert rotation dialogs in UI for k8s universes
• [PLAT-2298] Allow outOfOrder migrations and ignoreMissingMigrations
• [PLAT-2319] Remove sensitive data from platform log while during universe creation using s3 package
• [PLAT-2320] Fix Prometheus links to have correct timestamp
• [PLAT-2321] [PLAT-2314] Fix backup util behavior on error for onprem providers
• [PLAT-2323] Preparation subtask with error message should be added only if no other subtasks exist
• [PLAT-2325] Fix broken migration in older releases
• [PLAT-2326] Incorrect masters selection for GP universe
• [PLAT-2328] Reuse instance in cloud provider if it matches the universe ID and node ID tags.
• [PLAT-2344] Fix preflight checks
• [PLAT-2349] [UI] Blank screen when trying to add read replica to an universe
• [PLAT-2351] Disable upgrade to systemd for manually provisioned universes
• [PLAT-2373] Get rid of repeated migrations
• [PLAT-2376] Fixing resize node to utilize ssh_user param
• [PLAT-2400] Universe scaling out by adding nodes keeps new nodes in blacklisted state.
• [PLAT-2434] Fix omitted log configurations after application start
• [PLAT-2514] Fix leaderless and underreplicated tablet alerts in case master quorum is missing
• [PLAT-2348] Fix UT failure during change in max size of config name
• [T9574] [T8510] Force delete backup Configuration after deleting backups and schedule associated with it

Database

• [8660] [DocDB] Tablet splitting thresholds should be determined based on number of nodes in a table's placement policy
• [9665] [YSQL] ysql_dump should not need master addresses to be passed explicitly.
• [9929] [2809] [2742] [YSQL] Fix explicit row locking semantics + support SKIP LOCKED for REPEATABLE READ isolation level
• [10163] [DST] Disable large transaction batch apply until it does not affect tablet splitting
• [10193] [YSQL] Disallow deleting tablespace used by tablegroups
• [10236] [YSQL] Properly assign junk_filter_needed value based on type of Relation
• [10256] [DST] [PITR] Fix Incorrect Restore logic for System Catalog tables
• [10262] [DocDB] Tablespace task in the YB-Master must first check whether ysql is enabled
• [10303] [YSQL] fix unexpected transaction state error
• [10472] Use curl instead of wget for client download script
• [10519] Refresh master leader after election
• [10519] Reset master leader on meta cache timeouts
• [10521] [YSQL] Always republish migrations
• [10591] [YSQL] COPY for partitioned table writes to parent instead of child nodes
• [10622] [DocDB] Fix ASAN build
• [10629] [YSQL] Ensure follower reads go to the follower for reads from the index
• [10631] [YSQL] Hide index backfill auth key in logs
• [10646] [YSQL] fix client backfill timeout
• [10737] [backup] [YSQL] yb_backup must use '--masters' argument for ysql_dump.
• [10741] [YSQL] change ybgin substitution msg to LOG
• [10769] [Geo] Fixed data race when updating transaction status hash
• [10185] Check for schema column id mismatch in SetupUniverseReplication

Known Issues

Yugabyte Platform

• [PLAT-2487] When you add read replicas, the instance type and volume may not show any values. Re-select the provider and the values should populate correctly as primary cluster.

• [PLAT-2490] You may see a "Warning: cronjobs are not active on some nodes" message on the Universe health check page, even when cron jobs are active on the database nodes. To remove the warning:

  • For Replicated- and Yugabundle-based Platform installs, launch the devops/bin/edit_universe_details.py script and globally replace the value of cronsActive field from true to false. The number of cronsActive entries corresponds to the number of database nodes in your universe — you need to replace all of them.

  • For Kubernetes-based Platform installs, please contact Yugabyte support for help as this requires modifying the values in the database directly.

Database

N/A

v2.11.0.0 - November 22, 2021

Build: 2.11.0.0-b7

Downloads

Docker

docker pull yugabytedb/yugabyte:2.11.0.0-b7

New Features

For all 2.11 new features, please refer to this release announcement blog post

Yugabyte Platform

• [CLOUDGA-2875] Add additional permissions to yb_superuser
• [CLOUDGA-3033] Grant additional roles to yb_superuser
• [PLAT-26] [9612] Add logs purge threshold option to zip_purge_yb_logs.sh
• [PLAT-580] Add new xCluster create/get/edit/delete APIs and data model
• [PLAT-1669] initial OEL 8 support
• [PLAT-1748] Create POST and GET endpoint to generate support bundle and download support bundle v1
• [PLAT-1817] Add support for new certificate creation when rotating certs
• [PLAT-1856] Support pause/resume for GCP
• [PLAT-1870] Add a table view to universe page
• [PLAT-1941] Add status quick filter and table actions
• [PLAT-2071] Implement read-only user functionality for Alert UIs
• [PLAT-2104] Enable/disable Auth in k8s

Database

• [1127] [YSQL] Collation support
• [2272] [YSQL] Migration framework for YSQL cluster upgrade
• [7850] [YSQL] Implement GIN (YBGIN) indexes
• [8242] Enable automatic tablet splitting by default
• [8422] [YSQL] pg_stat_monitor extension
• [9370] Set enable_stream_compression flag to true by default
• [9595] [YSQL] Support YBGIN index in pg_trgm extension
• [10019] [DocDB] Add support for ZLib compression
• [10094] [DocDB] added data_block_key_value_encoding_format option
• [10094] [DocDB] Implemented advanced delta encoding/decoding optimized for DocDB-specific RocksDB keys
• [10141] [DocDB] Remove feature gate on savepoints
• [10150] [YSQL] Add functionality for the yb_extension role
• [10157] [Geo] Added command to create new transaction status tables
• [10204] [YSQL] Add functionality for the yb_fdw role
• [10473] Implement YSQL Follower reads

Improvements

Yugabyte Platform

• [PLAT-1506] Enhancement: Support to create/mark Alert Definition Group in Active or Inactive state from UI
• [PLAT-1513] Enhance metrics that use sum without to also exclude namespace_name (#9759)
• [PLAT-1580] Implement OOM killer alert
• [PLAT-1585] k8s example for create universe
• [PLAT-1704] Make Platform health checks more scalable
• [PLAT-1731] Add more logging for Platform HA feature
• [PLAT-1740] Make backup utility python3-compatible for different OS.
• [PLAT-1753] Enable taking backups using custom ports
• [PLAT-1760] Add readable type names
• [Plat-1777] Add basic filtering and sorting
• [Plat-1797] Create a pagination component
• [PLAT-1808] [Alert UI] cleanup tasks
• [PLAT-1867] AWS Provider and Universe examples
• [PLAT-1916] Moved default access token key to configuration
• [PLAT-1934] Adding UI to set KUBE_DOMAIN
• [PLAT-1953] Improve performance of /logs endpoint
• [PLAT-1956] Expose preflight check as a standalone action
• [PLAT-1962] Add optional AWS KMS Endpoint field while creating KMS configuration.
• [PLAT-1967] API Add support for k8s provider creation
• [PLAT-1989] Show alert configuration target in page view
• [PLAT-2032] Append number to self-signed certificate labels when rotating certs
• [PLAT-2033] [Alert] [UI] Move seconds in Duration under conditions similar to Threshold in Alert Definition Page
• [PLAT-2034] Specific task type name for TLS toggle
• [PLAT-2093] Replace pause icon with resume icon for resume universe

Database

• [1127] [YSQL] Improve collation upgrade performance.
• [3745] [DocDB] Added flag for making log cache memory percent-based.
• [5310] [YSQL] Cherry-pick upstream PostgreSQL commit that performs refactor of ExecUpdate() function.
• [5310] [YSQL] Support row-level partition UPDATE across partitions
• [7293] [YSQL] Import Fix tablespace handling for partitioned tables
• [8242] [DocDB] Update defaults for automatic tablet splitting
• [8862] [DocDB] Enable CHANGE_CONFIG_OP to be added to raft log for split tablet
• [9178] [YSQL] Support a way to read from local partitions first
• [9467] [YSQL] Increase scope of cases where transparent retries are performed
• [9468] [YSQL] [Part-1] READ COMMITTED isolation level
• [9512] Add optional bootstrap IDs parameter to AlterUniverseReplication add_tables
• [9606] [DocDB] Add flag --force for command delete_tablet to set state TABLET_DATA_DELETED for tool yb-ts-cli
• [9969] [DocDB] Add a gflag for RocksDB block_restart_interval
• [10038] [YQL] Support for displaying the bind values for a prepared statement(s).
• [10110] [DocDB] Enables compaction file filter during manual compactions
• [10136] [YSQL] Import Reject SELECT ... GROUP BY GROUPING SETS (()) FOR UPDATE.
• [10151] [YSQL] Import Avoid fetching from an already-terminated plan.
• [10199] [YSQL] Import Reset memory context once per tuple in validateForeignKeyConstraint.
• [10208] [YSQL] Adding negative caching for types and metrics collection for catalog cache misses
• [10211] [xCluster] Allow for overriding the default CDCConsumerHandler thread pool size
• [10266] [YSQL] Import In security-restricted operations, block enqueue of at-commit user code.
• [10317] [YSQL] Import Allow users with BYPASSRLS to alter their own passwords.
• [10335] [YSQL] Import Avoid lockup of a parallel worker when reporting a long error message.
• [10343] [DocDB] Adds a GFlag to ignore value-level TTL during SST file expiration
• [10359] [YCQL] [YSQL] Update dependencies for Java subprojects
• [10377] [DocDB] Add multi drives to TS servers on ExternalMiniCluster
• [10381] [DocDB] enhance debug logs for RWCLock
• [10382] [YSQL] Import Make pg_dump acquire lock on partitioned tables that are to be dumped.
• [10385] [YSQL] Import Add strict_multi_assignment and too_many_rows plpgsql checks
• [10386] [YSQL] Import Fix some errhint and errdetail strings missing a period
• [10406] [YSQL] Create callback for index write
• [10427] [DocDB] Added transaction_table_num_tablets_per_tserver flag
• [10487] [10489] [YSQL] Import Prevent drop of tablespaces used by partitioned relations
• [YSQL] Import Fix cloning of row triggers to sub-partitions

Bug Fixes

Yugabyte Platform

• [CLOUDGA-2800] Fix possible customer removal issue related to persisted metrics
• [PLAT-364] [9391] Incorrect masters selection leads to universe creation failures
• [PLAT-490] Display timezone with timestamp
• [PLAT-1504] Delete release from yugaware_property table and local filesystem.
• [PLAT-1511] Fix legend overflowing in metrics tab
• [PLAT-1607] Upgrade systemd API fix
• [PLAT-1618] Make TLS Enable/Disable UI to display as default instead of under feature flag
• [PLAT-1634] Backup page is not loading because of empty configuration column
• [PLAT-1716] Import releases modal on releases page doesn't work
• [PLAT-1751] [UI] DB Version field setting getting reset to first item in the dropdown on toggling between the Read Replica and Primary cluster tabs
• [PLAT-1752] Potential resource leak in thread pool for subtasks
• [PLAT-1789] [PLAT-1727] Addition/Removal of default platform gflags does not retain the universe's initial preferences.
• [PLAT-1803] Not able to change cert for client to node in TLS enable feature
• [PLAT-1806] Resolve issue in TlsToggle where certs_for_client_dir is set as empty
• [PLAT-1819] [PLAT-1828] Release backup lock when Platform restarts, and update Backup state
• [PLAT-1824] Improve backup retention in case of backup failure
• [PLAT-1829] [ycql/ysql auth password] Wrong error message
• [PLAT-1831] Fix DB version dropdown from being reset when switching between primary and async cluster forms
• [PLAT-1831] Fix when navigating from home page to Create Universe
• [PLAT-1836] Clean up needless releases data from YB nodes
• [PLAT-1837] Change Replication factor field to be editable for async universe form.
• [PLAT-1840] Fix 30 sec customer_controller list API
• [PLAT-1842] Fix long universe list query
• [PLAT-1845] GET /api/v1/customers/cUUID/universes/uniUUID/leader takes 9 seconds on dev portal
• [PLAT-1853] Frequent error log related to health checks on portal.k8s
• [PLAT-1855] Edit Universe example and missing implicit parameters
• [PLAT-1862] Backup Frequency cannot be negative number
• [PLAT-1886] Set locale on GCP Ubuntu universes.
• [PLAT-1887] Fix creation of read-only on-prem universe + code cleanup
• [PLAT-1892] Remove default template for error log + remove error logs from health check report
• [PLAT-1895] Fix backup failure alert in case restore fails
• [PLAT-1897] Make client_max_body_size configurable in replicated
• [PLAT-1897] Take-2. Make client_max_body_size configurable in replicated
• [PLAT-1907] Mismatching address should not cause standby to overwrite local instance
• [PLAT-1907] Missed a rename of assertYWSE to assertPlatformException
• [PLAT-1921] [Backup] [UI] Disappearance of Encrypt backup toggle in 2.9.1 and 2.9.2 portals
• [PLAT-1923] [PLAT-1924] Ability to create universes with AZs count > RF + definition of default region
• [PLAT-1942] Backup/restore failing on KMS enabled universes
• [PLAT-1952] Correctly mark status of root and client root during add operation
• [PLAT-1953] Add /logs sh script to release package
• [PLAT-1969] [UI] Universe creation - Create button is disabled when YSQL/YCQL auth is disabled
• [PLAT-1972] Check certificates existence
• [PLAT-1976] Fix EditUniverse for on-prem
• [PLAT-1987] Only adding gcp_internal flag for GCP provider
• [PLAT-1990] Ensure universe size doesn't change dramatically during a full move
• [PLAT-1998] Fix NPE in SystemdUpgrade task for TLS enabled universes
• [PLAT-1999] Update cert directories gflags during cert rotation
• [PLAT-2002] Fixing zip_purgs_yb_logs to not error without threshold flag
• [PLAT-2015] Remove Sort functionality from "Target universe" in alert listing
• [PLAT-2018] Fix instance restart alert during universe operation
• [PLAT-2019] Fix permission denied issues during find command
• [PLAT-2030] [UI] [Platform]UI should display the name of the newly created cert instead of "Create new cert" option
• [PLAT-2034] Fix migration version
• [PLAT-2045] Minor fix to release name regex
• [PLAT-2046] Yb-client: Possible race condition while getting Master-Leader
• [PLAT-2049] Fix metric storage + fix health check for development and ARM builds
• [PLAT-2053] Fix the wrong error message in TLS configuration modal
• [PLAT-2068] [UI] Screen going blank when removed regions in Edit Universe
• [PLAT-2069] Hiding systemd upgrade option for read-only users
• [PLAT-2073] [UI] Enable Systemd Services toggle shows wrong status
• [PLAT-2074] Alert configuration active status in page view + activate/deactivate from actions + sorting fixes
• [PLAT-2081] Show Error message when trying to create existing user
• [PLAT-2092] Fix Task list default sorting by create time
• [PLAT-2094] Fix k8s universe certificate expiry checks
• [PLAT-2096] [UI] Restore backup UI refresh issue
• [PLAT-2097] Fix repeated migration V68 : approach 2
• [PLAT-2107] Resolve multiple UI fixes in Encryption-at-Rest modal
• [PLAT-2109] Skip hostname validation in certificate
• [PLAT-2110] Fix wrong default destination migration for multi-tenant platforms.
• [PLAT-2111] Systemd Upgrade failing with read replica
• [PLAT-2113] Fix HA failing with entity_too_large
• [PLAT-2124] [Alert] [UI] Select Alert Metrics doesn't load the template if the metrics is created twice
• [PLAT-2126] Fix stopping periodical tasks in case of failure
• [PLAT-2128] Fix alert message field to print the whole message + alert channel error message fix
• [PLAT-2129] [Alert] Full Alert message is not displayed in Alert listing page on selecting the alert
• [PLAT-2134] Fix beforeValidate migration for the case of empty database
• [PLAT-2138] Fix OOM Kill alert query in DB migration
• [PLAT-2157] Flyway plugin patch for ignoreMissingMigration and default java package issue
• [PLAT-2167] Fix 3000 seconds timeout for IAM profile retrieval operation
• [PLAT-2180] Missing error response logging when demoteInstance fails
• [PLAT-2189] Fix universe creation on airgap install
• [PLAT-2200] [UI] Fix regression with HA "standby" overlay

Database

• [2272] [YSQL] Fix OID generation for initdb migration
• [2397] [YSQL] Fix wrong results after modification statement failure in procedure block
• [2866] Add deadline to CdcProducer::GetChanges call
• [5536] [YSQL] fast-path not used when type conversion from timestamp with & without timezone happens
• [7092] [10046] [10222] [10224] [10230] [10251] [10295] Enable Clang 12 ASAN build on AlmaLinux 8 and fix relevant bugs
• [8148] [DocDB] Potential issue on crash after creating post-split tablets
• [8229] [Backup] repartition table if needed on YSQL restore
• [8718] [YSQL] Free Bitmapset used in match_index_to_operand()
• [9541] [YSQL] Restart metrics webserver when postmaster recovers
• [9645] [YSQL] Cleanup DDL transaction state in case of query failure
• [9898] [DocDB] Fix queries on system.partitions when unable to resolve some addresses
• [9936] [YBase] Don't parse RequestHeader protobuf
• [9936] Fix ysql_dump in encrypted k8s environment
• [9957] [YSQL] Fix memory usage when translating decimal data into Postgres's datum format.
• [10044] [DST] [PITR] Fix race in snapshot/schedule cleanup
• [10071] Fix Locking Issues with DeleteTableInMemory
• [10077] [DocDB] Compaction file filter factory uses HistoryRetention instead of Schema
• [10082] Clean up environment on SetupUniverseReplication failure
• [10116] [YSQL] Starting a new cluster with an old YSQL snapshot fails in debug build
• [10164] [DocDB] Max file size for compactions should only affect TTL tables
• [10166] Acquire lock in GetUniverseParamsWithVersion
• [10167] [DocDB] Save source tablet mutations to sys catalog when splitting
• [10207] [DocDB] Make read_buffer_memory_limit a percentage of process memory instead of total memory.
• [10218] CheckLocalHostInMasterAddresses should check all specified RPC addresses
• [10220] [DocDB] splitting: deprecate TabletForSplitPB.tablets_for_split
• [10225] [DST] Adhere to the definitions of partitions_ and tablets_ during DeleteTable
• [10240] Add IPv6 address filters to default value of net_address_filter
• [10254] [YSQL] Fix 100% CPU usage regression bug in SELECT with FOR KEY SHARE/IN/missing keys
• [10259] [YSQL] Allow setting tablegroups on tables using WITH
• [10304] [DocDB] fix deadlock in ProcessTabletReportBatch
• [10308] [YSQL] Prevent setting tablespaces for temp tables
• [10314] [YSQL] remove mention of HaveYouForgottenAboutMigration
• [10323] [YBase] Fix outbound call timeout handling
• [10364] [YCQL] Fix issue when dropping col that is not in an existing non-partial secondary index
• [10374] [YSQL] Cannot start a cluster with --ysql_pg_conf_csv='statement_timeout=1000'
• [10415] [Backup] Backup-restore failures for old backups.
• [10419] [YSQL] Shorten string to get rid of output truncation warning
• [10430] [YSQL] Limit to IPv4 for sys catalog initialization
• [10433] [YSQL] Load pg_depend and pg_shdepend on demand
• [10496] [YSQL] Adjust cost when enable_seqscan=off
• [adhoc] [DST] Reword loud log line in raft_consensus.cc to remove the word Failure

Known Issues

Yugabyte Platform

N/A

Database

N/A

v2.8.0.0 - November 8, 2021

Build: 2.8.0.0-b37

Downloads

Docker

docker pull yugabytedb/yugabyte:2.8.0.0-b37

New features

Please refer to our blog post for new features in this release - https://blog.yugabyte.com/announcing-yugabytedb-2-8/

Improvements

Yugabyte Platform

[#9131] [Platform] Enable/disable YCQL endpoint while universe creation and force password requirement
[#9580] [Platform] Add restore_time field for all universes.
[#9613] [Platform] Update UI to accommodate Authentication changes
[#9733] [Platform] [Alerts] Implement alert listing
[#9978] [Platform] [UI] Change stop backup icon and label to abort icon and label.
[PLAT-26] [#9612] Add logs purge threshold option to zip_purge_yb_logs.sh
[PLAT-59] [#5236] Allow log levels to be changed through POST /logging_config endpoint
[PLAT-386] [#9407] Implement base YSQL/YCQL alerts
[PLAT-417] Add support for Ubuntu 18.04 distributions
[PLAT-490] Display timezone with timestamp
[PLAT-523] [#7645] Show error summary at the top of the health check email
[PLAT-541] Allow configuring no destination for alert config + UI improvements
[PLAT-1530] Made assignStaticPublicIP optional parameter for create universe. Ran swaggerGen.
[PLAT-1556] List Storage Configs Create Scheduled backup examples
[PLAT-1573] Adding 'create new cert' in enable TLS new feature
[PLAT-1582] [Alert] Limit Severity to maximum 2(Severe/warn), now we can add multiple severity's but after edit we are displaying only 2 (1 Severe/1 Warn)
[PLAT-1585] k8s example for create universe
[PLAT-1620] Added secondary subnet for allowing two network interfaces
[PLAT-1647] Provide more details for default channel on UI
[PLAT-1664] Enable new alert UIs and remove deprecated alert UI + configs from Health tab + config from replication tab
[PLAT-1669] initial OEL 8 support
[PLAT-1691] Task, API and thread pool metrics
[PLAT-1704] Make Platform health checks more scalable
[PLAT-1704] WIP: Make Platform health checks more scalable
[PLAT-1705] Add auditing and transaction for /register API action
[PLAT-1731] Add more logging for Platform HA feature
[PLAT-1747] supporting n2 instance types for GCP internally
[PLAT-1774] Add a customer ID field in Customer Profile page
[Plat-1777] Add basic filtering and sorting
[PLAT-1793] DB Error logs alert
[Plat-1797] Create a pagination component
[PLAT-1808] [Alert UI] cleanup tasks
[PLAT-1817] Add support for new certificate creation when rotating certs
[PLAT-1818] Add pagination to Tables tab and add classNames
[PLAT-1824] Improve backup retention in case of backup failure
[PLAT-1855] Edit Universe example and missing implicit params
[PLAT-1867] AWS Provider and Universe examples
[PLAT-1934] Adding UI to set KUBE_DOMAIN
[PLAT-1943] Remove feature flagging for enable/disable TLS
[PLAT-1956] Expose on-prem node pre-flight checks as a standalone action
[PLAT-1962] Add optional AWS KMS Endpoint field while creating KMS config.
[PLAT-1989] Show alert configuration target in page view
[PLAT-2033] [Alert] [UI] Move seconds in Duration under conditions similar to Threshold in Alert Definition Page
[PLAT-2071] Implement read-only user functionality for Alert UIs
[PLAT-2104] Enable/disable Auth in k8s
[PLAT-2143] [UI] Add an optional field AWS KMS Endpoint while creating KMS config
[PLAT-2229] Retrieve YB version via ssh/kubectl during health check
[Platform] Return direct URL to Prometheus for metrics from metrics API call

Database

[#2220] [YSQL] Enabling relation size estimation for temporary tables in optimizer
[#2272] [YSQL] Migration framework for YSQL cluster upgrade
[#5492] yb-admin: Added error message when attempting to create snapshot of YCQL system tables
[#6541] [YSQL] Enable row-locking feature in CURSOR
[#7612] [DocDB] Allow TTL-expired SST files that are too large for compaction to be directly expired
[#7612] [DocDB] Modified compaction file filter to filter files out of order
[#7889] Reduce timeout for ysql backfill.
[#8162] YSQL Support single-request optimization for UPDATE with RETURNING clause
[#8229] [Backup] repartition table if needed on YSQL restore
[#8242] [DocDB] Update defaults for automatic tablet splitting
[#8402] [YSQL] change gin to ybgin for YB indexes
[#8452] Speed up restoring YSQL system catalog
[#8501] [DocDB] Add metric to monitor server uptime
[#8807] [YBase] Add HTTP URL param for limiting the number of tables whose metrics are displayed
[#8979] [DocDB] Improve master load balancer state presentation
[#9279] [YSQL] Enable -Wextra on pgwrapper
[#9279] [YSQL] Enable -Wextra on yql folder
[#9370] Set enable_stream_compression flag to true by default
[#9439] [YBase] Allow sst-dump to decode docdb keys and dump data in human readable format
[#9467] [YSQL] Increase scope of cases where transparent retries are performed
[#9512] Add optional bootstrap IDs parameter to AlterUniverseReplication add_tables
[#9606] [docdb] Add flag --force for command delete_tablet to set state TABLET_DATA_DELETED for tool yb-ts-cli
[#9969] [DocDB] Add a gflag for rocksdb block_restart_interval
[#10019] [DocDB] Add support for zlib compression
[#10064] [xCluster] Lag Metric Improvements
[#10094] [DocDB] added data_block_key_value_encoding_format option
[#10141] [DocDB] Remove feature gate on savepoints
[#10150] [YSQL] Add functionality for the yb_extension role
[#10240] Add IPv6 address filters to default value of net_address_filter
[#10430] [YSQL] Limit to IPv4 for sys catalog initialization
[YSQL] Foreign Data Wrapper Support
Added more information in logs for understanding concurrency control + downgraded two log lines to VLOG(4)
Added new AWS regions to metadata files

Bug fixes

Yugabyte Platform

[#1525] [Platform] New Universe creation gets public IP assigned even with flag = false
[#1598] [Platform] [UI] Suggested Default File Path for CA Signed Certificate and Private Key is Incorrect
[#7396] [Platform] Splitting up create/provision tasks to delete orphaned resources
[#7738] [PLAT-611] Health checks can overlap with universe update operations started after them
[#8510] [Platform] Allow the deletion of Failed Backups
[#9571] [Platform] Backup and Restore failing in k8s auth enabled environment
[#9743] [Platform] Fix universe reset config option (#9863)
[#9850] [YW] Correct the node path (#9864)
[CLOUDGA-1893] [Platform] fix client-to-node cert path in health checks
[PLAT-253] Fix the backupTable params while creating Table backups using APIs.
[PLAT-253] Fix universe's backupInprogress flag to avoid multiple backup at a time due to low frequency scheduler.
[PLAT-289] Stopped node should not allow Release action
[PLAT-368] [#9366] Disable Delete Configuration button for backups when in use.
[PLAT-482] [#7573] Health Checks should run when Backup/Restore Tasks are in progress
[PLAT-509] [#9014] Refresh Pricing data for Azure provider seems to be stuck
[PLAT-521] [#9315] BackupsController: small fixes required
[PLAT-525] Add IP address to SAN of node certificates
[PLAT-599] Fix error messages in alert destination and configuration services
[PLAT-1511] Fix legend overflowing in metrics tab
[PLAT-1520] Stop displaying external script schedule among Backup Schedules.
[PLAT-1522] Fix s3 release breakage
[PLAT-1523] Make Alert APIs to be consistent with UI terminology
[PLAT-1528] Change YWError handler to default to json response on client error.
[PLAT-1530] [#9794] Creates static IP during cluster creation for cloud free tier clusters. Releases IPs on deletion.
[PLAT-1549] [PLAT-1697] Fix Stop backup race condition. Add non-schedlued backup examples
[PLAT-1559] Stop the external script scheduler if the universe is not present.
[PLAT-1563] Fix instance down alerts + make sure instance restart alert is not fired on universe operations
[PLAT-1578] Do not specify storage class (use default if provided)
[PLAT-580] Fix DB migration ordering; use repeatable for backport
[PLAT-1586] [Alert] Able to add multiple alert configuration with same name. Add duplicate check for alert configuration name
[PLAT-1599] [UI] Root Certificate and node-node and client-node TLS missing on Edit Universe
[PLAT-1600] add conf entries for various ansible settings
[PLAT-1603] YBFormInput's OnBlur throws error on AddCertificateForm
[PLAT-1605] Fix duplicate alert definitions handling + all locks to avoid duplicates creation
[PLAT-1606] Disk name too long for Google Cloud clone disk
[PLAT-1607] Upgrade systemd API fix
[PLAT-1611] Add python depedencies required for executing external scripts
[PLAT-1613] [Alerts] Logs filled with NPE related to "Error while sending notification for alert "
[PLAT-1617] Added GCP region metadata for missing regions.
[PLAT-1617] Fix issue with GCP Subnet CIDR
[PLAT-1619] Check for FAILED status in wait_for_snapshot method.
[PLAT-1621] Health check failed in K8s portal
[PLAT-1625] Fix task details NPE
[PLAT-1626] Skip preprovision for systemd upgrade.
[PLAT-1631] [Alert] Universe filter is not working in Alert Listing
[PLAT-1634] Backup page is not loading because of empty config column
[PLAT-1638] Fix naming convention for external script endpoints as per our standards
[PLAT-1639] [PLAT-1681] Make proxy requests async to keep them from blocking other requests. Reduce log spew from akka-http-core for proxy requests.
[PLAT-1644] Fix k8s universe creation failure for Platform configured with HA
[PLAT-1646] Remove Unsupported Instance types from pull down menu for Azure
[PLAT-1650] Added yum lock_timeout to prevent yum lockfile errors for use_custom_ssh_port.yml
[PLAT-1653] Fix region get/list.
[PLAT-1656] [UI] [Alert] Group Type filter is not working in Alert Listing
[PLAT-1661] Fix alert messages for notification failures
[PLAT-1664] Clean unused code
[PLAT-1667] Platform should not scrape all per-table metrics from db hosts (part 2)
[PLAT-1668] Yugabundle failing because can't find YWErrorHandler
[PLAT-1682] Fix node comparison function from accessing undefined cluster
[PLAT-1687] [Alert] Not able to create destination channel using "default recipients + default smtp settings + empty email field"
[PLAT-1691] Set oshi LinuxFileSystem log level to ERROR
[PLAT-1694] Fix Intermittent failure to back up k8s universe
[PLAT-1707] Fix performance issue
[PLAT-1715] Check for YB version only for 2.6+ release DB
[PLAT-1717] Full move fails midway if system tablet takes more than 2 mins to bootstrap
[PLAT-1721] Stop storage type from automatically changing when instance type is changed
[PLAT-1723] Allow disabling prometheus management + write alerts and metrics effectively
[PLAT-1726] Allow user to completely remove all gFlags after addtion of several gFlags.
[PLAT-1730] Fix resize node logic for RF1 clusters
[PLAT-1736] Create default alert configs and destination on DB seed
[PLAT-1737] "This field is required" error message is shown on alert configuration creation with default threshold == 0
[PLAT-1740] [PLAT-1886] Make backup util python3 compatible for different OS.
[PLAT-1746] Delete prometheus_snapshot directory once Platform backup package is created
[PLAT-1751] [UI] DB Version field setting getting reset to first item in the dropdown on toggling between the Read Replica and Primary cluster tabs
[PLAT-1753] Enable taking backups using custom ports
[PLAT-1757] Health Check failure message has Actual and expected values interchanged
[PLAT-1760] Add readable type names
[PLAT-1761] Fix alert message in case of unprovisioned nodes
[PLAT-1768] Universe tasks take lot more time because thread pool executors do not reach max_threads
[PLAT-1780] Redact YSQL/YCQL passwords from task_info table.
[PLAT-1791] Use hibernate validator for all alert related entities
[PLAT-1796] Edit Universe page has password fields editable
[PLAT-1802] Replication graphs stopped showing on replication tab (replicated.yml change)
[PLAT-1803] Not able to change cert for client to node in tls enable feature
[PLAT-1804] Fix 'Querying for {} metric keys - may affect performance' log
[PLAT-1806] Resolve issue in TlsToggle where certs_for_client_dir is set as empty
[PLAT-1816] Forward port restricted user creation to master
[PLAT-1819] [PLAT-1828] Release backup lock when Platform restarts, and update Backup state
[PLAT-1831] Fix DB version dropdown from being reset when switching between primary and async cluster forms
[PLAT-1831] Fix when navigating from home page to Create Universe
[PLAT-1833] Fix missing create time on alert configuration creation issue
[PLAT-1837] Change Replication factor field to be editable for async universe form.
[PLAT-1840] Fix 30 sec customer_controller list API
[PLAT-1842] Fix long universe list query
[PLAT-1853] Frequent error log related to health checks on portal.k8s
[PLAT-1862] Backup Frequency cannot be negative number
[PLAT-1887] fix creation readonly onprem universe + code cleanup
[PLAT-1891] [Backup] [IAM-Platform] Backup is hanging for universe with read replicas on IAM-enabled platform
[PLAT-1892] Remove default template for error log + remove error logs from health check report
[PLAT-1895] Fix backup failure alert in case restore fails
[PLAT-1897] [PLAT-1995] Make client_max_body_size configurable in replicated
[PLAT-1897] Make client_max_body_size configurable in replicated
[PLAT-1897] Take-2. Make client_max_body_size configurable in replicated
[PLAT-1921] [Backup] [UI] Disappearance of Encrypt backup toggle
[PLAT-1942] Backup/restore failing on KMS enabled universes
[PLAT-1969] [UI] Universe creation - Create button is disabled when YSQL/YCQL auth is disabled
[PLAT-1976] Fix EditUniverse for on-prem
[PLAT-1998] Fix NPE in SystemdUpgrade task for TLS enabled universes
[PLAT-2002] Fixing zip_purgs_yb_logs to not error without threshold flag
[PLAT-2012] Update cert directories gflags during cert rotation
[PLAT-2015] Remove Sort functionality from "Target universe" in alert listing.
[PLAT-2019] Fix permission denied issues during find command
[PLAT-2030] [UI] UI should display the name of the newly created cert instead of "Create new cert" option
[PLAT-2032] Append number to self-signed certificate labels when rotating certs
[PLAT-2034] Specific task type name for tls toggle
[PLAT-2053] Fix the wrong error message in TLS configuration modal
[PLAT-2068] [UI] Screen going blank when removed regions in Edit Universe
[PLAT-2069] Hiding systemd upgrade option for ReadOnly users
[PLAT-2073] [UI] Enable Systemd Services toggle shows wrong status
[PLAT-2081] Show Error message when trying to create existing user
[PLAT-2092] Fix Task list default sorting by create time
[PLAT-2094] Fix k8s universe certificate expiry checks
[PLAT-2096] [UI] Restore backup UI refresh issue
[PLAT-2097] Fix repeated migration V68 : approach 2
[PLAT-2098] Certificate details page shows 'invalid date' for certificate start and expiration fields on Safari Browser only.
[PLAT-2107] Resolve multiple UI fixes in Encryption-at-Rest modal
[PLAT-2109] Skip hostname validation in certificate
[PLAT-2110] Fix wrong default destination migration for multitenant Platforms.
[PLAT-2111] Systemd upgrade failing with read replica
[PLAT-2113] [PLAT-2117] Fix HA failing with entity_too_large
[PLAT-2124] [Alert] [UI] Select Alert Metrics doesn't load the template if the metrics is created twice
[PLAT-2126] Fix stopping periodical tasks in case of failure
[PLAT-2128] Fix alert message field to print the whole message + alert channel error message fix
[PLAT-2129] [Alert] Full Alert message is not displayed in Alert listing page on selecting the alert
[PLAT-2134] Fix beforeValidate migration for the case of empty database
[PLAT-2157] Flyway plugin patch for ignoreMissingMigration and default java package issue
[PLAT-2167] Fix 3000 seconds timeout for IAM profile retrieval operation
[PLAT-2180] [PLAT-2182] Missing error response logging when demoteInstance fails
[PLAT-2189] Fix universe creation on airgap install
[PLAT-2200] [UI] Fix regression with HA "standby" overlay
[PLAT-2263] application.log not updating
[Platform] Fix NPE in VM image upgrade for TLS enabled universes
[Platform] Hooking GCP Create Method into Create Root Volumes method

Database

[#2272] [YSQL] Fix OID generation for initdb migration
[#4421] [YCQL] Disallow Unauthenticated LDAP binding + add handling for ycql_ldap_search_filter
[#5920] Fix bootstrapping with preallocated log segment
[#7528] [YSQL] Error out when Tablespaces are set for colocated tables
[#8043] [YBase] Remove information about LB skipping deleted tables from the admin UI
[#8580] [#9489] [YSQL] Inherit default PGSQL proxy bind address from rpc bind address
[#8675] [DocDB] Prevent tablet splitting when there is post split data
[#8772] Fix fatal that occurs when running alter_universe_replication and producer master has
[#8804] [YSQL] [backup] Support in backups the same table name across different schemas.
[#8807] [YBase] Rename the flag controlling maxmimum number of tables to retrieve metrics for
[#9061] [docdb] Master task tracking should point to the table it is operating on
[#9436] [YSQL] Statement reads rows it has inserted
[#9475] Fetch Universe Key From Masters on TS Init
[#9541] [YSQL] Restart metrics webserver when postmaster recovers
[#9616] Fix master crash when restoring snapshot schedule with deleted namespace
[#9655] [xCluster] Label cdc streams with relevant metadata
[#9668] Alert configurations implement missing parts and few small changes
[#9685] [xCluster] Make delete_universe_replication fault tolerant
[#9746] Set WAL footer close_timestamp_micros on Bootstrap
[#9749] [DocDB] Log::CopyTo - fixed handling kLogInitialized state
[#9762] [Part-1] Populate partial index predicate in "options" column of system_schema.indexes
[#9781] Mark snapshot as deleted if tablet was removed
[#9782] docdb Tablet Splitting - Wait for all peers to finish compacting during throttling
[#9786] Universe Actions-> Add Read Replica is failing on 2.6.1.0-b23
[#9789] [docdb] Load Balancer should use tablet count while looking tablets to move
[#9802] [xCluster] Set proper deadline for YBSession in CDCServiceImpl
[#9803] [YSQL] Import Avoid trying to lock OLD/NEW in a rule with FOR UPDATE.
[#9806] [DocDB] fixed Batcher::FlushBuffersIsReady
[#9812] [YSQL] Check database is colocated before adding colocated option for Alter Table
[#9822] [DocDB] Check table pointer is not nullptr before dereferencing
[#9831] [YSQL] Import Fix broken snapshot handling in parallel workers.
[#9855] [DocDB] Set aborted subtransaction data on local apply
[#9860] [YSQL] fix limit vars to uint64
[#9862] Allow PITR in conjunction with tablet split
[#9862] PITR: Allow consecutive restore
[#9865] Fix internal retry of kReadRestart for SELECT func() with a DML in the func
[#9867] [YSQL] Fix double type overflow in case of SET yb_transaction_priority_lower_bound/yb_transaction_priority_upperr_bound command
[#9878] [YBase] Reduce regex expression evaluation in nested loop
[#9892] Mask sensitive gflag info
[#9898] [DocDB] Fix queries on system.partitions when unable to resolve some addresses
[#9899] [YSQL] Import Fix corner-case uninitialized-variable issues in plpgsql.
[#9906] [YSQL] Fix not being able to add a range primary key
[#9909] [YSQL] further fix backup restore for NULL col attr
[#9911] [YSQL] Import In pg_dump, avoid doing per-table queries for RLS policies.
[#9922] [YSQL] Import Fix float4/float8 hash functions to produce uniform results for NaNs.
[#9924] [YSQL] always check schema name on backup import
[#9926] [YSQL] Import Disallow creating an ICU collation if the DB encoding won't support it.
[#9927] YCQL - Handle unset correctly
[#9932] [YSQL] Initialize t_ybctid field in acquire_sample_rows()
[#9933] [Part-0] Update logic for using num_tablets from internal or user requests.
[#9933] [YCQL] [Part-1] DESC TABLE does not directly match the "CREATE TABLE" command for number of tablets.
[#9934] [docdb] Don't update rocksdb_dir on Remote Bootstrap
[#9935] [YSQL] Import Fix bitmap AND/OR scans on the inside of a nestloop partition-wise join.
[#9936] Alter and Create table via PgClient
[#9936] Fix ysql_dump in encrypted k8s environment
[#9936] Fix ysql_dump in TLS encrypted environment
[#9936] Generate session ID in tserver
[#9936] Remove all direct YBClient usage from PgSession
[#9940] [DocDB] use correct kv_store_id for post-split tablets
[#9947] [YSQL] remove runtime tag for ysql_disable_index_backfill
[#9957] [YSQL] Fix memory usage when translating decimal data into Postgres's datum format.
[#9963] [Backup] fix to reallow YEDIS on restore
[#9965] [YSQL] Fix copy/paste error causing incorrect conversion
[#9966] [YSQL] Import Rearrange pgstat_bestart() to avoid failures within its critical section.
[#9969] [DocDB] Couple of minor fixes
[#9981] Fix transaction coordinator returning wrong status hybrid time
[#9994] [YSQL] copy t_ybctid field in modify tuple functions
[#9995] [YSQL] Import Fix EXIT out of outermost block in plpgsql.
[#10025] [YSQL] Import jit: Do not try to shut down LLVM state in case of LLVM triggered errors.
[#10034] [YSQL] Preserve operation buffering state in case of transparent retries
[#10038] [YQL] Support for displaying the bind values for a prepared statement(s).
[#10042] [Backup] allow system table for YEDIS restore
[#10044] [DST] PITR - Fix race in snapshot/schedule cleanup
[#10051] [DocDB] use RETURN_NOT_OK on an unchecked status
[#10071] Fix Locking Issues with DeleteTableInMemory
[#10072] [YSQL] Check the return status of certain YB functions
[#10077] [DocDB] Compaction file filter factory uses HistoryRetention instead of Schema
[#10082] Clean up environment on SetupUniverseReplication failure
[#10085] YSQL fix FATAL caused by wrong sum pushdown
[#10098] [YSQL] Fix index creation on temp table via ALTER TABLE
[#10110] [DocDB] Enables compaction file filter during manual compactions
[#10111] [YSQL] Import Force NO SCROLL for plpgsql's implicit cursors.
[#10120] [DocDB] added safe version of FastDecodeSignedVarInt
[#10121] [YSQL] Import Avoid misbehavior when persisting a non-stable cursor.
[#10139] [YBase] Avoid unnecessary table locking in CatalogManager::DeleteYsqlDBTables
[#10164] [DocDB] Max file size for compactions should only affect TTL tables
[#10166] Acquire lock in GetUniverseParamsWithVersion
[#10167] [DocDB] Save source tablet mutations to sys catalog when splitting
[#10199] [YSQL] Import Reset memory context once per tuple in validateForeignKeyConstraint.
[#10211] [xCluster] Allow for overriding the default CDCConsumerHandler threadpool size
[#10218] CheckLocalHostInMasterAddresses should check all specified RPC addresses
[#10254] [YSQL] Fix 100% CPU usage regression bug in SELECT with FOR KEY SHARE/IN/missing keys
[#10304] [DocDB] fix deadlock in ProcessTabletReportBatch
[#10317] [YSQL] Import Allow users with BYPASSRLS to alter their own passwords.
[#10364] [YCQL] Fix issue when dropping col that is not in an existing non-partial secondary index
[#10374] [YSQL] Cannot start a cluster with --ysql_pg_conf_csv='statement_timeout=1000'
[#10415] [backup] Backup-restore failures for old backups.
[#10519] Reset master leader on meta cache timeouts, refresh master leader after election.
[adhoc] [DocDB] Remove GetTabletPeers method with return argument
[adhoc] [DST] Reword loud log line in raft_consensus.cc to remove the word Failure
[xCluster] [#9418] Add cdc_state Schema Caching to Producer Cluster
[YBase] Properly pass number of tables via MetricPrometheusOptions
[YSQL] [#9572] Correctly determine is_yb_relation for row-marked relations when preparing target list
[YSQL] Change file and function names to match Yugabyte convention in catalog and access directories
[YSQL] Import Fix performance bug in regexp's citerdissect/creviterdissect.
Add S3 Bucket Host Base as endpoint in case of S3 compatible storage
Fixed bug in yb-ctl for stopping processes, when os.kill raises an exception
Increase column length for availability zone subnets

Known issues

Yugabyte Platform

N/A

Database

N/A

Note: To upgrade a pre-version 2.9.0.0 Yugabyte Platform or universe instance deployed on Kubernetes that did not specify a storage class override, you need to override the storage class Helm chart value (which is now "", the empty string) and set it to the previous value, "standard".

For Yugabyte Platform, the class is yugaware.storageClass. For YugabyteDB, the classes are storage.master.storageClass and storage.tserver.storageClass.

v2.9.1.0 - Oct 29, 2021

Build: 2.9.1.0-b140

Downloads

Docker

docker pull yugabytedb/yugabyte:2.9.1.0-b140

New Features

Yugabyte Platform

• [9124] Create REST endpoints to manage async replication relationships
• [9733] [Alerts] Implement alert listing
• [PLAT-417] Add support for Ubuntu 18.04 distributions
• [PLAT-1573] Adding 'create new cert' in enable TLS new feature
• [PLAT-1620] Added secondary subnet for allowing two network interfaces
• [PLAT-1669] Initial OEL 8 support
• [PLAT-1695] Create new API endpoint to be able to query logs by Universe
• [PLAT-1753] Enable taking backups using custom ports

Database

• [1127] [YSQL] Collation Support (part 2)
• [1127] [YSQL] Collation Support (part 3)
• [6541] [YSQL] Enable row-locking feature in CURSOR
• [7850] [YSQL] create new access method ybgin
• [8402] [YSQL] change gin to ybgin for YB indexes
• [YSQL] Foreign Data Wrapper Support

Improvements

Yugabyte Platform

• [5236] [PLAT-59] Allow log levels to be changed through POST /logging_config endpoint
• [7396] Splitting up create/provision tasks to delete orphaned resources
• [7645] [PLAT-523] Show error summary at the top of the health check email
• [9131] Enable/disable YCQL endpoint while universe creation and force password requirement
• [9407] [PLAT-386] Implement base YSQL/YCQL alerts
• [9580] Add restore_time field for all universes.
• [9613] Update UI to accommodate Authentication changes
• [9668] Alert configurations implement missing parts and few small changes
• [9794] [PLAT-1530] Creates static IP during cluster creation for cloud free tier clusters. Releases IPs on deletion.
• [9892] Mask sensitive gflag info
• [9978] Platform UI: Change stop backup icon and label to abort icon and label.
• [CLOUDGA-2345] Implement MDC propagation and add request/universe ID to MDC
• [PLAT-525] Add IP address to SAN of node certificates
• [PLAT-541] Allow configuring no destination for alert config + UI improvements
• [PLAT-1523] Update Alert APIs to be consistent with UI terminology
• [PLAT-1528] Change YWError handler to default to JSON response on client error.
• [PLAT-1546] [PLAT-1547] [PLAT-1571] [PLAT-1572] Add API docs for UniverseClustersController, and other misc fixes
• [PLAT-1549] Add (non-generated client, "simple") Python API examples
• [PLAT-1549] Cleanup list/create provider API usage examples
• [PLAT-1555] Add Python API client example for create Universe
• [PLAT-1555] Add Python API client example for list Universe
• [PLAT-1556] List Storage Configs Create Scheduled backup examples
• [PLAT-1582] [Alert] Limit Severity to maximum 2(Severe/warn), now we can add multiple severity's but after edit we are displaying only 2 (1 Severe/1 Warn)
• [PLAT-1611] Add python depedencies required for executing external scripts
• [PLAT-1647] Provide more details for default channel on UI
• [PLAT-1664] Enable new alert UIs and remove deprecated alert UI + configs from Health tab + config from replication tab
• [PLAT-1691] Set oshi LinuxFileSystem log level to ERROR
• [PLAT-1691] Task, API and thread pool metrics
• [PLAT-1705] Add auditing and transaction for /register API action
• [PLAT-1723] Allow disabling prometheus management + write alerts and metrics effectively
• [PLAT-1766] [Alerts] UI: Cleanup
• [PLAT-1774] Add a customer ID field in Customer Profile page
• [PLAT-1791] Use hibernate validator for all alert related entities
• [PLAT-1818] Add pagination to Tables tab and add classNames
• Added new AWS regions to metadata files.
• Hooking GCP Create Method into Create Root Volumes method

Database

• [2220] [YSQL] Enabling relation size estimation for temporary tables in optimizer
• [5492] yb-admin: Added error message when attempting to create snapshot of YCQL system tables
• [7612] [DocDB] Allow TTL-expired SST files that are too large for compaction to be directly expired
• [7612] [DocDB] Modified compaction file filter to filter files out of order
• [7889] Reduce timeout for ysql backfill.
• [8043] [YBase] Remove information about LB skipping deleted tables from the admin UI
• [8162] [YSQL] Support single-request optimization for UPDATE with RETURNING clause
• [8229] [backup] repartition table if needed on YSQL restore
• [8452] Speed up restoring YSQL system catalog
• [8501] [DocDB] Add metric to monitor server uptime
• [8508] [DocDB] moved GetSplitKey from TabletServerAdminService into TabletServerService
• [8580] [9489] [YSQL] Inherit default PGSQL proxy bind address from rpc bind address
• [8804] [YSQL] [backup] Support in backups the same table name across different schemas.
• [8807] [YBase] Add a limit on number of metrics for the prometheus metrics endpoint
• [8979] [DocDB] Improve master load balancer state presentation
• [9279] [YSQL] Enable -Wextra on pgwrapper
• [9279] [YSQL] Enable -Wextra on yql folder
• [9418] [xCluster] Add cdc_state Schema Caching to Producer Cluster
• [9439] [YBase] Allow sst-dump to decode DocDB keys and dump data in human readable format
• [9467] [YSQL] Increase scope of cases where transparent retries are performed
• [9685] [xCluster] Make delete_universe_replication fault tolerant
• [9739] Added placement info to /api/v1/tablet-servers
• [9746] Set WAL footer close_timestamp_micros on Bootstrap
• [9762] [Part-1] Populate partial index predicate in "options" column of system_schema.indexes
• [9803] [YSQL] Import Avoid trying to lock OLD/NEW in a rule with FOR UPDATE.
• [9831] [YSQL] Import Fix broken snapshot handling in parallel workers.
• [9862] [PITR] Allow consecutive restore
• [9862] Allow PITR in conjunction with tablet split
• [9899] [YSQL] Import Fix corner-case uninitialized-variable issues in plpgsql.
• [9911] [YSQL] Import In pg_dump, avoid doing per-table queries for RLS policies.
• [9922] [YSQL] Import Fix float4/float8 hash functions to produce uniform results for NaNs.
• [9926] [YSQL] Import Disallow creating an ICU collation if the DB encoding won't support it.
• [9935] [YSQL] Import Fix bitmap AND/OR scans on the inside of a nestloop partition-wise join.
• [9936] Remove YBClient from Postgres: Introduce PgClient and implement ReserveOids using it; Open table via PgClient; Remove all direct YBClient usage from PgSession
• [9966] [YSQL] Import Rearrange pgstat_bestart() to avoid failures within its critical section.
• [9995] [YSQL] Import Fix EXIT out of outermost block in plpgsql.
• [10025] [YSQL] Import jit: Do not try to shut down LLVM state in case of LLVM triggered errors.
• [10034] [YSQL] Preserve operation buffering state in case of transparent retries
• [10064] [xCluster] Lag Metric Improvements
• [10111] [YSQL] Import Force NO SCROLL for plpgsql's implicit cursors.
• [10121] [YSQL] Import Avoid misbehavior when persisting a non-stable cursor.
• [YSQL] Import Fix performance bug in regexp's citerdissect/creviterdissect.

Bug Fixes

Yugabyte Platform

• [1525] New Universe creation gets public IP assigned even with flag = false
• [1598] [UI] Suggested Default File Path for CA Signed Certificate and Private Key is Incorrect
• [7573] [PLAT-482] Health Checks should run when Backup/Restore Tasks are in progress
• [7738] [PLAT-611] Health checks can overlap with universe update operations started after them
• [8510] Allow the deletion of Failed Backups
• [9014] [PLAT-509] Refresh Pricing data for Azure provider seems to be stuck
• [9315] [PLAT-521] BackupsController: small fixes required
• [9366] [PLAT-368] Disable Delete Configuration button for backups when in use.
• [9850] [YW] Correct the node path (#9864)
• [CLOUDGA-1893] fix client-to-node cert path in health checks
• [PLAT-253] Fix the backupTable params while creating Table backups using Apis.
• [PLAT-253] Fix universe's backupInprogress flag to avoid multiple backup at a time due to low frequency scheduler.
• [PLAT-289] Stopped node should not allow Release action
• [PLAT-580] Fix create xCluster config API call
• [PLAT-599] Fix error messages in alert destination and configuration services
• [PLAT-1520] Stop displaying external script schedule among Backup Schedules.
• [PLAT-1522] Fix s3 release breakage
• [PLAT-1549] [PLAT-1697] Fix Stop backup race condition. Add non-schedlued backup examples
• [PLAT-1559] Stop the external script scheduler if the universe is not present.
• [PLAT-1563] Fix instance down alerts + make sure instance restart alert is not fired on universe operations
• [PLAT-1578] Do not specify storage class (use default if provided)
• [PLAT-1586] [Alert] Able to add multiple alert configuration with same name. Add duplicate check for alert configuration name
• [PLAT-1599] [UI] Root Certificate and node-node and client-node TLS missing on Edit Universe
• [PLAT-1603] [Platform]YBFormInput's OnBlur throws error on AddCertificateForm
• [PLAT-1605] Fix duplicate alert definitions handling + all locks to avoid duplicates creation
• [PLAT-1606] Disk name too long for Google Cloud clone disk
• [PLAT-1613] Alerts: Logs filled with NPE related to "Error while sending notification for alert "
• [PLAT-1617] Added GCP region metadata for missing regions.
• [PLAT-1617] Fix issue with GCP Subnet CIDR
• [PLAT-1619] Check for FAILED status in wait_for_snapshot method.
• [PLAT-1621] Health check failed in K8s portal
• [PLAT-1625] Fix task details NPE
• [PLAT-1626] Skip preprovision for systemd upgrade.
• [PLAT-1631] [Alert] Universe filter is not working in Alert Listing
• [PLAT-1638] Fix naming convention for external script endpoints as per our standards
• [PLAT-1639] [PLAT-1681] Make proxy requests async to keep them from blocking other requests
• [PLAT-1639] [PLAT-1681] Reduce log spew from akka-http-core for proxy requests.
• [PLAT-1644] Fix k8s universe creation failure for platform configured with HA
• [PLAT-1646] Remove Unsupported Instance types from pull down menu for Azure
• [PLAT-1650] Added yum lock_timeout to prevent yum lockfile errors for use_custom_ssh_port.yml
• [PLAT-1653] Fix region get/list.
• [PLAT-1656] [UI] [Alert] Group Type filter is not working in Alert Listing
• [PLAT-1661] Fix alert messages for notification failures
• [PLAT-1667] Platform should not scrape all per-table metrics from db hosts (part 2)
• [PLAT-1668] Yugabundle failing because can't find YWErrorHandler
• [PLAT-1682] Fix node comparison function from accessing undefined cluster
• [PLAT-1687] ALERT: Not able to create destination channel using "default recipients + default smtp settings + empty email field"
• [PLAT-1694] Fix Intermittent failure to back up k8s universe
• [PLAT-1707] Fix performance issue
• [PLAT-1715] Check for YB version only for 2.6+ release DB
• [PLAT-1717] Full move fails midway if system tablet takes more than 2 mins to bootstrap
• [PLAT-1721] Stop storage type from automatically changing when instance type is changed
• [PLAT-1726] Allow user to completely remove all gFlags after addtion of several gFlags.
• [PLAT-1730] Fix resize node logic for RF1 clusters
• [PLAT-1736] Create default alert configs and destination on DB seed
• [PLAT-1737] "This field is required" error message is shown on alert configuration creation with default threshold == 0
• [PLAT-1746] Delete prometheus_snapshot directory once platform backup package is created
• [PLAT-1757] Health Check failure message has Actual and expected values interchanged
• [PLAT-1761] Fix alert message in case of unprovisioned nodes
• [PLAT-1768] Universe tasks take lot more time because thread pool executors do not reach max_threads
• [PLAT-1780] Redact YSQL/YCQL passwords from task_info table.
• [PLAT-1793] DB Error logs alert
• [PLAT-1796] Edit Universe page has password fields editable
• [PLAT-1802] Replication graphs stopped showing on replication tab (replicated.yml change)
• [PLAT-1804] Fix 'Querying for {} metric keys - may affect performance' log
• [PLAT-1816] Forward port restricted user creation to master
• [PLAT-1819] [PLAT-1828] Release backup lock when Platform restarts, and update Backup state
• [PLAT-1829] [ycql/ysql] auth password: wrong error message
• [PLAT-1833] Fix missing create time on alert configuration creation issue
• [PLAT-1839] Fix typo in DB migration
• [PLAT-1892] Make error alert be disabled by default
• [PLAT-1969] [UI] Universe creation - Create button is disabled when YSQL/YCQL auth is disabled
• Backup and Restore failing in k8s auth enabled environment
• Fix NPE in VM image upgrade for TLS enabled universes
• Use TaskInfo instead of CustomerTask in shouldIncrementVersion check

Database

• [1252] Do not link with system libpq
• [5920] Fix bootstrapping with preallocated log segment
• [7528] [YSQL] Error out when Tablespaces are set for colocated tables
• [8675] [DocDB] Prevent tablet splitting when there is post split data
• [8772] Fix fatal that occurs when running alter_universe_replication and producer master has
• [9061] [DocDB] Master task tracking should point to the table it is operating on
• [9216] [YSQL] Fix NULL pointer access in case of failed test
• [9436] [YSQL] Statement reads rows it has inserted
• [9475] Fetch Universe Key From Masters on TS Init
• [9616] Fix master crash when restoring snapshot schedule with deleted namespace
• [9655] [xCluster] Label cdc streams with relevant metadata
• [9743] Fix universe reset config option (#9863)
• [9781] Mark snapshot as deleted if tablet was removed
• [9782] [DocDB] Tablet Splitting - Wait for all peers to finish compacting during throttling
• [9786] Universe Actions -> Add Read Replica is failing
• [9789] [DocDB] Load Balancer should use tablet count while looking tablets to move
• [9802] [xCluster] Set proper deadline for YBSession in CDCServiceImpl
• [9806] DocDB: fixed Batcher::FlushBuffersIsReady
• [9812] [YSQL] Check database is colocated before adding colocated option for Alter Table
• [9822] DocDB: Check table pointer is not nullptr before dereferencing
• [9855] [DocDB] Set aborted subtransaction data on local apply
• [9860] [YSQL] fix limit vars to uint64
• [9865] Fix internal retry of kReadRestart for SELECT func() with a DML in the func
• [9867] [YSQL] Fix double type overflow in case of SET yb_transaction_priority_lower_bound/yb_transaction_priority_upperr_bound command
• [9906] [YSQL] Fix not being able to add a range primary key
• [9909] [YSQL] further fix backup restore for NULL col attr
• [9924] [YSQL] always check schema name on backup import
• [9927] YCQL - Handle unset correctly
• [9932] [YSQL] Initialize t_ybctid field in acquire_sample_rows()
• [9933] [Part-0] Update logic for using num_tablets from internal or user requests.
• [9933] [YCQL] [Part-1] DESC TABLE does not directly match the "CREATE TABLE" command for number of tablets.
• [9934] [DocDB] Don't update rocksdb_dir on Remote Bootstrap
• [9936] Fix ysql_dump in encrypted k8s environment
• [9936] Fix ysql_dump in TLS encrypted environment
• [9940] DocDB: use correct kv_store_id for post-split tablets
• [9947] [YSQL] remove runtime tag for ysql_disable_index_backfill
• [9963] backup: fix to reallow YEDIS on restore
• [9965] [YSQL] Fix copy/paste error causing incorrect conversion
• [9981] Fix transaction coordinator returning wrong status hybrid time
• [10042] [backup] allow system table for YEDIS restore
• [10051] DocDB: use RETURN_NOT_OK on an unchecked status
• [10085] YSQL fix FATAL caused by wrong sum pushdown
• [10098] [YSQL] Fix index creation on temp table via ALTER TABLE
• [10139] ybase: Avoid unnecessary table locking in CatalogManager::DeleteYsqlDBTables
• [ybase] Properly pass number of tables via MetricPrometheusOptions
• [YSQL] [9572] Correctly determine is_yb_relation for row-marked relations when preparing target list
• Fix for resource leaks
• Fixed bug in yb-ctl for stopping processes, when os.kill raises an exception
• Make SSH wait behavior consistent across operations

Known Issues

Yugabyte Platform

N/A

Database

N/A

v2.6.5.0 - Oct 29, 2021

Build: 2.6.5.0-b4

Downloads

Docker

docker pull yugabytedb/yugabyte:2.6.5.0-b4

Improvements

Database

9606 [DocDB] Add flag --force for command delete_tablet to set state TABLET_DATA_DELETED for tool yb-ts-cli

Yugabyte Platform

N/A

Bug fixes

Database

• 9924 [YSQL] Always check schema name on backup import
• 10042 [Backup] Allow system table for YEDIS restore
• 10415 [backup] Backup-restore failures for old backups.

Yugabyte Platform

• [PLAT-1634] Backup page is not loading because of empty config column
• [PLAT-1934] Adding UI to set KUBE_DOMAIN
• [PLAT-2113] [PLAT-2116] Fix HA failing with entity_too_large
• [PLAT-2020] [PLAT-2041] Fix HA on IPv6-enabled K8s setup
• [YB] Replaced the Busybox image with a YB image, as some environments are unable to access Busybox

Known issues

Database

N/A

Yugabyte Platform

N/A

v2.6.4.0 - Oct 26, 2021

Build: 2.6.4.0-b3

Downloads

Docker

docker pull yugabytedb/yugabyte:2.6.4.0-b3

Improvements

Database

• [10150] [YSQL] Add functionality for the yb_extension role
• [10317] [YSQL] Import "Allow users with BYPASSRLS to alter their own passwords."

Yugabyte Platform

• [9612] [PLAT-26] [PLAT-1674] [Platform] Add logs purge threshold option to zip_purge_yb_logs.sh
• [PLAT-1897] Make client_max_body_size configurable in replicated

Bug fixes

Database

• [9909] [YSQL] Further fix backup restore for NULL col attr
• [9957] [YSQL] Fix memory usage when translating decimal data into Postgres's datum format.
• [9963] [Backup] Fix to reallow YEDIS on restore
• [10240] Add IPv6 address filters to default value of net_address_filter
• [10364] [YCQL] Fix issue when dropping col that is not in an existing non-partial secondary index

Yugabyte Platform

N/A

Known issues

Database

N/A

Yugabyte Platform

N/A

v2.6.3.0 - Oct 22, 2021

Build: 2.6.3.0-b12

Downloads

Docker

docker pull yugabytedb/yugabyte:2.6.3.0-b12

Improvements

Database

• [3785] [DocDB] Add support for LZ4 compression
• [7612] [DocDB] Allow TTL-expired SST files that are too large for compaction to be directly expired
• [7612] [DocDB] Improves TTL handling by removing a file completely if all data is expired
• [7612] [DocDB] Modified compaction file filter to filter files out of order
• [10019] [DocDB] Add support for zlib compression
• [10110] [DocDB] Enables compaction file filter during manual compactions

Yugabyte Platform

• [9113] [9114] [Platform] Populate the task id field in the backup table
• [PLAT-1753] Enable taking backups using custom ports

Bug fixes

Database

• [9436] [YSQL] Statement reads rows it has inserted
• [10077] [DocDB] Compaction file filter factory uses HistoryRetention instead of Schema
• [10164] [DocDB] Max file size for compactions should only affect TTL tables
• [YSQL] Restart metrics webserver when postmaster recovers backend

Yugabyte Platform

• [PLAT-1819] [PLAT-1828] Release backup lock when Platform restarts, and update Backup state

Known issues

Database

N/A

Yugabyte Platform

N/A

v2.6.2.0 - Oct 12, 2021

Build: 2.6.2.0-b36

Downloads

Docker

docker pull yugabytedb/yugabyte:2.6.2.0-b36

Improvements

Database

• 8807 [YBase] Add HTTP URL param for limiting the number of tables whose metrics are displayed
• 9370 Add Snappy and LZ4 traffic compression algorithms
• 9685 [XCluster] Make delete_universe_replication fault tolerant
• 9762 Update yb-thirdparty dependencies to use cqlsh v3.10-yb-10
• 10064 [xCluster] Lag Metric Improvements
• 10139 [YBase] Avoid unnecessary table locking in CatalogManager::DeleteYsqlDBTables
• 10199 [YSQL] Import Reset memory context once per tuple in validateForeignKeyConstraint.

Yugabyte Platform

• 8510 [Platform] Allow the deletion of Failed Backups

Bug fixes

Database

• 1252 Do not link with system libpq
• 2318 [2DC] yb-admin should prevent setup_universe_replication from self-referencing.
• 4421 [YCQL] Disallow Unauthenticated LDAP binding + add handling for ycql_ldap_search_filter
• 5920 Fix bootstrapping with preallocated log segment
• 8580 9489 [YSQL] Inherit default PGSQL proxy bind address from rpc bind address
• 8772 Fix fatal that occurs when running alter_universe_replication and producer master has changed
• 9170 3375 9934 [DocDB] Drive aware LBing when removing tablets
• 9572 [YSQL] Correctly determine is_yb_relation for row-marked relations when preparing target list
• 9763 Fix accept failure failure handling in linux
• 9781 Mark snapshot as deleted if tablet was removed
• 9806 [DocDB] fixed Batcher::FlushBuffersIsReady
• 9892 Mask sensitive gflag info
• 9927 [YCQL] Handle unset correctly
• 9933 [YCQL] DESC TABLE does not directly match the "CREATE TABLE" command for number of tablets.
• 9933 [YCQL] Update logic for using num_tablets from internal or user requests.
• 9947 [YSQL] remove runtime tag for ysql_disable_index_backfill
• 10085 [YSQL] fix FATAL caused by wrong sum pushdown
• 10104 [Tools] Explicitly removing transaction metadata field during ListSnapshots

Yugabyte Platform

• [PLAT-1682] Fix node comparison function from accessing undefined cluster
• [PLAT-1725] Full move fails midway if system tablet takes more than 2 mins to bootstrap
• [Platform] [UI] NFS config failed in 2.6
• [Platform] Use TaskInfo instead of CustomerTask in shouldIncrementVersion check

Known issues

Database

N/A

Yugabyte Platform

N/A

v2.6.1.1 - Oct 8, 2021

Build: 2.6.1.1-b1

Downloads

Docker

docker pull yugabytedb/yugabyte:2.6.1.1-b1

Security update

This release is a patch to v2.6.1.0, and addresses an LDAP authentication vulnerability in YCQL.

If you can't update to 2.6.1.1 immediately, and you're running YugabyteDB 2.6.1.0 in conjunction with LDAP authentication for YCQL, disable LDAP authentication for YCQL by setting the --ycql_use_ldap flag to false, which reverts the authentication method to hashed password. YSQL is not affected.

v2.6.1.0 - Sept 3, 2021

Build: 2.6.1.0-b49

Downloads

Docker

docker pull yugabytedb/yugabyte:2.6.1.0-b49

Improvements

Database

• [4014] [YSQL] Indexes on Enum based columns
• [4421] [YCQL] Enable LDAP based authentication
• [6470] [YSQL] Enable ALTER SCHEMA RENAME
• [8418] Add filter to list_snapshot_schedules
• [8757] [xCluster] Make setting up replication synchronous
• [9317] [YBase] Introduce mutex for permissions manager
• [9333] [Backup] Improve internal PB structure to store backup metadata into SnapshotInfoPB file.
• [9370] Implement network traffic compression
• [9762] (Part 1) Populate partial index predicate in "options" column of system_schema.indexes

Yugabyte Platform

• [3452] [Platform] UI support for root cert rotation
• [8489] [Platform] Add support for root cert rotation for custom certs
• [8789] Add support for certificate chaining in platform/yb-client.
• [9063] Support metrics filtering for /prometheus-metrics endpoint
• [9451] Default AWS EBS volume type changed from GP2 to GP3

Bug fixes

Database

• [8114] [YSQL] [Backup] Partial index syntax error in the ysql_dump output
• [8294] Fix missing conflict when creating row using multiple inserts
• [8480] Add check for recursive shared lock
• [8592] Check capability before sending graceful cleanup
• [8804] [YSQL] [Backup] Support in backups the same table name across different schemas.
• [9032] [YCQL] Honour token() conditions for all partition keys from IN clause
• [9270] [Backup] Fixed compatibility issue in yb_backup.
• [9314] [PITR] Cleanup sys catalog snapshots
• [9418] [xCluster] Add cdc_state Schema Caching to Producer Cluster
• [9550] [YSQL] output NOTICE when CREATE INDEX in txn block
• [9605] [PITR] Fix auto cleanup of restored hidden tables
• [9616] Fix master crash when restoring snapshot schedule with deleted namespace
• [9654] [xCluster] Limit how often ViolatesMaxTimePolicy and ViolatesMinSpacePolicy are logged
• [9656] [xCluster] Update cdc_min_replicated_index on BootstrapProducer
• [9657] [YCQL] Show static column in the output of DESC table
• [9746] Set WAL footer close_timestamp_micros on Bootstrap
• [9812] [YSQL] Check database is colocated before adding colocated option for Alter Table

Yugabyte Platform

• [1525] [Platform] New Universe creation gets public IP assigned even with flag = false
• [9417] [9662] Set enable_log_retention_by_op_idx to true by default and bump update_metrics_interval_ms to 15000
• [9571] [Platform] Backup and Restore failing in k8s auth enabled environment
• [9692] Fix initialization of async cluster form values for existing universes without read-replica
• [9713] [Platform] Do not perform version checks if HA is not set
• [9786] Universe Actions-> Add Read Replica is failing on 2.6.1.0-b23
• [PLAT-1644] Fix k8s universe creation failure for platform configured with HA
• [PLAT-525] [Platform] Add IP address to SAN of node certificates

Known issues

Database

N/A

Yugabyte Platform

N/A

v2.9.0.0 - August 31, 2021

Version 2.9 introduces many new features and refinements. To learn more, check out the Announcing YugabyteDB 2.9: Pushing the Boundaries of Relational Databases blog post.

Yugabyte release 2.9 builds on our work in the 2.7 series, which fed into the 2.6 stable release.

Build: 2.9.0.0-b4

Downloads

Docker

docker pull yugabytedb/yugabyte:2.9.0.0-b4

New Features

(Refer to the release announcement for new-feature details for this release!)

Improvements

Yugabyte Platform

• [3452] [Platform] Allow TLS encryption to be enabled on existing universes
• [3452] [Platform] Wrapper API handling both TLS Toggle and Cert Rotation
• [8296] [Platform] Ability to stop backups from admin console. (#9310)
• [8489] [Platform] Update CertsRotate upgrade task to support rootCA rotation
• [8637] [Platform] Adding APIs to schedule External user-defined scripts.
• [9236] Replace cron jobs with systemd services for yb-master, yb-tserver, clean_cores, and zip_purge_yb_logs.
• [9237] Upgrade cron based universes to systemd universes.
• [9238] Changed AWS Default storage type from GP2 to GP3
• [9272] Add connection strings for JDBC, YSQL and YCQL in connect Dialog (#9473)
• [9302] Adding custom machine image option for GCP
• [9325] updated aws pricing data by running aws utils.py script. pricing data now includes t2 data. t2 instances can now be used when launching universes.
• [9370] Add Snappy and LZ4 traffic compression algorithms
• [9370] Implement network traffic compression
• [9372] Add RPC call metrics
• [9497] [Platform] Add more regions to GCP metadata
• [PLAT-1501] [Platform] Support downloading YB tarball directly on the DB nodes
• [PLAT-1522] [Platform] Support downloading releases directly from GCS
• AWS disk modification wait method updated to return faster

Database

• [2272] [YSQL] Creating system views during YSQL cluster upgrade
• [2272] [YSQL] Support INSERT with OID and ON CONFLICT or cluster upgrade
• [3375] [DocDB] Drive aware LBing when removing tablets
• [4421] [YCQL] Enable LDAP based authentication
• [6470] [YSQL] Enable ALTER SCHEMA RENAME
• [6719] [YSQL] YSQL support for tablet splits by preparing requests along with tablet boundaries
• [7327] [YSQL] Enable concurrent transactions on ALTER TABLE [DROP & ADD COLUMN] DDL Statement
• [7612] [DocDB] Improves TTL handling by removing a file completely if all data is expired
• [7889] [5326] [YBase] Implement chunking/throttling in Tablet::BackfillIndexForYSQL
• [7889] [YSQL] Set up infrastructure for index backfill pagination
• [8452] [YBase] Support for YSQL DDL restores for PITR
• [8718] [YSQL] Implement function to compute internal hash code for hash-split tables
• [8756] [YSQL] Enable statistic collection by ANALYZE command
• [8804] [YSQL] [backup] Support in backups the same table name across different schemas
• [8846] [DocDB] [PITR] allow data-only rollback from external backups
• [9036] Ability to verify Index entries for a range of rows on an indexed table/tablet
• [9073] [9597] [YSQL] pg_inherits system table must be cached
• [9219] [YSQL] Add superficial client-side support for SAVEPOINT and RELEASE commands
• [9317] [YBase] Introduce mutex for permissions manager
• [9333] [backup] Improve internal PB structure to store backup metadata into SnapshotInfoPB file.
• [9583] [YSQL] log failed DocDB requests on client side
• [YSQL] Merge user provided shared_preload_libraries to enable custom PSQL extensions (#9576)
• [YSQL] Pass Postgres port to yb_servers function

Bug Fixes

Yugabyte Platform

• [7456] [Platform] Add Labels to GCP Instances and disks
• [8152] [Platform] Enforce configured password policy (#9210)
• [8798] Add version numbers to UpgradeUniverse task info
• [8950] [Platform] Use matching helm chart version to operate on db k8s pods
• [9098] [Platform] Fix sample apps command syntax for k8s universes
• [9213] [Platform] [UI] Leading or trailing spaces are not removed from username field on login console
• [9245] [Platform] Add empty check before adding tags
• [9245] [Platform] Tag AWS Volumes and Network Interfaces
• [9260] [Platform] Fix Health Check UI not rendering
• [9278] changing kubernetes provider config labels
• [9331] [Platform] Allow editing "Configuration Name" for backup storage provider without security credentials
• [9363] fixing metric graph line labels
• [9363] removing TServer references from graph titles
• [9365] [Platform] Optimise CertificateInfo.getAll by populating universe details in batch rather than individually
• [9377] Improving system load graph labels
• [9403] [UI] Add submit type to submit button in YBModal
• [9403] Fix form submission causing refresh for confirmation modal
• [9417] [9662] Set enable_log_retention_by_op_idx to true by default and bump update_metrics_interval_ms to 15000
• [9425] [Platform] Slow Query Calls using custom username/password
• [9580] [Platform] Added a restore_time field in backup restore flow for AWS portal only using Feature Flags.
• [9628] [Platform] Increase wait for yum lockfile to be released during preprovisioning
• [9635] [Platform] "None" in zone field observed on tserver status page in platform
• [9692] Fix initialization of async cluster form values for existing universes without read-replica
• [9713] [Platform] Do not perform version checks if HA is not set
• [9854] Disable drive aware LB logic by default
• [PLAT-1520] [Platform] Stop displaying external script schedule among Backup Schedules
• [PLAT-1524] [Platform] Fix password policy validation
• [PLAT-1540] [Platform] Make health check use both possible client to node CA cert location
• [PLAT-1559] [Platform] Stop the external script scheduler if the universe is not present
• [Platform] Disable "Pause Universe" operation for Read-Only users (#9308)
• [Platform] Extends ToggleTLS with ClientRootCA and General Certificates Refactor
• Delete associated certificates while deleting universe
• Make backup configuration name unique for each customer

Database

• [2922] [5036] [YSQL] Avoid redundant key locking in case of update operations
• [4992] Add application.conf setting to dump output of cluster_health.py
• [6667] [DocDB] Add a limit on number of outstanding tablet splits
• [8034] [DocDB] fixed tablet split vs table deletion race
• [8256] [DocDB] Tablet splitting: Disable automatic splitting for 2DC enabled tables
• [8592] Check capability before sending graceful cleanup
• [8683] [DocDB] fixed CassandraBatchTimeseries failures loop with tablet splitting
• [9032] [YCQL] Honour token() conditions for all partition keys from IN clause
• [9219] [DocDB] Ignore intents from aborted subtransactions during reads and writes of the same transaction
• [9219] [DocDB] Persist SubTransactionId with intent value
• [9248] [DocDB] reworked global_skip_buffer TSAN suppression
• [9259] Block PITR when there were DDL changes in restored YSQL database
• [9279] [YSQL] Enable -Wextra on pggate
• [9301] Default to logging DEBUG logs on stdout
• [9314] [PITR] Cleanup sys catalog snapshots
• [9319] [DocDB] fixed std::string memory usage tracking for gcc9
• [9320] [YSQL] Import Make index_set_state_flags() transactional
• [9323] [YSQL] address infinite recursion when analyzing system tables
• [9334] Fix provider creation in yugabundle by using correct version of python
• [9335] Use proper initial time to avoid signed integer overflow
• [9430] [DocDB] Added success message for all tablets and single tablet compaction/flushes
• [9451] Fixed diskIops and throughput issue.
• [9452] Fix access key equals method
• [9476] [DocDB] Use EncryptedEnv instead of Env on MiniCluster
• [9492] Limit VERIFY_RESULT macro to accept only Result's rvalue reference
• [9501] [DocDB] fixed Log::AllocateSegmentAndRollOver
• [9550] [YSQL] output NOTICE when CREATE INDEX in txn block
• [9553] Update TSAN suppression after RedisInboundCall::Serialize rename
• [9563] [YSQL] Import jit: Don't inline functions that access thread-locals.
• [9586] [DocDB] Ignore intents from aborted subtransactions during transaction apply
• [9593] [DocDB] Move client-side subtransaction state to YBTransaction
• [9600] [YSQL] Smart driver: Incorrect host value being return in Kubernetes environment
• [9601] Cleanup intents after bootstrap
• [9605] [YBase] PITR - Fix auto cleanup of restored hidden tablets
• [9616] Fix master crash when restoring snapshot schedule with deleted namespace
• [9654] [xCluster] Limit how often ViolatesMaxTimePolicy and ViolatesMinSpacePolicy are logged
• [9657] [CQL] Show static column in the output of DESC table
• [9677] [YSQL] Import Fix mis-planning of repeated application of a projection.
• [9678] [YQL] Use shared lock for GetYsqlTableToTablespaceMap
• [9750] Initialise shared memory when running postgres from master
• [9758] [DocDB] Fix race between split tablet shutdown and tablet flush
• [9768] [YSQL] Import Fix incorrect hash table resizing code in simplehash.h
• [9769] [YBase] Use shared lock in GetMemTracker()
• [9776] [YSQL] Import Fix check_agg_arguments' examination of aggregate FILTER clauses.
• [YSQL] free string in untransformRelOptions()
• [YSQL] Import Fix division-by-zero error in to_char() with 'EEEE' format.
• [YSQL] Import Fix thinkos in LookupFuncName() for function name lookups
• [YSQL] Import Lock the extension during ALTER EXTENSION ADD/DROP.

Known Issues

Yugabyte Platform

N/A

Database

N/A

Notes

v2.7.2.0 - July 29, 2021

Build: 2.7.2.0-b216

Downloads

Docker

docker pull yugabytedb/yugabyte:2.7.2.0-b216

New Features

Yugabyte Platform

• [7349] [Platform] Support for multiple backup configs. (#7668)
• [8767] [Platform] RedHat OpenShift provider is no longer beta.
• [8775] [Platform] [UI] Platform high availability is no longer beta.

Core Database

• [1127] [YSQL] Collation Support (part 1)
• [3785] [DocDB] Add support for LZ4 compression
• [7509] [YCQL] Support partial indexes
• [7719] [DocDB] Introduce Aggregation Function for Metrics
• [8323] [YSQL] Add support for USING INDEX TABLESPACE

Improvements

Yugabyte Platform

• [3452] [Platform] Allow TLS Encryption to be enabled on existing universes
• [6857] [Platform] Preflight checks for encryption-at-rest keys (#8737)
• [7509] [YCQL] Allow both = and != operator in partial indexes.
• [8141] [Platform] Disable backup button is moved to the universe action list. (#8788)
• [8144] [Platform] Validate custom certs on the node
• [8313] [Platform] Don't download all node logs at once
• [8324] [Platform] Disabled the query monitoring under Queries tab. (#8576)
• [8406] [Platform] Add deviceInfo validation on universe/read replica cluster create operations
• [8487] [Platform] Add indices on customer_task and task_info to improve Tasks page performance
• [8631] [Platform] Add ability to use different certificates for node to node and client to node connections.
• [8632] [Platform] Add ability to take custom certificates in platform for client to server connections.
• [8662] [Platform] Release pause universe and multiple provider feature
• [8789] Add support for certificate chaining in platform/yb-client.
• [8813] [Platform] requesting Email alerts uptime in days, hours, minutes, seconds.
• [8824] [Platform] S3 backup preflight check while updating the backups. (#8926)
• [8883] [Platform] Support smart instance type upgrade for AWS
• [8917] [Platform] Add task to sync platform with cluster state
• [8921] [Platform] ReadOnly and BackupAdmin roles to change their password
• [9054] [Platform] To implement AlertReceivers group entity
• [9056] [Platform] Alert definition groups implementation + APIs for groups and templates
• [9120] [Platform] Default alert route functionality
• [9197] [platform] Adding SSL mode to YSQL client
• [9331] [Platform] Allow editing "Configuration Name" for backup storage provider without security credentials
• [Platform] Remove commons-collections4 and use guava instead (#8856)

Core Database

• [2272] [YSQL] Creating system and shared system catalog tables
• [3375] [DocDB] Add multi drives and env to TS servers for MiniCluster
• [4014] [YSQL] Indexes on Enum based columns
• [4437] [DocDB] disabled bloom filters for master tablet and fixed DocDBAwareV2FilterPolicy compatibility for range-partitioned co-located tables
• [4519] [YSQL] Re-enable merge join
• [5026] [9001] [YCQL] Run operations within a transaction block in serial
• [7110] [DocDB] Add Clang thread safety annotations to YQLPartitionsVTable (#8364)
• [7349]Change ToString to TextVlue for json node (#8792)
• [7530] YB-Master HTML page should show the tablespace and tablespace replication info for a table
• [7535] [YSQL] Use geo-location (tablespace) to cost index scans
• [7794] [YSQL] Add option to forward pggate RPCs to local tserver
• [7835] [YCQL] Prohibit NULL value in the collections.
• [7877] Some raw json cleanup across the board
• [8010] Handle creation of tables in a tablespace with invalid placement policy gracefully
• [8039] [DocDB] Rename flag controlling forced tablet split threshold for very large tablets
• [8039] Implement phased ramp-up of tablet splitting rate
• [8084] Remove dependence of client to server TLS on node to node TLS.
• [8225] Disable automatic tablet splitting for YEDIS tables
• [8234] [DocDB] Remove tablet_split_heartbeat_data_provider and delegate all split decisions to yb-master
• [8249] [YSQL] Allow any hash column in index to be an expression based column
• [8254] No leader lease needed for BackfillIndex
• [8257] [YBase] Disable tablet splitting for PITR tracked tables
• [8295] [DocDB] Improved tablet RocksDBs shutdown process
• [8330] [YCQL] Provide capability to skip writing null jsonb attribute in UPDATE stmt
• [8347] Wait until executor finish executing async calls on shutdown
• [8382] [YSQL] Import Fix mishandling of resjunk columns in ON CONFLICT ... UPDATE tlists.
• [8392] [YSQL] Use negative cache elements to avoid read catalog entries from master
• [8473] [YBase] Log the requested memory size in the assertion for allocation failure
• [8485] Convert OperationCompletionCallback into std::function
• [8485] Simplify MVCCManager to allow aborting only last operation
• [8485] Unify ConsensusRound callbacks
• [8512] [YCQL] Added CQL metric for USE statement and tests for Prepared INSERT.
• [8519] [YSQL] Optimize FK check
• [8575] [YSQL] Optimize row locking in case of using IN operator for single range key column
• [8591] [DocDB] Add protection against missing UserFrontiers in older SST files during intents cleanup
• [8619] Log index table name instead of index id (#8693)
• [8672] [YSQL] Check status of YBCPgResetOperationsBuffering function
• [8691] Remove dump-statistics related code from db_impl.cc;
• [8712] Reduce space consumed by HdrHistogram metrics for per-table metrics
• [8723] Simplify RemoteMethodsCache code
• [8749] [YSQL] Import Don't leak rd_statlist when a relcache entry is dropped.
• [8757] xCluster Replication: Make setting up replication synchronous
• [8783] [YSQL] Import Fix CREATE INDEX CONCURRENTLY for simultaneous prepared transactions.
• [8784] Set session timeout in PgTxnManager
• [8805] [YSQL] Import Fix incautious handling of possibly-miscoded strings in client code.
• [8806] [YBase] Add global client gflag to specify number of tablets for a table
• [8817] Add mechanism to report number of rows backfilled to master
• [8855] Logging improvements for backup restore issue.
• [8867] [YBase] Add endpoint for LB pretty display
• [8871] [YBase] Pass timeout to the Session object in FlushIndexBatchIfRequired()
• [8872] Merge Operation and OperationState
• [8873] [YSQL] Import Work around portability issue with newer versions of mktime().
• [8878] [YBase] Reduce scope of lock in CatalogManager::DumpState()
• [8892] backups: Add timing summary to end of yb_backup
• [8894] backups: Allow disabling of checksums in yb_backup
• [8905] Replace gscoped_ptr with std::unique_ptr
• [8962] [YSQL] Import Fix plancache refcount leak after error in ExecuteQuery.
• [8986] [YSQL] Import Fix misbehavior of DROP OWNED BY with duplicate polroles entries.
• [9007] [5380] Allow using clangd-indexer to fully index C/C++ code
• [9041] [YSQL] Import Fix minor violations of FunctionCallInvoke usage protocol.
• [9056] Remove extension operations from migration code.
• [9063] Support metrics filtering for /prometheus-metrics endpoint
• [9101] [YSQL] Import backpatch "jit: Add support for LLVM 12."
• [9109] Deduplicate hostnames in PickResolvedAddress
• [9128] [DocDB] Converted MetaCache::DoLookupAllTablets excessive INFO logs to VLOGs
• [9146] [YSQL] add "/HASH" to "ASC/DESC" errmsg
• [9154] [2519] [1973] Initial changes for supporting the aarch64 architecture
• [9185] Use atomic write for created table and its tablets
• [9208] [YSQL] Change function call information to be fixed length
• [9265] [YBase] Return error if tablet is not removed by RemoveRunningTablet
• [adhoc] [DocDB] Remove unused argument from Tablet::NewRowIterator
• [backup] Added a check for 'num_tablets' in CatalogManager::ImportSnapshot.
• [DocDB] Add Clang thread safety annotations to catalog_entity_info (#8186)
• [SMARTDRIVER] [YSQL] Function to fetch database servers #7879
• [YBase] Use SharedLock in GetNumRelevantReplicas
• [YSQL] Import Fix incorrect return value in pg_size_pretty(bigint)
• [YSQL] Import Reduce the cost of planning deeply-nested views.
• [YSQL] Import Relax transactional restrictions on ALTER TYPE ... ADD VALUE (redux).
• [YSQL] improve ALTER TABLE [NOT] OF errmsg
• [YSQL] improve ALTER TABLE [RE]SET errmsg

Point-in-time recovery

• [8417] PITR: Implement delete_snapshot_schedule
• [8418] Add filter to list_snapshot_schedules
• [8419] Consistent restore failover
• [8419] Consistent restore for non transactional writes
• [8419] Consistent restore for transactional writes
• [8543] PITR: Add test for need to increase table version on restore
• [8773] PITR: Add DDL log
• [9046] PITR: Fix crash when using multiple masters
• [9157] [DocDB] PITR: Fix operations filters data race
• [9171] PITR: Fix restoring snapshot to time before history cutoff

Bug fixes

Yugabyte Platform

• [6645] [Platform] AZ rendering issue when API throws bad request in case of same instance type. (#8367)
• [7594] [Platform] Assign universe UUID instead of backup UUID to target UUID while creating delete backup task. (#8529)
• [7859] Fix '< 1 min' uptime shown intermittently
• [8029] [Platform] Fix slow queries failing to fetch on client-to-node TLS encrypted universes
• [8322] [Platform] No HA config exists is now logged as INFO
• [8345] [Platform] Remove hard coded cert filepath
• [8399] [Platform] Fix read replica cluster addition failure
• [8400] [Platform] when universe is in pending state (inprogress) upgrade on the card should also be disabled
• [8426] [Platform] Alert spam for message "Clock Skew Alert Resolved"
• [8460] [Platform] Add proxy request timeout
• [8461] [Platform] Added fix for redirecting user to intended url. (#8520)
• [8462] [Platform] Added preflight check to check if there is adequate disk space before installation
• [8481] [Platform] Added check to disable backups if it is in progress. (#8482)
• [8487] [Platform] Update index sql version number to prevent conflicts
• [8503] [Platform] Fix Add instance modal form to allow for adding instances in isolated region case.
• [8525] [Platform] Audit migration failed on AWS portal
• [8539] [Platform] [UI] remove toast about auth token expiration
• [8541] [Platform] Returns bad request as a response when trying to create a provider with an existing name
• [8697] [Platform] Fix client certs not being included when adding custom CA cert.
• [8739] [Platform] Cleanup raw Json from CloudProviderController
• [8739] Cleanup CloudProviderController and Skip JsonBackrefs
• [8795] [Platform] Retain placeholder text while editing the CA certificate fields. (#9051)
• [8814] [Platform] Email alerts incorrectly label Nodes as Clusters.
• [8830] [Platform] Get rid of raw json in AlertReceiver
• [8836] [Platform] [UI] Do not reverse the logs
• [8841] [Platform] Fetch KMS configs when user has enabled encryption at rest
• [8855] [Platform] Restore backup - Selected S3 Default but BackupParams point to NFS
• [8858] [Platform] fix playbook for python 3.7 + multiline config value
• [8875] [Platform] On failure task runner updates task_info.details.errorString
• [8958] [Platform] Fix incorrect sample app command.
• [9080] [Platform] Fix certificate value being used for client to server conns
• [9113] [9114] [Platform] Populate the task id field in the backup table
• [9198] [Platform] Alerts: Repeat notifications after previous failures + code cleanup
• [9209] [Platform] Fix downloadNodeLogs and add Unit tests for universe
• [9209] [Platform] Use current http execution context to do work so that we can use response object.
• [9263] [Platform] Node status shows as Unreachable, after restarting a node process
• [9292] [Platform] Fix preflight check for backup configurations
• [9334] [Platform] Fix provider creation in yugabundle by using correct version of python
• [Platform] [UI] Fixed connect button for K8s-based universes. (#8404)

Core database

• [2318] [2DC] yb-admin should prevent setup_universe_replication from self-referencing.
• [7213] [DocDB] Potential deadlock in yb::client::YBTable::MaybeRefreshPartitions
• [7863] [YSQL] Single row optimization for Updates is not being used for partitioned tables even when only one partition is being updated.
• [8011] [YBase] Don't abort replica assignment for other tables if one table has an invalid placement
• [8076] [YBase] Master skips deleting tablet data on restarted tservers
• [8170] Correct fix for removing tablet in ProcessTabletAssignment
• [8204] [YBase] GetLoadMoveCompletionPercent returns an incorrect 100% if tservers haven't
• [8271] YB-Master should not periodically read the pg_class table if there are no tablespaces.
• [8282] Fix commons-lang deps.
• [8294] Fix missing conflict when creating row using multiple inserts
• [8390] Fix NPE Handling for indexed_table_id
• [8584] [DocDB] fixed RocksDB manual compaction abort on shutdown
• [8666] [DocDB] Fix tserver response to SplitTablet RPC in case tablet is not in ready state
• [8696] Fix potential deadlock in WaitLoaded and WaitAllLoaded
• [8709] fix yb-ctl start_node to wait for tserver startup instead… (#8711)
• [8719] [8594] [DocDB] Don't send TabletPathInfo for non data ready tablets
• [8721] [YSQL] Skip iteration of bucket when YugaByte is enabled
• [8722] [YSQL] Remove autogenerated files as a part of orafce source tree
• [8726] Fix yb-admin change_config REMOVE_SERVER on stepdown
• [8748] Every executable should link tcmalloc directly
• [8766] [DocDB] recreate table with the same name could cause insert to fail
• [8774] [8780] Fix DeleteTable interaction with backfill
• [8799] [DocDB] Fix core dump when applying split operation for subtablet with existing tablet-meta directory
• [8827] [DocDB] Remove deadlock from SetIsBackfiling/IsBackfilling
• [8835] [YSQL] Disallow PRIMARY KEY on expression
• [8861] [DocDB] Do not remove flush tasks on shutdown if disable_flush_on_shutdown is not set
• [8891] [DocDB] Do not remote bootstrap newly split tablets to raft peers who have accepted split op in parent tablet
• [8915] YSQL Fix initdb in ASAN
• [8919] [DocDB] Fixed DBImpl::BackgroundFlush
• [8987] [DocDB] fixed YQLPartitionsVTable::RetrieveData TSAN issue

v2.6.0.0 - July 7, 2021

Downloads

Docker

docker pull yugabytedb/yugabyte:2.6.0.0-b69

New features

Core database

Point-in-time recovery

This feature allows you to restore the state of a cluster back to a previous point in time. This release is focused on support for the YCQL API. You can set up PITR at a YCQL keyspace level and recover from data changes and from metadata operations, such as CREATE TABLE / CREATE INDEX / ALTER TABLE / DROP TABLE / DROP INDEX. Support for YSQL is still very limited, only allowing recovery of data. (The items in this list cover new functionality as well as bug fixes.)

• [7126] [7135] Restore table schema
• [7126] Add restore_snapshot_schedule to admin
• [7126] Add yb-admin commands to create and list snapshot schedules
• [7126] Cleanup deleted tablets
• [7126] Cleanup not restored tables and tablets
• [7126] Cleanup outdated snapshots
• [7126] Correct history retention for newly added tablets
• [7126] Fix SnapshotScheduleTest.RemoveNewTablets
• [7126] Fix YbAdminSnapshotScheduleTest.UndeleteIndex
• [7126] Handle master failover
• [7126] Load snapshot schedules during bootstrap
• [7126] Restore deleted table
• [7126] Special history retention mechanism
• [7126] Take system catalog snapshot
• [7137] Provide ability to create snapshot schedule for YSQL database and YCQL keyspace
• [8417] Implement delete_snapshot_schedule
• [8419] PITR related fixes
• [8543] Add test for need to increase table version on restore
• [8773] Add DDL log
• [9046] Fix crash when using multiple masters
• [9162] Fix stack overflow in filtering iterator
• [9171] Fix restoring snapshot to time before history cutoff

Yugabyte Platform

• Yugabyte Platform High Availability(HA):

Deploy and use the YB Platform console in HA mode for mission-critical environments while meeting service level agreements and business continuity requirements.

• Expanded IaaS support in Platform:

Added support for Azure, Openshift, Vmware Tanzu, (AWS, GCP, and all flavors of managed k8s already supported)

• Yugabyte Platform on Tanzu Solutions Hub:

Confidently run stateful microservices using the first distributed SQL database solution to be validated to run on all three of the following: VMware Tanzu Kubernetes Grid (TKG), TKG-i (Integrated Edition), and VMware vSphere with Tanzu.

• Yugabyte Platform on Red Hat Marketplace:

We bring the power of Red Hat OpenShift to its open source distributed SQL database and make YugabyteDB available on Red Hat Marketplace for customers seeking solutions that are tested, certified and supported on Red Hat OpenShift

• [7215] Added an ability to select multiple backups for deletion rather than deleting individual backups.
• [7278] [7446] Added improved search usability for Live and Slow queries by adding autocomplete suggestions, better filtering and navigation.
• [7421] In order to enhance security, encryption is enabled by default for both client to node and node to node cases.
• [7474] [7725] Platform now supports creating multi-instance cloud providers. Cloud provider components to allow adding more than one config for the same provider.
• [7799] Added support for AWS GP3 volumes during universe creation from the Platform. The disk size and IOPS configuration for GP3 drives are configurable, whereas throughput is not configurable and is set to default value of 125MiB/sec.

Improvements

Core database

• [1248] [YSQL] Create background task for verifying tablet data integrity
• [1479] [YBase] Allow normal load balancing for DEAD+BLACKLISTED TS
• [3040] [YBase] Allow global leader load balancing
• [3460] [YSQL] Integrate Orafce extension with Yugabyte
• [4580] add metric for wal files size (#7260)
• [6631] [YBase] Allow support for prefixes while specifying placement info
• [6636] [DocDB] Cache table->tablespace->placement information in YB-Master
• [6845] [YSQL] Introduce the 'use_node_hostname_for_local_tserver' gflag to use DNS name instead of IP for local tserver connection
• [6947] [YBase] Allow leader balancing for DEAD nodes
• [6982] [YSQL] Specify read time for catalog tables to guarantee consistent state of catalog cache
• [7047] [YSQL] Read minimal possible number of columns in case of index scan
• [7068] Allow reloading of the config file with 'ts-cli'
• [7108] [DocDB] Disable tablet splitting during index backfill
• [7199] track and display heartbeat roundtrip time from each yb-tserver in yb-master UI (#7239)
• [7355] [YSQL] check backfill bad connection status
• [7455] [YCQL] Update index from transaction with cross-key statements.
• [7487] [DocDB] Remove unnecessary Value decoding and TTL calculation in doc_reader.cc
• [7509] [YCQL] Allow both = and != operator in partial indexes.
• [7509] [YCQL] Support partial indexes
• [7534] [YSQL] Support ALTER TABLE ADD PRIMARY KEY for colocated tables
• [7543] [DocDB] Add uptime into master home UI
• [7547] Set flags automatically based on the node's available resources
• [7557] [YCQL] Support != operator
• [7564] [YBase] Auto tune ysql_num_shards_per_tserver similar to yb_num_shards_per_tserver
• [7600] [YSQL] Explain --masters in ysql_dump cli.
• [7617] [DocDB] Record and display disk usage by drive
• [7628] Add LDAP libraries as special case for YB client packaging
• [7632] [YCQL] Support upsert for JSONB column field values
• [7647] [DocDB] Adds Num SST Files to TS tablets view
• [7649] [YCQL] Block secondary index creation on static columns.
• [7651] [YSQL] Always listen on UNIX domain socket
• [7661] [DocDB] Run manually triggered compactions concurrently
• [7705] [YSQL] prioritize internal HBA config
• [7724] [YSQL] add GUC var yb_index_state_flags_update_delay
• [7748] [YSQL] ALTER ADD PK should do column checks
• [7756] Make Encryption at Rest Code Openssl 1.1.1 Compatible
• [7804] [DocDB] Make WritableFileWriter buffer gflag controllable
• [7805] Share Histograms across tablets belonging to a table instead of having Histograms (in TabletMetrics and other objects) separately for each tablet. Share Histograms in RocksDBStatistics across various tablets belonging to a table.
• [7813] [YSQL] YSQL dump should always include HASH/ASC/DESC modifier for indexes/pkey.
• [7844] Set tcmalloc max cache bytes for yb-master similar to the yb-tserver.
• [7873] [DocDB] Initialize block cache for master/sys_catalog
• [7915] Add flag to allow dumping lock batch keys in case of timeout
• [7916] CQL call timeout
• [7944] [YSQL] deprecate flag ysql_wait_until_index_permissions_timeout_ms
• [7977] [DocDB] Send per tablet disk usage to the master via heartbeats
• [8002] [DocDB] Increase thresholds for master long lock warnings
• [8026] Bump up timestamp_history_retention_interval_sec to 900s
• [8027] A separate YSQL flag for yb_client_timeout
• [8037] [DocDB] Refactor memory management for tablets into a separate class
• [8052] Add ability to configure cipher list
• [8073] Drop rocksdb memstore arena from 128kb to 64kb
• [8330] [YCQL] Provide capability to skip writing null JSONB attribute in UPDATE statement
• [DocDB] Added a max_depth param to the mem-trackers view (#7903)
• Default fail_on_out_of_range_clock_skew=false

Yugabyte Platform

• [5296] Allow editing cloud provider in case of provider is not in use
• [5733] Disabled "stop process" and "remove node" for a single node universe
• [5946] Clock sync is now checked while creating or expanding the universe. Clock sync is added to health checks now.
• [6913] [6914] Add ability to reset slow query data and hide slow queries.
• [6924] When a node is removed/released from a universe, hide the "Show Live Queries" button.
• [7171] Added a validation that the on-prem instance type name cannot be the same for different customers on the same platform.
• [7193] Fixed issues with Run sample apps to have the deterministic payload and unify behaviour of YCQL and YSQL app.
• [7223] [7224] Added a new “Show Universes” action in the Actions menu. This provides a way for users to see all the associated universes that are using a particular KMS config. We are now also showing the list of universes as a modal dialog box associated with the certificate.
• [7311] Added appropriate warnings while using ephemeral storage for the cases like stopping a VM or pausing an universe as it will potentially lead to data loss.
• [7416] Platform: Changed default port of On-Prem provider to 22 (#7599)
• [7447] When universe creation is in progress, other operations which require the Universe in "ready" state should be disabled like "Edit universe", "Read replicas", "Run sample apps", etc.
• [7536] You can now specify an SSH username even when not using a custom key-pair.
• [7591] Added labeling for the Azure Instance Type dropdown similar to GCP/AWS.
• [7624] Removed refetch on window focus for slow queries
• [7706] Edit backup config credentials. (#8536)
• [7732] [UI] remove beta tag from Azure provider tab
• [7736] Change the username help info for certificate based authentication
• [7780] Fixed an issue causing old backups to not get deleted by a schedule.
• [7918] Add us-west2 GCP metadata to Platform
• [7950] Navigating to a universe with KMS enabled will show this error due if something has been misconfigured
• [8038] Default metrics button now points to the Prometheus metrics endpoint.
• [8051] Redact sensitive data and secrets from audit logs
• [8144] Validate custom certificates to ensure they are signed by the correct CA, and that the cert is for the correct node
• [8302] Added Platform's metrics endpoint (/prometheus_metrics) as a scrape target to the Prometheus instance that is configured as part of the Platform install
• [8460] Made proxy timeout configurable, Default value is 60 seconds.

Bug fixes

Core database

• [4412] [DocDB] Fix Load balancer state for move operations
• [4437] [8731] [DocDB] disabled bloom filters for master tablet and fixed DocDBAwareV2FilterPolicy compatibility for range-partitioned co-located tables
• [5854] [DocDB] Handling tablet splitting errors at YBSession level
• [6096] [YSQL] Fix crash during bootstrap when replaying WAL of deleted colocated table
• [6509] [YSQL] Fix leaking when a portal is used to query in small batches (refer to the note following this list)
• [6672] [DocDB] fix for deadlock in GlobalBacktraceState constructor
• [6789] [YSQL] Fix ysql_dumpall and ysql_dump to work with Tablespaces
• [6821] [7069] [7344] (YCQL) Fix issues when selecting optimal scan path
• [7055] [YCQL] Fixed bugs in processing LIMIT and OFFSET clause.
• [7324] [YSQL] Early bailout when bind condition is an empty search array
• [7369] [YSQL] Respect leader affinity on master sys catalog tablet
• [7398] [DocDB] Crashing after CopyTo from parent to child causes child bootstrap failure
• [7398] [DocDB] Forcing remote bootstrap to replay split operation causes seg fault
• [7484] [DocDB] Sort the hosts of tablet replicas consistently in Admin UI
• [7499] [YSQL] Import pg_dump: label INDEX ATTACH ArchiveEntries with an owner.
• [7602] [DocDB] FlushTablets rpc causes SEGV of the tserver process
• [7641] [YCQL] Fix checks in index update path that determine full row removal.
• [7678] [YSQL] Import Fix race condition in psql \e's detection of file modification.
• [7682] [YSQL] Import Forbid marking an identity column as nullable.
• [7702] [YSQL] Import Avoid corner-case memory leak in SSL parameter processing.
• [7715] [YSQL] Prevent DocPgsqlScanSpec and DocQLScanSpec from accepting rvalue reference to hash and range components
• [7729] Avoid recreating aborted transaction
• [7729] Fix checking ABORTED txn status at follower
• [7741] [YSQL] Import Don't leak malloc'd strings when a GUC setting is rejected.
• [7791] [YSQL] Import Fix psql's \connect command some more.
• [7798] [DocDB] Only the YB-Master Leader should refresh the tablespace info in memory
• [7802] [YSQL] Import Fix connection string handling in psql's \connect command.
• [7806] [YSQL] Import Fix recently-introduced breakage in psql's \connect command.
• [7812] [YSQL] Import Fix connection string handling in src/bin/scripts/ programs.
• [7835] Don't crash when trying to append ValueType::kTombstone to a key
• [7894] Keep ScopedRWOperation while applying intents for large transaction
• [7937] [YSQL] Avoid unnecessary secondary index writes for UPDATE on table with
• [7979] ysql Import Fix handling of -d "connection string" in pg_dump/pg_restore.
• [8006] [YSQL] Import Fix out-of-bound memory access for interval -> char conversion
• [8029] Fix slow queries failing to fetch on client-to-node TLS encrypted universes
• [8030] [YSQL] Import Redesign the caching done by get_cached_rowtype().
• [8047] [YSQL] Import Fix some inappropriately-disallowed uses of ALTER ROLE/DATABASE SET.
• [8065] [DocDB] Fix Sys Catalog Leader Affinity with Full Move
• [8079] Ensure leadership before handling catalog version
• [8101] [YCQL] Fixed CQLServiceImpl::Shutdown
• [8118] [YSQL] Import 'Fix memory leak when rejecting bogus DH parameters.'
• [8150] [8196] Fix preceding op id in case of empty ops sent to the follower
• [8204] [YBase] GetLoadMoveCompletionPercent returns an incorrect 100% if tservers haven't heartbeated their tablet reports
• [8254] No leader lease needed for BackfillIndex
• [8348] Correctly handling a failure to create a priority thread pool worker thread
• [8360] [YBase] Correctly compare running workers
• [8388] [YSQL] prevent temp indexes from using lsm
• [8390] Fix NPE Handling for indexed_table_id
• [8496] Downgrade gperftools to 2.7
• [8591] [DocDB] Add protection against missing UserFrontiers in older SST files during intents cleanup
• [8766] [DocDB] recreate table with the same name could cause insert to fail
• [8834] [YCQL] Remove incorrect CHECK condition added in D10931
• [9108] Tablespace task in YB-Master should skip system_postgres namespace
• [YSQL] Try all preferred zones in master sys catalog affinity task and suppress logs

{{< note title="New built-in functions" >}}
[6509] adds several new built-in functions that can be used to collect internal memory usage data:

• yb_getrusage() returns the output from the system getrusage() call.
• yb_mem_usage_kb() returns memory usage in kilobytes for the current session in the proxy server.
• yb_mem_usage() is the text version of yb_mem_usage_kb(). Returning a text value allows Yugabyte to provide more details than just the total usage.
• yb_mem_usage_sql_b and yb_mem_usage_sql_kb return memory usage in bytes and kilobytes respectively by the SQL layer of the current session in the proxy server.
• yb_mem_usage_sql returns SQL usage in text. The text value may contain more details than just the total usage.

These functions are enabled by default for new installations on 2.6. But, if you’re upgrading from v2.4 or an earlier version, you can enable them manually by adding them to pg_proc.
{{}}

Yugabyte Platform

• [1342] Fixing the error message when the get host info call to cloud providers fails
• [7007] Fixed an issue where Restore backup dialog allowed empty/no universe name selected.
• [7408] Retry Task button should not be visible for tasks other than "Create Universe" Task, as it’s the only task that supports retry.
• [7437] Since Kubernetes currently doesn't support read replicas, disabled it from the UI; k8s providers are also not shown when configuring a read-replica.
• [7441] Added field-level validation for User Tags to disallow "Name" as a key for a tag
• [7442] Only include the queries run by the user under slow queries
• [7444] Fixed an issue in Edit Universe, as user was able to edit User Tags but not save them
• [7554] Fixed an issue where error toaster appears even when the Provider is added successfully
• [7562] In case of Encryption at rest configuration fixed an error in configuring KMS provider.
• [7593] [7895] Fixed and issue where users Unable to create azure universe with custom image from image gallery
• [7656] After manually provisioning an on-premises node, create universe tries to use "centos" user, not "yugabyte"
• [7687] YSQL health check fails when YSQL auth is enabled
• [7698] Custom SMTP Configuration API returns unmasked SMTP password
• [7703] Can't send email for custom SMTP settings without authentication (empty username)
• [7704] Backup to S3 fails using Yugaware instance's IAM role
• [7727] [7728] Fix UI issues with k8s provider creation and deletion
• [7769] Prevent adding on-prem node instance with duplicate IP
• [7779] Health check fails on k8s portal for all the universes on clock synchronization with FailedClock synchronization and Error getting NTP state
• [7810] Health check emails not working with default SMTP configuration
• [7811] Slow queries is not displaying all queries on k8s universe pods
• [7841] Resume Universe Failure. (#7508)
• [7864] Delete associated backups after deleting the universe. (#8579)
• [7959] Disabling Node-to-Node TLS during universe creation causes universe creation to fail
• [7995] Enable SSH pipelining
• [8399] Fix read replica cluster addition failure
• [8426] Remove duplicate "Clock Skew Alert Resolved" messages
• [8503] Fix Add instance modal form to allow for adding instances in isolated region cases.
• [8525] Audit migration failed on AWS portal
• [8541] Returns bad request as a response when trying to create a provider with an existing name
• [8611] Enable edit backup configuration for the active tab only. (#8673)
• [8620] Reset the values on cancel. (#8626)
• [8742] UI shows blank page after clicking on the edit provider configuration button
• Universe alerts should be resolved when a universe is deleted (#7537)

Known issues

Core database

N/A

Yugabyte Platform

N/A

v2.4.5.0 - June 22, 2021

Downloads

Docker

docker pull yugabytedb/yugabyte:2.4.5.0-b20

Improvements

Core database

N/A

Yugabyte Platform

• [7706] Allow editing of backup config credentials. (#8535)

Bug fixes

Core database

• [4437] [8731] [DocDB] disabled bloom filters for master tablet and fixed DocDbAwareV2FilterPolicy compatibility for range-partitioned co-located tables
• [6096] [YSQL] Fix crash during bootstrap when replaying WAL of deleted colocated table
• [6482] Fix timeout handling when getting safe time in a RF1 cluster
• [7641] [8834] [YCQL] Remove incorrect CHECK condition added in D10931 (in 2.4.2.0 release)
• [8204] [Ybase] GetLoadMoveCompletionPercent returns an incorrect 100% if tservers haven't heartbeated their tablet reports
• [8390] Fix NPE Handling for indexed_table_id
• [8591] [DocDB] Add protection against missing UserFrontiers in older SST files during intents cleanup

Yugabyte Platform

• [6945] Add limit to customer task API. (#8700)
• [7859] Fix '< 1 min' uptime shown intermittently
• [8345] Remove hard coded cert filepath, and add Python module to use the system temporary directory
• [8611] Enable edit backup configuration for the active tab only. (#8674)
• [8620] Reset the values on cancel. (#8627)
• [8809] [Platform] Edit Configuration button was only working intermittently. (#8975)
• [8921] [Platform] Allow ReadOnly and BackupAdmin roles to change their password.

v2.5.3.4 - May 26, 2021

Build: 2.5.3.4-b1

YugabyteDB version 2.5.3.4 contains an important fix for a bug in a downstream dependency (the gperftools package). This tcmalloc memory allocation bug could lead to process crashes. If you're using a previous 2.5 version, please upgrade as soon as possible.

Refer to issue 8531 for details.

Downloads

Docker

docker pull yugabytedb/yugabyte:2.5.3.4-b1

Bug fixes

• [8496] Downgrade gperftools to 2.7

v2.7.1.1 - May 26, 2021

Build: 2.7.1.1-b1

YugabyteDB version 2.7.1.1 contains an important fix for a bug in a downstream dependency (the gperftools package). This tcmalloc memory allocation bug could lead to process crashes. If you're using a previous 2.7 version, please upgrade as soon as possible.

Refer to issue 8531 for details.

Downloads

Docker

docker pull yugabytedb/yugabyte:2.7.1.1-b1

New Features

Yugabyte Platform

Core Database

N/A

Improvements

Yugabyte Platform

• [5041] Added a health check for total memory(RAM) usage.
• [6555] Similar to scheduled backups, added an ability to provide retention duration for manual backups as well.
• [6913] For slow query monitoring, added an ability to reset stats with the new ‘Reset Stats’ button.
• [6913] [6914] Add ability to reset slow query data and hide slow queries.
• [6914] Added an ability to turn on query monitoring for slow queries. By default, query monitoring is turned off.
• [7215] Added an ability to select multiple backups for deletion rather than deleting individual backups.
• [7223] [7224] Added a new “Show Universes” action in the Actions menu. This provides a way for users to see all the associated universes that are using a particular KMS config. We are now also showing the list of universes as a modal dialog box associated with the certificate.
• [7278] [7446] Improved search usability for Live and Slow queries by adding autocomplete suggestions, better filtering and navigation.
• [7726] Health check now runs in parallel on all the universes rather than sequential.
• [7799] Added support for AWS GP3 volumes during universe creation from the Platform. The disk size and IOPS configuration for GP3 drives are configurable, whereas throughput is not configurable and is set to default value of 125MiB/sec.
• [7913] When upgrading a universe with read replica clusters, nodes in primary clusters are now always upgraded first, then read replica cluster nodes.
• [7967] Added ‘Download logs’ action under Nodes tab.
• [7970] Added a new ‘Backup Type’ label to distinguish YSQL and YCQL scheduled backups. For Yedis back type this field will be an empty string.
• [8038] Default metrics button now points to the Prometheus metrics endpoint.
• [8081] Added support for searching certificates by universe name in the Encryption-at-Rest. If there are more than 10 certificates, the user has to use pagination to search one page at a time to find the right certificate.

Core Database

Point-in-time restore progress

• [7126] Add restore_snapshot_schedule to admin
• [7126] Add yb-admin commands to create and list snapshot schedules
• [7126] PITR: Cleanup not restored tables and tablets
• [7126] PITR: Cleanup outdated snapshots
• [7126] PITR: Correct history retention for newly added tablets
• [7126] PITR: Load snapshot schedules during bootstrap
• [7126] PITR: Restore deleted table
• [7126] PITR: Special history retention mechanism
• [7126] PITR: Take system catalog snapshot
• [7126] [7135] PITR: Restore table schema
• [7137] PITR: Provide ability to create snapshot schedule for YSQL database and YCQL keyspace

TLS-related

• [6845] [YSQL] Introduce the 'use_node_hostname_for_local_tserver' gflag to use DNS name instead of IP for local tserver connection
• [7756] Make Encryption at Rest Code Openssl 1.1.1 Compatible
• [8052] Add ability to configure cipher list and cipher suites.

UI improvements

• [docdb] Added a max_depth param to the mem-trackers view (#7903)
• [7620] Refactor scoped leader shared lock instantiation
• [7199] track and display heartbeat roundtrip time from each yb-tserver in yb-master UI (#7239)
• [7543] docdb: Add uptime into master home UI
• [7484] docdb - Sort the hosts of tablet replicas consistently in Admin UI
• [7617] docdb: Record and display disk usage by drive
• [7647] docdb: Adds Num SST Files to TS tablets view

Performance improvements

• [7487] docdb - Remove unnecessary Value decoding and TTL calculation in doc_reader.cc
• [7661] docdb - Run manually triggered compactions concurrently
• [7798] DocDB: Only the YB-Master Leader should refresh the tablespace info in memory
• [7844] Set tcmalloc max cache bytes for yb-master similar to the yb-tserver.
• [7873] docdb - Initialize block cache for master/sys_catalog
• [7894] Don't create long operation tracker for empty ScopedRWOperation
• [8002] docdb: Increase thresholds for master long lock warnings
• [8015] Remove tablets belonging to the same table by taking table lock once
• [8037] docdb - Refactor memory management for tablets into a separate class
• [8071] Lookup HostPort in blacklist for TSManager::IsTsBlacklisted
• [8061] Iterate over copy of namespace_ids_map_ when listing namespaces
• [8133] remove CatalogManager::CheckOnline()
• [8167] Properly scope namespace read lock in CatalogManager::CreateTable()
• [8170] ybase: Check dirty bit of tablet metadata before issuing removal
• [8260] ybase: Use shared lock when checking table truncation / deletion

Tablet splitting

• [5854] docdb: Handling tablet splitting errors at YBSession level
• [6719] docdb: Added YBOperation table_partition_list_version checking
• [7108] [docdb] Disable tablet splitting during index backfill
• [8201] docdb: YBSession API cleanup

Load balancer and placement improvements

• [1479] ybase: Allow normal load balancing for DEAD+BLACKLISTED TS
• [3040] ybase: Allow global leader load balancing
• [6631] ybase: Allow support for prefixes while specifying placement info
• [6947] ybase: Allow leader balancing for DEAD nodes
• [7369] ysql: Respect leader affinity on master sys catalog tablet

T-server memory overhead

• [7804] docdb: Make WritableFileWriter buffer gflag controllable
• [7805] Share Histograms across tablets belonging to a table instead of having Histograms (in TabletMetrics and other objects) separately for each tablet.
• [8073] Drop rocksdb memstore arena from 128kb to 64kb

YCQL deferred index backfill

• [8069] YCQL: Basic support for deferred/batched index backfill
• [6290] [8069] Pt 2 & 3: CQL Handle partial-failures in a batch of index backfills.
• [8069] Add a yb-admin command to backfill tables with deferred indexes

Other core database improvements

• [1248] ysql: Create background task for verifying tablet data integrity
• [3460] YSQL: Integrate Orafce extension with Yugabyte
• [4580] add metric for wal files size (#7260)
• [4934] [7922] Thread safety improvements in the Transaction class
• [6636] docdb: Cache table->tablespace->placement information in YB-Master
• [6672] docdb: added explicit initialization of libbacktrace into InitYB.
• [7068] Allow reloading of the config file with 'ts-cli'
• [7324] YSQL: Early bailout when bind condition is an empty search array
• [7557] YCQL: Support != operator
• [7564] ybase: Auto tune ysql_num_shards_per_tserver similar to yb_num_shards_per_tserver
• [7632] ycql: Support upsert for jsonb column field values
• [7724] ysql: add GUC var yb_index_state_flags_update_delay
• [7916] CQL call timeout
• [7937] YSQL: Avoid unnecessary secondary index writes for UPDATE on table with
• [7977] [docdb] Send per tablet disk usage to the master via heartbeats
• [8026] Bump up timestamp_history_retention_interval_sec to 900s
• [8027] A separate YSQL flag for yb_client_timeout

Bug Fixes

Yugabyte Platform

• [5246] Fixed cluster_health to examine only local volumes and exclude nfs from consideration so that false alerts are not generated.
• [5733] Disabled "stop process" and "remove node" for a single node universe
• [5946] Clock sync is now checked while creating or expanding the universe. Clock sync is added to health checks now.
• [6019] Added an init container to yugabyte helm charts to wait for container to be ready
• [6924] When a node is removed/released from a universe, hide the "Show Live Queries" button.
• [7007] Fixed an issue where Restore backup dialog allowed empty/no universe name selected.
• [7171] Added a validation that on-prem instance type name cannot be same for different customers on the same platform.
• [7172] Added visual feedback for certain universe creation failures such as pre-flight validation failures or bad request response from API, etc.
• [7193] Fixed issues with Run sample apps to have the deterministic payload and unify behaviour of YCQL and YSQL app.
• [7311] Added appropriate warnings while using ephemeral storage for the cases like stopping a VM or pausing an universe as it will potentially lead to data loss.
• [7408] Retry Task button should not be visible for tasks other than "Create Universe" Task, as it’s the only task that supports retry.
• [7412] Make footer link buttons clickable
• [7415] Made secure the default configuration of SSH daemon by avoiding password authentication and PermitRootLogin in VMs
• [7416] Platform: Changed default port of On-Prem provider to 22 (#7599)
• [7421] Encryption is enabled by default for both client to node and node to node cases.
• [7432] In the case of the AWS provider, fixing an issue of ssh key name and private key were getting ignored.
• [7437] Since Kubernetes currently doesn't support read replicas, disabled it from the UI; k8s providers are also not shown when configuring a read-replica.
• [7441] Added field-level validation for User Tags to disallow "Name" as a key for a tag
• [7442] Only include the queries run by the user under slow queries
• [7444] Fixed an issue in Edit Universe, as user was able to edit User Tags but not save them
• [7447] When universe creation is in progress, other operations which require the Universe in "ready" state should be disabled like "Edit universe", "Read replicas", "Run sample apps", etc.
• [7536] You can now specify an SSH username even when not using a custom key-pair.
• [7554] Fixed an issue where error toaster appears even when the Provider is added successfully
• [7561] [7699] [7717] Fixed an issue in trying to force-delete a universe and you will be redirected to an error page on success.
• [7562] In case of Encryption at rest configuration fixed an error in configuring KMS provider.
• [7591] Added labeling for the Azure Instance Type dropdown similar to GCP/AWS.
• [7624] Removed refetch on window focus for slow queries
• [7656] After manually provisioning an on-premises node, create universe tries to use "centos" user, not "yugabyte"
• [7659] Non-replicated flow fails due to package requiring python3
• [7672] Cannot read property 'data' of undefined on Tasks -> Retry Task
• [7687] YSQL health check fails when YSQL auth is enabled
• [7698] Custom SMTP Configuration API returns unmasked SMTP password
• [7703] Can't send email for custom SMTP settings without authentication (empty username)
• [7704] Backup to S3 fails using Yugaware instance's IAM role
• [7727] [7728] Fix UI issues with k8s provider creation and deletion
• [7736] Change the username help info for certificate based authentication
• [7740] Prometheus going down silently after YW upgrade thru replicated
• [7769] Prevent adding on-prem node instance with duplicate IP
• [7779] Health check fails on k8s portal for all the universes on clock synchronization with FailedClock synchronization and Error getting NTP state
• [7780] Fixed an issue causing old backups to not get deleted by a schedule.
• [7810] Health check emails not working with default SMTP configuration
• [7811] Slow queries is not displaying all queries on k8s universe pods
• [7908] Added a fix caused while deleting a universe with a stopped node
• [7909] Fix issue with signature could not be verified for google-cloud-sdk for GCP VMs
• [7950] Navigating to a universe with KMS enabled will show this error due if something has been misconfigured
• [7959] Disabling Node-to-Node TLS during universe creation causes universe creation to fail
• [7988] Backup deletion failure should not cause retries
• [8020] To handle auth token expiration, added a global interceptor to catch all 403-code responses and redirect to the login page with a session expiration message in error toast. So when auth token expires background API calls won't fail silently anymore.
• [8051] Redact sensitive data and secrets from audit logs
• [8176] Fixed an issue of setting the max number of processes properly when deploying universes in GCP
• [8189] Make sure AWS instances with no EBS volume do not pass "Scratch" as default value
• [8243] Make Persistent storage default for GCP universe

Core Database

• [2977] docdb: CountIntents() should use shared tablet pointer
• [4250] ybase: Stop Load balancing for deleting/deleted tables
• [4412] docdb: Fix LB State for Move Operations
• [5380] Add re-try in postgres build when encountering transient error.
• [6096] ysql: Fix crash during bootstrap when replaying WAL of deleted colocated table
• [6615] [7693] [YCQL] Manifest generation for YCQL command for sample apps. kubectl command and docker command to run sample apps will be created automatically.
• [6672] docdb: fix for deadlock in GlobalBacktraceState constructor
• [6789] YSQL: Fix ysql_dumpall and ysql_dump to work with Tablespaces
• [6821] [7069] [7344] (YCQL) Fix issues when selecting optimal scan path
• [6951] [YSQL] Fix missed check of YBStatus
• [6972] Update local limit in case of a successful read
• [6982] [YSQL] Specify read time for catalog tables to guarantee consistent state of catalog cache
• [7047] [YSQL] Read minimal possible number of columns in case of index scan
• [7355] ysql: check backfill bad connection status
• [7390] Preflight checks should handle sudo passwords when given
• [7390] Rename V65 migration with R prefix
• [7398] docdb - Crashing after CopyTo from parent to child causes child bootstrap failure
• [7398] docdb - Forcing remote bootstrap to replay split operation causes seg fault
• [7455] [YCQL] Update index from transaction with cross-key statements.
• [7499] ysql: Import pg_dump: label INDEX ATTACH ArchiveEntries with an owner.
• [7534] YSQL: Support ALTER TABLE ADD PRIMARY KEY for colocated tables
• [7547] Set flags automatically based on the node's available resources
• [7600] [YSQL] Explain --masters in ysql_dump cli.
• [7602] docdb: FlushTablets rpc causes SEGV of the tserver process
• [7603] rocksdb: Calling memset on atomic variable generates warning (#7604)
• [7628] Add ldap libraries as special case for yb client packaging
• [7641] YCQL: Fix checks in index update path that determine full row removal.
• [7649] YCQL: Block secondary index creation on static columns.
• [7651] YSQL: Always listen on UNIX domain socket
• [7678] ysql: Import Fix race condition in psql \e's detection of file modification.
• [7682] ysql: Import Forbid marking an identity column as nullable.
• [7702] ysql: Import Avoid corner-case memory leak in SSL parameter processing.
• [7705] ysql: prioritize internal HBA config
• [7715] YSQL: Prevent DocPgsqlScanSpec and DocQLScanSpec from accepting rvalue reference to hash and range components
• [7729] Avoid recreating aborted transaction
• [7729] Fix checking ABORTED txn status at follower
• [7741] ysql: Import Don't leak malloc'd strings when a GUC setting is rejected.
• [7748] YSQL: ALTER ADD PK should do column checks
• [7791] ysql: Import Fix psql's \connect command some more.
• [7802] ysql: Import Fix connection string handling in psql's \connect command.
• [7806] ysql: Import Fix recently-introduced breakage in psql's \connect command.
• [7812] ysql: Import Fix connection string handling in src/bin/scripts/ programs.
• [7813] [YSQL] YSQL dump should always include HASH/ASC/DESC modifier for indexes/pkey.
• [7835] Don't crash when trying to append ValueType::kTombstone to a key
• [7848] Fix for yb-prof for python3
• [7872] Remove flashcache-related code
• [7894] Keep ScopedRWOperation while applying intents for large transaction
• [7939] Enforce password policy
• [7940] docdb: Unregister BlockBasedTable memtrackers from parent on tablet deletion
• [7944] ysql: deprecate flag ysql_wait_until_index_permissions_timeout_ms
• [7979] ysql Import Fix handling of -d "connection string" in pg_dump/pg_restore.
• [8065] docdb: Fix Sys Catalog Leader Affinity with Full Move
• [8006] ysql: Import Fix out-of-bound memory access for interval -> char conversion
• [8024] YSQL: Redundant read for create table with primary key
• [8030] ysql: Import Redesign the caching done by get_cached_rowtype().
• [8047] ysql: Import Fix some inappropriately-disallowed uses of ALTER ROLE/DATABASE SET.
• [8079] Ensure leadership before handling catalog version
• [8101] YCQL: Fixed CQLServiceImpl::Shutdown
• [8102] Traverse pgsql_ops_ once in PgDocOp::ProcessResponseResult()
• [8112] Correct string substitution in UpdateTablet()
• [8114] [YSQL] [backup] Partial index syntax error in the ysql_dump output
• [8118] ysql: Import 'Fix memory leak when rejecting bogus DH parameters.'
• [8119] ycql: Properly compare BigDecimals for equality
• [8150] [8196] Fix preceding op id in case of empty ops sent to the follower
• [8183] ysql: Import Always call ExecShutdownNode() if appropriate.
• [8225] YQL: Add missing makefile dependency
• [8496] Downgrade gperftools to 2.7

Known Issues

Yugabyte Platform

N/A

Core Database

N/A

YugabyteDB version 2.4.4.0 contains an important fix for a tcmalloc memory allocation bug which could lead to process crashes. This was caused by a dependency (the gperftools package). If you're using a prior version in the 2.4 series (2.4.1, 2.4.2, 2.4.3), please upgrade as soon as possible.

Refer to issue 8531 for details.

This bug does not affect version 2.4.0.0.

v2.4.4.0 - May 20, 2021

Downloads

Docker

docker pull yugabytedb/yugabyte:2.4.4.0-b7

Improvements

Core database

• [7651] YSQL: Always listen on UNIX domain socket
• [7873] [DocDB] - Initialize block cache for master/sys_catalog
• [8037] [DocDB] - Refactor memory management for tablets into a separate class

Yugabyte Platform

• [8302] Platform: Scrape platform prometheus metrics in replicated

Bug fixes

Core database

• [8388] ysql: prevent temp indexes from using lsm
• [8496] Downgrade gperftools to 2.7