Bot releases are visible (Hide)

yugabyte-db - v1.3.1 (July 31, 2019)

Published by rao-vasireddy about 5 years ago

Overview of Changes

[IMPORTANT] This version includes a backward incompatible file format change for YSQL. This means that if you have an existing cluster with YSQL schema, then you will not be able to connect to the YSQL database after upgrading to v1.3.1. There are two ways to work around this problem:

If you don't care about preserving your existing data, then you can delete your older cluster, upgrade to v1.3.1 and create a new cluster.
If you want to continue using your existing data, then please save your older data (in the form of SQL statements), delete the older cluster, upgrade to v1.3.1, create a new cluster and then load the previously saved data.

YSQL Changes

[YSQL] Fix error in nextval_internal retry.#1783
[YSQL] Support bulk inserts for COPY FROM command.#1590
[YSQL] Support for Triggers and Extensions.#1156
[YSQL] Simplify gflags enabling YSQL.#1691
[YSQL] Support NULLS LAST for SELECT.#1734

System Improvements

Extra cleanup of intents of aborted transactions to prevent repeated log messages.#1722
Cleanup checkpoints on startup.#498
Unified yb::RandomAccessFile and rocksdb::RandomAccessFile.#1661
Clear Pending Delete State on RPC Failure.#424
Do not crash yb-master process if we fail to find a namespace when listing tables.#1716
Allow consecutive master restarts to succeed.#1074
Change soft memory limit handling.#1437
Use log prefix in MvccManager.#1835
Fix handling timeout of a local call in the service.#1866
Fixed TS crash due to NULL name in the PTBindVar object.#1821
Add /tables view to tablet server ui.#1830
Add ability to avoid using the compaction thread pool for flushes.#1874
Tablet leader tracking at catalog manager.#1881
Allow in memory erase of intents.#1240
Fix assignment order of propagated_safe_time and propagated.#1889
Memory monitor should not flush tablet that is already flushing.#1880
Fixed potential race condition in memory-based flush.#1859

yugabyte-db - v1.3.0 (Jul 15, 2019)

Published by rao-vasireddy over 5 years ago

Overview of Changes

[IMPORTANT] This version includes a backward incompatible file format change for YSQL. This means that if you have an existing cluster with
YSQL schema, then you will not be able to connect to the YSQL database after upgrading to v1.3.0. There are two ways to work around this problem:

If you don't care about preserving your existing data, then you can delete your older cluster, upgrade to v1.3.0 and create a new cluster.
If you want to continue using your existing data, then please save your older data (in the form of SQL statements), delete the older cluster, upgrade to v1.3.0, create a new cluster and then load the previously saved data.

YSQL Changes

[YSQL] Enable DO statements (a.k.a anonymous blocks).#1656
[YSQL] Fix transaction read restart logic causing stale reads and lost writes.#1646
[YSQL] Enable beta-features by default.#1639
[YSQL] Fix value overwrite check in REPEATABLE READ isolation mode in YSQL.#1577
[YSQL] Allow SELECT from sequences.#999
[YSQL] Avoid auto-retrying non-DML requests.#1333
[YSQL] Set the read point correctly at REPEATABLE READ isolation when turning a read-only transaction into a read-write one.
[YSQL] Add new key column ybindexkeysuffix to YSQL index table [format change].#1058
[YSQL] Add support for setval().#1003
[YSQL] YSQL catalog cache consistency checking via tablet server shared memory.#1457
[YSQL] Fix persistence issue with catalog version.#1629

YCQL Changes

Added built-in function toJson() for YCQL SELECT statement.#992

System Improvements

Add Master UI page for tracking async tasks.#1145
Use rw_spinlock in meta cache to decrease lock contention.#1667
Change default maximum per-tablet RPC batch size to 32mb.#1440
Fix for flushing old tablets based on memory usage.#1672
Replaced OS_LINUX with linux for ifdefs.#1711
Unified yb::SequentialFile and rocksdb::SequentialFile.#1661
Add a compact_table command to yb-admin.#1735
Automatically filter out YSQL sys catalog tables from YBClient calls.#1537
Add TLS support to java yb-client.
Allow pausing a compaction when another compaction with a higher priority is scheduled.#1314
Fixed Tablet::Truncate to re-enable auto compactions.1765
Fix race condition in PriorityThreadPool.#1775

yugabyte-db - v1.2.12 (Jul 03, 2019)

Published by rao-vasireddy over 5 years ago

Overview of Changes

[IMPORTANT] This version includes a backward incompatible file format change for YSQL. This means that if you have an existing cluster with
YSQL schema, then you will not be able to connect to the YSQL database after upgrading to v1.2.12. There are two ways to work around this problem:

If you don't care about preserving your existing data, then you can delete your older cluster, upgrade to v1.2.12 and create a new cluster.
If you want to continue using your existing data, then please save your older data (in the form of SQL statements), delete the older cluster, upgrade to v1.2.12, create a new cluster and then load the previously saved data.

YSQL Changes

[YSQL] Fix scan operator when range key is not fully-specified.#1576
[YSQL] Fix ORDER BY range column of a secondary index.#1591
[YSQL] Add YSQL RPCs to tserver utilz page.#1446

System Improvements

Resolve ABA problem in LockFreeStackResolve ABA problem in LockFreeStack.#1561
Fix recursive locking in Batcher.#1584
Use boost::atomic for 16-bytes structures.#1189
Fix integer overflow during Raft log read path.#1606
Fix concurrent access to primary table info in RaftGroupMetadata.#1631
A new priority-aware thread pool implementation for compactions and flushes.#1314
Create mem trackers that reflects TC Malloc stats.#1633
Make sure we don't read an invalid replicate index from the footer.#1625

Performance Benchmarks

This section gives an overview of the performance of this release. The benchmarks were done on the following setup:

3 nodes with 16-vCPUs
Replication factor = 3
Each key-value is ~64 bytes (combined)
See setup details for more info

Summary

API	Workload	Type	Throughput	Latency	Avg CPU on DB node
YCQL	KeyValue	100% Reads	218K	1.17ms	48%
YCQL	KeyValue	100% Writes	73K	3.5ms	44%
YCQL	Batched Writes	100% Writes	247K	26ms	52%
YCQL	Secondary Index	100% Reads	187K	1.4ms	44%
YCQL	Secondary Index	100% Writes	5K	12.9ms	51%

Details

YCQL KeyValue

	Workload CassandraKeyValue with 256 writers and 0 readers: 
+--------------------------------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+
| Metric                         | mean      | min       | max       | std.dev   | median    | 1%        | 5%        | 10%       | 90%       | 95%       | 99%       |
| Read throughput, ops/sec       | 0         | 0         | 0         | 0         | 0         | 0         | 0         | 0         | 0         | 0         | 0         |
| Read latency, ms/op            | 0         | 0         | 0         | 0         | 0         | 0         | 0         | 0         | 0         | 0         | 0         |
| Write throughput, ops/sec      | 73037.05  | 68884.95  | 74102.43  | 1211.67   | 73480.55  | 68884.95  | 68884.95  | 71993.35  | 74051.57  | 74102.43  | 74102.43  |
| Write latency, ms/op           | 3.50      | 3.45      | 3.72      | 0.06      | 3.48      | 3.45      | 3.45      | 3.45      | 3.55      | 3.72      | 3.72      |
| Load tester CPU, user, %       | 16.91     | 14.90     | 18.10     | 0.88      | 17.30     | 14.90     | 14.91     | 15.18     | 17.70     | 18.08     | 18.10     |
| Load tester CPU, system, %     | 9.20      | 7.60      | 10.10     | 0.83      | 9.65      | 7.60      | 7.60      | 7.72      | 9.90      | 10.09     | 10.10     |
| Cluster node CPU, user, %      | 32.93     | 23.80     | 38        | 3.45      | 32.45     | 23.80     | 24.31     | 30.13     | 37.20     | 37.49     | 38        |
| Cluster node CPU, system, %    | 15.43     | 12.70     | 16.60     | 0.82      | 15.40     | 12.70     | 13.22     | 14.43     | 16.30     | 16.50     | 16.60     |
+--------------------------------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+

	Workload CassandraKeyValue with 192 writers and 16 readers: 
+--------------------------------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+
| Metric                         | mean      | min       | max       | std.dev   | median    | 1%        | 5%        | 10%       | 90%       | 95%       | 99%       |
| Read throughput, ops/sec       | 18493.93  | 17156.62  | 19190.41  | 587.15    | 18606.10  | 17156.62  | 17156.62  | 17440.30  | 19151.33  | 19190.41  | 19190.41  |
| Read latency, ms/op            | 0.87      | 0.83      | 0.93      | 0.03      | 0.86      | 0.83      | 0.83      | 0.83      | 0.92      | 0.93      | 0.93      |
| Write throughput, ops/sec      | 60571.82  | 58544.09  | 62509.31  | 983.23    | 60550.72  | 58544.09  | 58544.09  | 59035.93  | 62380.73  | 62509.31  | 62509.31  |
| Write latency, ms/op           | 3.17      | 3.07      | 3.28      | 0.05      | 3.17      | 3.07      | 3.07      | 3.08      | 3.25      | 3.28      | 3.28      |
| Load tester CPU, user, %       | 17.68     | 16        | 20.70     | 0.87      | 17.55     | 16        | 16.06     | 17.20     | 18.39     | 20.58     | 20.70     |
| Load tester CPU, system, %     | 8.73      | 8.10      | 10.40     | 0.54      | 8.50      | 8.10      | 8.11      | 8.22      | 9.58      | 10.36     | 10.40     |
| Cluster node CPU, user, %      | 35.62     | 32.90     | 38.80     | 1.71      | 34.95     | 32.90     | 33.41     | 33.72     | 38.10     | 38.39     | 38.80     |
| Cluster node CPU, system, %    | 15.38     | 14.90     | 15.80     | 0.19      | 15.40     | 14.90     | 15.01     | 15.10     | 15.60     | 15.70     | 15.80     |
+--------------------------------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+

	Workload CassandraKeyValue with 128 writers and 64 readers: 
+--------------------------------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+
| Metric                         | mean      | min       | max       | std.dev   | median    | 1%        | 5%        | 10%       | 90%       | 95%       | 99%       |
| Read throughput, ops/sec       | 71301.76  | 64468.86  | 78149.80  | 6074.55   | 69364.13  | 64468.86  | 64468.86  | 64563.72  | 78080.94  | 78149.80  | 78149.80  |
| Read latency, ms/op            | 0.90      | 0.82      | 0.99      | 0.08      | 0.92      | 0.82      | 0.82      | 0.82      | 0.99      | 0.99      | 0.99      |
| Write throughput, ops/sec      | 42974.61  | 40464.12  | 45473.25  | 1883.46   | 42860     | 40464.12  | 40464.12  | 40927.76  | 45053.88  | 45473.25  | 45473.25  |
| Write latency, ms/op           | 2.98      | 2.82      | 3.16      | 0.13      | 2.98      | 2.82      | 2.82      | 2.84      | 3.13      | 3.16      | 3.16      |
| Load tester CPU, user, %       | 21.46     | 19.10     | 23.30     | 1.28      | 21.60     | 19.10     | 19.15     | 20        | 23.08     | 23.29     | 23.30     |
| Load tester CPU, system, %     | 10.17     | 9.20      | 10.90     | 0.56      | 10.30     | 9.20      | 9.21      | 9.31      | 10.80     | 10.89     | 10.90     |
| Cluster node CPU, user, %      | 38.31     | 28.30     | 41.60     | 3.01      | 39.80     | 28.30     | 34.10     | 34.34     | 41.09     | 41.20     | 41.60     |
| Cluster node CPU, system, %    | 13.11     | 11.10     | 14        | 0.51      | 13.15     | 11.10     | 11.66     | 12.80     | 13.50     | 13.60     | 14        |
+--------------------------------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+

	Workload CassandraKeyValue with 64 writers and 128 readers: 
+--------------------------------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+
| Metric                         | mean      | min       | max       | std.dev   | median    | 1%        | 5%        | 10%       | 90%       | 95%       | 99%       |
| Read throughput, ops/sec       | 113115.50 | 111032.59 | 114690.37 | 1211.91   | 113593.04 | 111032.59 | 111032.59 | 111280.88 | 114639.78 | 114690.37 | 114690.37 |
| Read latency, ms/op            | 1.13      | 1.11      | 1.15      | 0.01      | 1.13      | 1.11      | 1.11      | 1.12      | 1.15      | 1.15      | 1.15      |
| Write throughput, ops/sec      | 21349.23  | 20717.49  | 21753.92  | 264.27    | 21335.10  | 20717.49  | 20717.49  | 20915.45  | 21699.52  | 21753.92  | 21753.92  |
| Write latency, ms/op           | 3.00      | 2.94      | 3.09      | 0.04      | 3         | 2.94      | 2.94      | 2.95      | 3.06      | 3.09      | 3.09      |
| Load tester CPU, user, %       | 23.54     | 21.80     | 27.90     | 1.24      | 23.50     | 21.80     | 21.81     | 22.03     | 24.36     | 27.72     | 27.90     |
| Load tester CPU, system, %     | 10.43     | 9.60      | 12.10     | 0.53      | 10.45     | 9.60      | 9.61      | 9.71      | 10.79     | 12.03     | 12.10     |
| Cluster node CPU, user, %      | 38.33     | 34.30     | 42.90     | 3.03      | 37.40     | 34.30     | 34.62     | 35.21     | 42.60     | 42.89     | 42.90     |
| Cluster node CPU, system, %    | 11.41     | 10.30     | 12.40     | 0.52      | 11.30     | 10.30     | 10.60     | 10.80     | 12.10     | 12.20     | 12.40     |
+--------------------------------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+

	Workload CassandraKeyValue with 0 writers and 256 readers: 
+--------------------------------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+
| Metric                         | mean      | min       | max       | std.dev   | median    | 1%        | 5%        | 10%       | 90%       | 95%       | 99%       |
| Read throughput, ops/sec       | 218803.58 | 209206.20 | 225392    | 4068.91   | 218849.97 | 209206.20 | 209206.20 | 213317.10 | 224702.67 | 225392    | 225392    |
| Read latency, ms/op            | 1.17      | 1.14      | 1.22      | 0.02      | 1.17      | 1.14      | 1.14      | 1.14      | 1.20      | 1.22      | 1.22      |
| Write throughput, ops/sec      | 0         | 0         | 0         | 0         | 0         | 0         | 0         | 0         | 0         | 0         | 0         |
| Write latency, ms/op           | 0         | 0         | 0         | 0         | 0         | 0         | 0         | 0         | 0         | 0         | 0         |
| Load tester CPU, user, %       | 31.19     | 13        | 34.70     | 4.52      | 32.20     | 13        | 13        | 30.10     | 33.10     | 34.70     | 34.70     |
| Load tester CPU, system, %     | 13.48     | 5.70      | 16.20     | 2.08      | 13.70     | 5.70      | 5.70      | 12.80     | 15.70     | 16.20     | 16.20     |
| Cluster node CPU, user, %      | 36.82     | 17.10     | 46.40     | 6.92      | 34.90     | 17.10     | 20.36     | 31.92     | 45.70     | 45.90     | 46.40     |
| Cluster node CPU, system, %    | 7.30      | 5.60      | 9.70      | 1.54      | 6.50      | 5.60      | 5.70      | 5.70      | 9.50      | 9.50      | 9.70      |
+--------------------------------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+

YCQL Secondary Index

	Workload CassandraSecondaryIndex with 64 writers and 0 readers: 
+--------------------------------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+
| Metric                         | mean      | min       | max       | std.dev   | median    | 1%        | 5%        | 10%       | 90%       | 95%       | 99%       |
| Read throughput, ops/sec       | 0         | 0         | 0         | 0         | 0         | 0         | 0         | 0         | 0         | 0         | 0         |
| Read latency, ms/op            | 0         | 0         | 0         | 0         | 0         | 0         | 0         | 0         | 0         | 0         | 0         |
| Write throughput, ops/sec      | 4957.63   | 4654.57   | 5466.63   | 190.85    | 4935.75   | 4654.57   | 4654.57   | 4701.88   | 5270.11   | 5466.63   | 5466.63   |
| Write latency, ms/op           | 12.92     | 11.71     | 13.75     | 0.48      | 12.96     | 11.71     | 11.71     | 12.15     | 13.61     | 13.75     | 13.75     |
| Load tester CPU, user, %       | 2.23      | 2         | 3.20      | 0.28      | 2.10      | 2         | 2         | 2         | 2.64      | 3.20      | 3.20      |
| Load tester CPU, system, %     | 1.55      | 1.40      | 1.80      | 0.11      | 1.50      | 1.40      | 1.40      | 1.40      | 1.80      | 1.80      | 1.80      |
| Cluster node CPU, user, %      | 32.02     | 29.60     | 33.70     | 0.96      | 32.20     | 29.60     | 29.70     | 30.62     | 33.26     | 33.38     | 33.70     |
| Cluster node CPU, system, %    | 19.25     | 17.80     | 20        | 0.52      | 19.30     | 17.80     | 18.06     | 18.42     | 19.88     | 19.94     | 20        |
+--------------------------------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+

	Workload CassandraSecondaryIndex with 32 writers and 64 readers: 
+--------------------------------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+
| Metric                         | mean      | min       | max       | std.dev   | median    | 1%        | 5%        | 10%       | 90%       | 95%       | 99%       |
| Read throughput, ops/sec       | 59031.00  | 57817.73  | 62446.65  | 1109.89   | 58745.42  | 57817.73  | 57817.73  | 58043.71  | 60768.14  | 62446.65  | 62446.65  |
| Read latency, ms/op            | 1.08      | 1.02      | 1.11      | 0.02      | 1.09      | 1.02      | 1.02      | 1.06      | 1.10      | 1.11      | 1.11      |
| Write throughput, ops/sec      | 3131.73   | 3076.68   | 3206.08   | 31.21     | 3127.82   | 3076.68   | 3076.68   | 3089.73   | 3176.39   | 3206.08   | 3206.08   |
| Write latency, ms/op           | 10.22     | 9.98      | 10.40     | 0.10      | 10.23     | 9.98      | 9.98      | 10.08     | 10.36     | 10.40     | 10.40     |
| Load tester CPU, user, %       | 14.97     | 14.20     | 15.70     | 0.41      | 15        | 14.20     | 14.20     | 14.52     | 15.62     | 15.70     | 15.70     |
| Load tester CPU, system, %     | 8.25      | 7.20      | 8.60      | 0.34      | 8.30      | 7.20      | 7.20      | 7.60      | 8.60      | 8.60      | 8.60      |
| Cluster node CPU, user, %      | 37.01     | 34.70     | 40.10     | 1.55      | 36.50     | 34.70     | 34.92     | 35.22     | 39.18     | 39.32     | 40.10     |
| Cluster node CPU, system, %    | 14.41     | 13.80     | 14.80     | 0.26      | 14.50     | 13.80     | 13.90     | 14.02     | 14.80     | 14.80     | 14.80     |
+--------------------------------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+

	Workload CassandraSecondaryIndex with 16 writers and 128 readers: 
+--------------------------------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+
| Metric                         | mean      | min       | max       | std.dev   | median    | 1%        | 5%        | 10%       | 90%       | 95%       | 99%       |
| Read throughput, ops/sec       | 104821.67 | 99481.21  | 120241.63 | 7320.25   | 101330.40 | 99481.21  | 99481.21  | 99546.21  | 119939.73 | 120241.63 | 120241.63 |
| Read latency, ms/op            | 1.23      | 1.06      | 1.29      | 0.08      | 1.26      | 1.06      | 1.06      | 1.07      | 1.29      | 1.29      | 1.29      |
| Write throughput, ops/sec      | 1949.49   | 1929.03   | 1990.20   | 17.51     | 1943.61   | 1929.03   | 1929.03   | 1931.10   | 1978.04   | 1990.20   | 1990.20   |
| Write latency, ms/op           | 8.21      | 8.04      | 8.29      | 0.07      | 8.23      | 8.04      | 8.04      | 8.09      | 8.28      | 8.29      | 8.29      |
| Load tester CPU, user, %       | 19.35     | 18.10     | 22.90     | 1.18      | 19        | 18.10     | 18.10     | 18.26     | 21.06     | 22.90     | 22.90     |
| Load tester CPU, system, %     | 8.89      | 8.40      | 10.30     | 0.59      | 8.60      | 8.40      | 8.40      | 8.40      | 10.06     | 10.30     | 10.30     |
| Cluster node CPU, user, %      | 40.96     | 36.50     | 44.20     | 2.31      | 41.90     | 36.50     | 36.72     | 37.20     | 43.18     | 43.62     | 44.20     |
| Cluster node CPU, system, %    | 11.82     | 11.10     | 12.30     | 0.33      | 11.90     | 11.10     | 11.10     | 11.20     | 12.20     | 12.24     | 12.30     |
+--------------------------------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+

	Workload CassandraSecondaryIndex with 0 writers and 256 readers: 
+--------------------------------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+
| Metric                         | mean      | min       | max       | std.dev   | median    | 1%        | 5%        | 10%       | 90%       | 95%       | 99%       |
| Read throughput, ops/sec       | 187239.42 | 185195.56 | 188133.96 | 804.53    | 187287.10 | 185195.56 | 185195.56 | 185805.85 | 188109.85 | 188133.96 | 188133.96 |
| Read latency, ms/op            | 1.37      | 1.36      | 1.38      | 0.01      | 1.37      | 1.36      | 1.36      | 1.36      | 1.38      | 1.38      | 1.38      |
| Write throughput, ops/sec      | 0         | 0         | 0         | 0         | 0         | 0         | 0         | 0         | 0         | 0         | 0         |
| Write latency, ms/op           | 0         | 0         | 0         | 0         | 0         | 0         | 0         | 0         | 0         | 0         | 0         |
| Load tester CPU, user, %       | 19.78     | 0.90      | 29.40     | 11.76     | 26.90     | 0.90      | 0.99      | 1.50      | 27.87     | 29.17     | 29.40     |
| Load tester CPU, system, %     | 8.55      | 0.70      | 14        | 4.88      | 11.45     | 0.70      | 0.74      | 1         | 11.80     | 13.67     | 14        |
| Cluster node CPU, user, %      | 34.88     | 12.30     | 48.50     | 9.85      | 36.65     | 12.30     | 16.62     | 22.21     | 48.20     | 48.36     | 48.50     |
| Cluster node CPU, system, %    | 8.70      | 4.30      | 17.20     | 4.21      | 7.70      | 4.30      | 4.50      | 4.67      | 16.56     | 16.93     | 17.20     |
+--------------------------------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+-----------+

YCSB

+--------------+----------------------+--------------------+--------------------+--------------------+
| Workload     | Throughput (ops/sec) | Op Type            | Avg Latency (us)   | 99th% Latency (us) |
| workloada    | 75054.10             | READ               | 2527.53            | 20895              |
|              |                      | UPDATE             | 4032.19            | 25391              |
|              |                      |                    |                    |                    |
| workloadb    | 89653.56             | READ               | 2711.76            | 7967               |
|              |                      | UPDATE             | 3391.83            | 8983               |
|              |                      |                    |                    |                    |
| workloadc    | 89456.49             | READ               | 2753.47            | 7939               |
|              |                      |                    |                    |                    |
| workloadd    | 87712.48             | READ               | 2765.26            | 8327               |
|              |                      | INSERT             | 3598.85            | 9671               |
|              |                      |                    |                    |                    |
| workloade    | 16485.62             | INSERT             | 14684.71           | 70847              |
|              |                      | SCAN               | 14963.57           | 70271              |
|              |                      |                    |                    |                    |
| workloadf    | 49282.21             | READ               | 2956.77            | 20815              |
|              |                      | READ-MODIFY-WRITE  | 7039.35            | 29743              |
|              |                      | UPDATE             | 4074.65            | 23871              |
|              |                      |                    |                    |                    |
+--------------+----------------------+--------------------+--------------------+--------------------+

yugabyte-db - v1.2.4 (Apr 02, 2019)

Published by rkarthik007 over 5 years ago

Overview of Changes

[IMPORTANT] This version includes a backward incompatible file format change for YSQL. This means that if you have an existing cluster with
YSQL schema, then you will not be able to connect to the YSQL database after upgrading to v1.2.4. There are two ways to work around this problem:

If you don't care about preserving your existing data, then you can delete your older cluster, upgrade to v1.2.4 and create a new cluster.
If you want to continue using your existing data, then please save your older data (in the form of SQL statements), delete the older cluster, upgrade to v1.2.4, create a new cluster and then load the previously saved data.

YSQL Changes

Added support for primary keys. It is now possible to create a table with a primary key. #955
Added support for temporary tables. #805
Added support for CYCLE option in CREATE SEQUENCE statement. #993
Enabled SET TRANSACTION READ WRITE statement. #1081
Support RelationType in TableInfo to distinguish between system tables, user tables and user indexes. #906

Bug Fixes

Fixed a crash in tserver that is observed while inserting null value into an indexed column. #945
Fixed a bug where indexes on system catalog tables were not being updated during DDL. #1083
Fixed detection of single row transactions on tables that have primary keys.
Fixed MiniMaster startup race condition in test infrastructure. #1040

System Improvements

Reduce per-connection overhead for cache preloading. #1090 #1091
Faster release of sending buffers to reduce memory consumption when leader sends large updates to followers who are lagging behind. #1079
Parallelize DNS resolution while filling system.peers and system.local tables #1000
Script for post-processing test results and generating JSON-based result files.
Improve stability of QLTransactionTest.IntentsCleanupAfterRestart. #1102

Key Commits

[f2ecaa1] [YSQL] Fix single-row-txn detection after primary key change
[90680ca] [#1102]: Improve stability of QLTransactionTest.IntentsCleanupAfterRestart
[a4c614f] JSON-based test reports
[33835b0] [#1079]: Release sending buffers as soon as possible
[1bc77da] ENG-4682 (#906): Support RelationType (user table, index, system table) in TableInfo
[1dedcd1] ENG-4943 #945 [YSQL] Correct handling for NULL value in indexed column
[465b6d6] [YSQL] #1090 #1091 Reduce per-connection overhead for cache preloading
[382b89c] [YSQL] ENG-4601 (#805): Add support for temporary tables
[5165f01] #1081 [YSQL] Enable READ WRITE transaction
[9f31c41] ENG-4927: #1040: Fix MiniMaster startup race condition
[be0908b] [YSQL] #955: Handle primary key as an index
[4b48e25] ENG-4872: #1000: Parallel DNS resolution while filling system.peers and system.local tables
[4096f59] ENG-4900: Add external mini cluster test with TLS support
[34ee0fc] [YSQL] #1083: Handle sys catalog index updates
[ac52116] #993: [YSQL] Add support for CYCLE option in CREATE SEQUENCE
[3149f36] ENG-4363, #668: Support JSON operator on INSERT (Part 1 - Refactoring)
[a3ea483]
[b3a60ee] [yb-docker-ctl] Save initdb log (#1087)
[b131fbc] ENG-4888: #1031: Make YCQL index name optional
[9d333f7] #1064: Fix data race with YQL permissions cache
[4a56fe1] #1038: Change FLAGS_remote_boostrap_rate_limit_bytes_per_sec to FLAGS_remote_bootstrap_rate_limit_bytes_per_sec
[56a6029] #752: Add TLS encryption support to yb-admin.
[d9b6385] [YSQL] #1066: Fix memory leak in ResourceOwner
[fb4c1a2] Added yb-docker-ctl to CE (#1077)
[046b4b6] ENG-4855: #977: Handle restart read in YSQL
[30725bf] ENG-4343: #655: Pick transaction read time at tablet server when possible
[0341b29] [YSQL] #1067: Buffer create index write operations only for initdb
[78ca75a] [#1050]: Add Tablet Server capabilities
[9d724d5] ENG-4790: Removing most of yb-loadtester from repo due to migration to standalone yb-sample-apps repo
[bbcc67b] ENG-4891: Removing the SQL RPCs button.
[14279cc] [YCQL] #1042: Fix ASAN issue in YCQL executor restart
[cc3584f] ENG-4800: #952: Use call buffer for receive from socket
[8715be3] [YSQL] #1051: Bulk insert in initdb
[987abc6] ENG-4877 (#1009): yb-ctl enhancements
[0f261a9] [YSQL] 1049 ASAN reported memory leaks in Postgres
[9eaf15b] Add a new pattern for NFS directories: /Volumes/net
[3a61698] [#1041]: Skip dumping of finished call
[a322d95] [YSQL] #711 Add support for all datatypes
[7e2c89c] [#1030]: Add transactional retry writes tests 2) Second
[request]licated. Fixed by returning AlreadyPresent status and handling it in
[callbac] not handled correctly. For instance when request cannot be processed because of service shutdown, we could stop retrying to apply the operation. Fixed by correct handling of such errors.
[509c5a2] #921: Fixed: [YCQL] improve error messages related to index DDL
[e48b7da] ENG-4468: Always perform only one server rpc call for readiness check.
[0f8fdd9] [YSQL] ENG-4831 (#969): Enable drop cascade
[85836b5] Allow spaces around equality sign in @RunWith(value=SomeClass) annotation
[e533efc] ENG-4844, #949: Treat TUPLE as a keyword
[40dd31f] [#984]: Allow running C++ test by specifying only gtest_filter
[9cb4f10] ENG-4746: #925: Implement change_blacklist & get_universe_config commands in yb-admin
[9e28eee] [YSQL] #995: Raise error on unsupported WHERE condition with secondary index
[9fd097e] [#965] Reduce the number of concurrent connections to YB masters and tservers from PostgreSQL backend processes
[7ea3cd0] [YSQL] ENG-4839 (#976): Handle postgres session termination correctly in YB mode
[f55f1c0] #991: Fixed TestRpc.TestDisconnect
[aa8c4ec] #999: [YSQL] SELECTing directly from a sequence throws an error
[8d226ce] ENG-4852: Do not pass Datum data types to ybc_pgate
[f702d72] [YSQL] #979: Fix ORDER BY query using secondary index
[66a94f3] ENG-4840 (#987): Fix incorrect count for system tablet leader count
[c847562] #964: Change compaction and remote bootstrap rate defaults.
[5ed041c] #788 Optimize select statements where a clustering-key needs to be in a given range
[0c00885] [#933]: Leader lease revocation
[03b996d] ENG-4746: #925: Migrate missing java yb-cli functionality to yb-admin (Preparation)

yugabyte-db - v1.2.0 (Mar 12, 2019)

Published by rkarthik007 over 5 years ago

Overview of Changes

Theme of this release: PostgreSQL, PostgreSQL, PostgreSQL! YSQL is a distributed PostgreSQL that can scale-out, tolerate failures and has no single point of failure.

Support has been added for a ton of Postgres functionality. The following is a list of some of the functionality:

DDL statements

CREATE, DROP and TRUNCATE tables

Data types

All primitive types including numeric types (integers and floats), text data types, byte arrays, date-time types
Support for UUID and SERIAL
Support for JSONB

DML statements

INSERT, UPDATE, SELECT and DELETE statements
JOIN, WHERE clauses, GROUP BY, ORDER BY, LIMIT, OFFSET and SEQUENCES

Transactions

ABORT, ROLLBACK, BEGIN, END, and COMMIT

Miscellaneous

Expressions: Built-in functions and operators
VIEWs
EXPLAIN PLAN
PREPARE-BIND-EXECUTE
JDBC Support

Key Commits

[aef1a1f] ENG-4683 (#874): Fix user table UI to exclude transactions and sequences tables
[c60921f] ENG-4681 [YSQL] Support INTERVAL for date/time datatypes
[4927d38] [YSQL] ENG-4807 (#957) Fix logs wrongly reporting that YugaByte transactions are not enabled
[4e69172] ENG-4780 (#930): Fix postgres server crash while creating index on existing table with data
[f004732] #972: ENG-4808: Fixed TabletInvoker::SelectTabletServer
[652bb5e] [#959]: Groups threads by stack trace in /threadz
[d33eaa9] #665: [YSQL] Enable support for sequences
[53a1331] ENG-4801 (#944): yb-ctl improvements for easier onboarding
[dce09da] ENG-4585: #796: Created test that covers case when thread pool is not yet ready for intents cleanup
[bb40833] ENG-4468: (#871) Add support for checking if tserver is ready for IO requests.
[e570c1c] [ENG-3928] [#967] Wait for NFS-based paths to exist in run_tests_on_spark.py
[3399b88] [YSQL] #255: Separate YCQL, YSQL and YEDIS namespaces
[064d366] ENG-4749: #887: Handle failure of delete at start of iteration in PgLibPqTest.SerializableColoring test
[88bb343] #961 Fix instantiation of round-robin policy
[1037c47] ENG-4577: Log Replay Count Bugfix and Test #782
[57ca114] ENG-4725: #932: Write RPC should take into account retryable_rpc_single_call_timeout_ms
[e9424ab] [YSQL] #943 Optimize single-row write transactions to avoid distributed txn path.
[c545fb5] ENG-4783: Misc fixes in shared lock manager
[45bc122] ENG-4783: Fixed LockBatch move ctor/assignment
[3db5d55] Cleanup of stray processes, NFS issues workaround, DXR integration, adjusting RPC timeout and using random PG ports in YSQL
[36431db] Update PostgreSQL code as of the following commit:
[3952394] [YSQL] ENG-4757: #902: Restart transaction when it was first executed operation and read restart is required
[d563e50] ENG-4577: Log Replay Count Bugfix and Test #782
[1ed9e95] ENG-3558: #920: Replace our own implementation of VarInt with BIGNUM from OpenSSL
[2f6dedc] [#836][ENG-4638] Fix KEYS to not Surface Deleted Keys
[7cf6ccd] [#918]: Add a pool of pre-created transaction records to avoid a Raft round-trip for transaction creation on the write path
[7b59cc8] #897: Fixed yb-tserver failure on SELECT COUNT(column) where column contains null value
[b0314eb] [YCQL] #916 Making STATIC an unreserved-keyword. Removing REFERENCES from keyword list.
[c886b86] [YSQL] #917: Support DROP INDEX
[81a80ab] [YCQL] (#878) : Add uuid() builtin function support.
[99cc736] ENG-4672: Provide more information (version,
[a101e74] ENG-4656 (#852): Enabled pg_depend
[c839f8c] Avoid using NFS-shared local Maven repository directory for running Java tests on macOS
[396ff88] [#914]: Split doc_operation into multiple files
[78776a5] [YCQL] #835 Allow OFFSET to be used as column names and identifiers
[362502d] ENG-4636 (#834): Make transaction failure messages more user friendly
[a746743] #904: ENG-4735: Fixed race between deleting obsolete files and creating new output SST file
[845cdb4] ENG-4717: #891: Not submitted write operation should block tablet peer shutdown
[1125d1e] #771 [YEDIS] Close connection on pub/sub limit
[ae1e30c] #768 Ping in subscribe mode should return a multi-bulk string
[dd97847] [YSQL] ENG-4734 Fix data race with ysql_catalog_version #903
[08c9bbf] ENG-4410 (#696): Retry resolving master addresses instead of erroring out immediately
[3ce7386] ENG-4680 (#873): Save postgres logs in tserver/logs directory
[1dd8e4b] ENG-4692 (#868): Enable access share mode for table lock
[63a0d61] ENG-4692 (#868): Enable support for read only transactions
[3779a86] #862: ENG-4728: Use libbacktrace only in debug builds and in single-threaded mode to avoid high memory consumption
[827ff02] [YSQL] Basic framework for cache consistency with multi-head DDLs #679
[299c718] Add pre- for leader election logging
[bfd2019] #895: Rate-limit the warning of unsupported YCQL consistency level.
[ff38980] Break the long test TestPgRegressPgTypes into two separate tests
[492c67c] Bump up master memory limit threshold for ASAN and TSAN
[abc6a2e] ENG-4680 (#873): Save postgres logs in tserver/logs directory
[ff9f36d] ENG-3648: #604: Preelections
[48411de] ENG-4713: Correctly handle openssl buffer overflow
[ec5cdf5] ENG-4522 (#769) : Support for ALTER TABLE command
[ce84a16] #821: Fix the race condition that causes the master to get stuck on aborting tasks.
[b7989a7] [ENG-4658] Work around for the "shuf: No such file or directory" error when trying to a pick worker host for remote compilation
[c87cc63] BUG: fixed memleak by destroying icu Timezone
[aefcb85] Using YugaByte BINARY internal type to store UUID
[99c7f6c] Fixed bugs when appending data of type CHAR(n) to tuple
[b75341a] [YSQL] ENG-4538, #711: DATE and TIME support
[95f0718] [#862] Upgrade to gperftools 2.7 to pick up tcmalloc bug fixes
[6444b19] [ENG-4666] [#862] Implement a global memory limit for the master and stop the master if exceeded
[edaa248] Improvements to yb_money, yb_numeric and yb_numeric_big tests
[5b73676] #798: Concurrent create-table calls can result in "Table Not Found"
[1305434] [YSQL] #865 Fix crash when copying heaptuple
[7f35bad] [#867]: Add deadline to DocDB lock manager
[3f939b4] ENG-4602: [YCQL] Add support for more timezone formats #806
[4e93a27] ENG-4646, #711: Enable support for MONEY datatype
[fb7333b] Add LLVM 6.0.1 back as an option in thirdparty
[61516d1] #843: Fix a bug in YBCInitializeRelCache that was causing the default values for tables to be loaded incorrectly
[e5edba5] ENG-4079: #673: Add serializable isolation support to YSQL API
[57ad672] ENG-4352: #662: Add more RPC related Metrics
[cf12af0] ENG-4605 (#813): Fix log warning for master replicas This
[0c8f53b] Move imported tests to yugabyte/java/yb-jedis-tests/src/test/java/redis/
[b9ac01b] [YQL] #807 Support for UUID Datatype
[8b86a63] (#641): Allow num_cpus to be explicitly passed for container environments; use std:🧵:hardware_concurrency() as default
[b5464c9] ENG-4537: #711: Decimal/Numeric support
[fade5be] [YSQL] #715 Fixed "=" operator for char-based datatype.
[4066f1e] [YSQL] (#559) Support secondary index in DML
[8af2a9e] ENG-4617: Added yb_completed_tests folder to track finished Mac Jenkins tests
[a2850d7] ENG-3271: JSON secondary indexes on attributes (PART 2) #741
[41ef4e3] ENG-4614 (#820): UPSERT of JSONB column should not crash the server
[f9fc9b2] [YSQL] #711 Framework for DataType Support
[2aafd92] [ENG-4578] [#783] Create Memtable Arena Allocation Gflag
[e60e3ec] Import tests from YB-JEDIS into Yugabyte
[e1a073c] [#760] AtEOXact_Snapshot should set FirstXactSnapshot to false on exit in YugaByte-enabled mode
[676797a] [#839] Fix a bug in migration from old to new intent type set format
[823ff34] #822: ENG-4624: Do not retry at ql/executor layer on a timeout; timeout retries already happen at ybclient layer
[b56ee9e] #824: Only count votes from VOTERS in the active config for determining replicated OpIds
[a3fe830] [#828]: Disable transaction RPCs timeout in QLTransactionTest.ChangeLeader
[2b63f89] [YSQL] #714 Fix wrong syscatalog metadata after create table failure
[dba6d1f] ENG-4626: Improve TLS certificate verification failure reporting
[48b225c] ENG-4079: #673: Handle SELECT statements without a WHERE clause in a transaction with serializable isolation
[3aa3aff] [YSQL] (#761) Enable YugaByte distributed transactions in the PostgreSQL API by default
[1970e09] ENG-4619: During a partition, tservers can log ~250,000 "Leader Master has changed" messages per minute #823
[4ecd7dd] ENG-4593 (#826) Enable JSONB functions and add tests
[f68aaa8] [#825]: Decrease number of concurrent threads in SerializableTxnTest.Increment in sanitized mode
[0f8d64f] ENG-4581: #792: Disable compactions until tablet bootstrap is done
[0e53760] #750: ENG-4499: Changed status code names and phrasing to eliminate "SQL"
[ece81a5] #631: [YSQL] Enable not null constraints and check constraints
[b0c357b] ENG-4461: #723: Use consistent read snapshot for operations within a SQL statement
[ef8a651] #817: ENG-4595: Don't use consistent read point for single shard operations
[2712401] [YSQL] ENG-4572 #814 Clean up stray backends after tests.
[9d1e3a8] [#812]: Use yb::Thread in rocksdb ThreadPool
[c463104] ENG-4566: #795: Use DNS names when validating TLS certificate
[28d67dd] Splitting PgRegress testsuite to avoid TIMEOUT
[19fa40b] ENG-4496: Add hostname and username to YB diagnostic information (call-home)
[26d06db] ENG-743 (#793) : [YSQL] Support COPY statement
[11ed907] [#803]: Increase timing in RpcStubTest.TestDontHandleTimedOutCalls
[326501f] ENG-4351: #661: Show out of limit memory consumption in web interface
[268b438] [YSQL] #699 Enable Support for SET, SHOW, and RESET
[fab7fe4] ENG-4501 (#745): fix incorrect LOG line reporting flush/compaction stats
[55968b6] ENG-3271: JSON secondary indexes on attributes #741
[3f40371] ENG-4423 (#707) : added statement to logtrace for CQL and Redis
[fbb88ab] [#791]: Handle case when thread pool is not yet ready for intents cleanup
[e15bdb9] [YSQL] #712 Support COUNT(table.) and fix COUNT() for tables without primary key
[c8dc68c] ENG-4564: Added python@2 to brew install
[afc3cce] [#779]: Store postgres table metadata in all master replicas
[f8d1e03] [YSQL] #786 Raise error for indexing on column of unsupported type
[1aee234] [#784] Correctly set flushed frontier to the given value in a version edit
[ebedb36] #559: [YQL] Basic Postgres secondary index support
[c2651f8] [YSQL] #698 Support for CREATE TABLE AS SELECT
[766761e] (#710) [YSQL] support for pushdown of bind variables
[7457a46] [#781] Report elapsed time and timeout for synchronous leader master RPCs
[5860eb6] [#780] Flushed frontier should be allowed to go back when restoring a snapshot
[75045b6] ENG-4535: Fix for thirdparty libs build is failing on "include-what-you-use" for gcc builds
[66dd49b] [#773] [ENG-4531] Fix a bug with recovering flushed OpId and hybrid time on tablet server restart
[444e5dd] [#650]: Exit postgres when tserver is closed
[f9b8162] ENG-3501: Extended set of cassandra C++ driver test cases.
[41055f2] #766 Add a redis_version section to the redis INFO string
[8a30216] ENG-4479 #740 Use PostgreSQL process started by tablet server for Java-based PostgreSQL API tests
[70218be] [#767]: Don't use custom leader_failure_max_missed_heartbeat_periods in MasterFailoverTest
[d80be8f] Fix unstable TTL test TestRedisService.TestTtlPrimitive
[9ed0489] #632: [YSQL] Re-enable default values for columns in PostgreSQL tables
[a6a27e9] #700: A user must have the ALTER permission on a table to create an index on it
[cb025d6] ENG-3413: CreateTable should take into account blacklisted nodes #314
[718d6df] #577: Add leader status cache to avoid locking replica state
[64ad445] [#756]: Transaction with serializable isolation should not conflict with committed transaction
[34c576c] Enabling Clang static analyzer and add the include-what-you-use tool
[0fbc88e] Disable pg_wrapper-test in TSAN mode
[a0c220f] [#748]: Check if the leader is ready while updating propagated safe time
[3ff5e5e] Basic Tests Tracking Supported Features
[dc42ea0] #749 Persist co-located table metadata in tablet metadata
[69394aa] Cleanup PgStatement to return statement type via a virtual function
[13fa8cb] [#747] Fix TSAN issues in QLTransactionTest.WriteConflictsWithRestarts
[dc11643] Remove old unused cache and nvm_cache files and the nvml dependency
[cb5ea06] ENG-4350: #660: Don't replicate lease before replicating no op
[42eecc6] #746: Remove file block manager
[af08421] ENG-4079: #673: Add read intents for serializable isolation during write
[77bbc16] ENG-4340 #651 Reduce initdb log spew
[5835be4] #730 Fix flushed frontier going backwards during a compaction
[05659bc] Update boost source tarball checksum in thirdparty_src_checksums.txt
[72a5447] #704 Return a "Snapshot too old" error on attempts to read compacted-away data, e.g. during very long-running transactions
[9a60540] [YSQL] #658 RETURNING Support
[12a688d] ENG-4424: #708: Increase timeout waiting for transactions cleanup in tests
[77cbebd] ENG-4429: Fixed yb_release prefix handling for symlinks
[2007245] #709 Skip rebuilding PostgreSQL if it has not changed since previous build
[03c18ce] ENG-4383: Added bin/psql symlink into release
[5fe8101] [#706]: Treat not found transaction as aborted It does not check result of write operation, so it could try to
[3ed9810] [#705]: Hold mutex while updating obsolete_manifests_
[0f2a0c1] #653: Disable replica cache refresh by default.
[3d5122c] ENG-4079: #673: Replace intent type with intent type set
[986d014] [YSQL] #693 TRUNCATE Support
[8a4cdef] [#691]: Wait for tablet peer leadership in TabletServerTestBase
[f938535] [#690]: Increase allowed error for MacOS in TestMonoTime.TestCondition
[b395f07] [#689]: Use proxy_uuid in system.peers
[5d87393] [#688]: Use correct path for FSManager in TabletServerTest.TestRpcServerRPCFlag
[5398a99] [ENG-4172] [#569] Introduce Timeout to DocDB Range Scan Queries
[aad6e5e] ENG-4394: Fixed DBImpl::NotifyOnCompactionCompleted
[87ef37d] #687: Fixed QLTabletTest.GCLogWithRestartWithoutWrites/GCLogWithoutWrites TSAN issue
[250aaad] [ENG-3923] #336 Handle slow subscribers
[85d662d] #683: Pick better auto defaults for max_background_flushes
[d66fab0] Re-enable transactions in PostgreSQL
[c8a8f22] ENG-4027: Freezing Linuxbrew
[e989665] ENG-4353: #663: Release buffers when Socket is closed
[d18616c] ENG-4079: #673: Persist "read intents" for read operations done as part of serializable read-write transactions
[6fad9ea] ENG-4386: Postgres libs linking order is wrong
[9903b97] [#682]: Increase lifetime of Rpcs object used by heartbeater
[7aa6a27] #653: ENG-4341 - Refresh tablet replicas periodically for ConsistentPrefix reads
[3a276ba] Refreshed the README on github
[0b062e5] [#680]: Suppress dwarf_lookup_pc
[c611ff3] #677: ENG-4389: Master process can fail on startup if FQDN is not resolvable yet.
[0aa5d44] Disable a couple of tests on macOS after enabling test parallelization
[56b3bfe] #676: ENG-4388: psql wrapper script needs to be updated
[94ef7cf] [ENG-4233] Fix Failing Read Replicas
[4d6a913] #654 Allow for disabling load balancer for cql load tester
[d3c895e] #675 Fix broken table links in yb-master Web UI.
[c8cbfb9] Run tests in parallel using Spark on macOS (as we already do on Linux)
[3aee3ba] [YSQL] #565 UPDATE support
[c81947c] #674: Reduce duration of lock on catalog manager for Postgres sys catalog read and write operations.
[c7f8499] #639: Basic Postgres schema support
[f8de7c4] #243: Fix thread restriction under RemoteTablet::GetRemoteTabletServers().
[20afe12] [#672]: Remove cpp_redis and tacopie from 3rd party libraries
[067963c] #638: Support Postgres tables without user-specified primary key.
[78cddf4] #611: Support new Cassandra Java driver versions
[3832009] ENG-4079: #673: Extract base class and utility functions from QLTransactionTest
[ae39261] #670: Fix SEGV when setting paging state on uncovered index query.
[e001a9d] [#671]: Enable Thread Safety Analysis in Clang
[8729c04] #554 [YSQL] Move PostgreSQL catalog tables to YugaByte Master
[0edd204] ENG-4280 #615 ENG-4283 #618: Take prefix locks for rows with compound primary keys
[25d12de] #488: ENG-3917: Occasional delay in deletion of compacted files.
[0c3e33f] [YCQL] #589 Update YugaByte scanner to match BISON's new API
[89d4d63] Limit total size of mini-cluster logs in C++ and Java; fix remote_build.py
[98ebafb] [ENG-4263] #597: Implement Rename as a best effort mechanism.
[bcefe70] #516: Remove psql from the bin directory in the distribution package and remove psql third-party dependency
[4916c63] ENG-4334: #642: Fix double registration of write request
[fc2f99e] ENG-4335: #644: Fix TrimTrailingWhitespaceFromEveryLine
[f90bf4b] [YSQL] #645 Seg fault occurred when deleting from table
[6e798f9] #640: Use call_once for InitializeSystemInfo
[6e5454c] #632: [YSQL] Enable default values for columns in YSQL
[2d5e4a0] Fix a bug with local-command(s)/keys in a redis pipeline.
[f78748c] #552: DELETE statement support in PostgreSQL
[7e8a990] ENG-4129: Fix RateLimiter tests for MacOS
[6201f0b] Remove restriction on source addresses of PostgreSQL connections
[c9a6663] ENG-4291: #626: Handle term change correctly during sys catalog load
[da1abd3] #636: Changing yb-ctl to start PostgreSQL child process in each tablet server
[4c08e34] #596: ENG-4228: Remove failed non-voter replicas unconditionally
[a88cd0e] ENG-4282: #617: Fix IsRangeOperation for the case when range key is partially specified
[7577fc3] #630: Run PostgreSQL as a child process of tablet server
[f8162af] ENG-4281: #616: Fix order of release lock and MVCC manager notification
[f2a56d8] #608: ENG-3570 - Occasional/intermittent FATAL during remote bootstrap: flushed opID higher than in WAL
[1321035] ENG-4289: #625: Handle empty response in InetAddress::FromString
[5ca7b1f] #619: ENG-3994 - GRANT ALL should only grant the permissions supported by the resource
[0d5f3bb] #541 Support copying all tables from a namespace to another
[95802be] #593: Resources without permissions granted to them, still appear when querying system_auth.role_permissions
[793b4cd] [ENG-3921] #336 Forward pub-sub messages to other nodes in the cluster
[5cf0188] ENG-4123: #537: Ignore duplicate write requests
[6eaa1ec] ENG-4240: #613: Fix checking of tablet presence during transaction CLEANUP
[e609694] Restore sys catalog table name
[4c8c5a4] #606: ENG-4102 - A role shouldn't be able to delete itself
[117de1d] Support for System Columns
[b2b7630] [ENG-4239] Add Date and Time datatypes to yb-client
[f68dee5] #609: Add retry to InsertTestRowsRemote
[292cb1b] #610: Add retry to DeleteTableTest::GetLeaderUUID
[7f4912f] ENG-1333. Report errors in LoadBalancer.
[0d50c0c] ENG 3889: Only a SUPERUSER role can alter the SUPERUSER status of another role
[c908298] #538: ENG-3471: Fixed write-if handling in case leader is not ready to serve
[af34729] #543: Support creating Postgres sys catalog tables in yb-master
[c640994] [ENG-4131] Fix ClientTest_TestWriteTimeout
[ac8600a] #603: Propagate leader term
[9a3823e] #605: Change the /mem-trackers internal UI page to a tree-like view
[3072e66] #602: Skip calling Done in QLProcessor::Reschedule
[fac2acd] #512: ENG-3501: Added JSON fields checks into the C++ driver test.
[04f6b9f] #598: Add MemTrackers to RocksDB
[6617193] #600: ENG-4234: Handle failure in LookupTabletDone
[adf6560] ENG-3885: Only a SUPERUSER role should be able to drop another SUPERUSER role
[e1e717e] ENG-4224 Export BUILD_TYPE in yb_build.sh and reduce username-related failures of run_tests_on_spark.py
[ee3e45a] #585: Only a SUPERUSER role can create another SUPERUSER role
[09b2558] ENG-4232: Updated C++ Cassandra driver version to 2.9.0-yb-2. (Fixed RapidJson version.)
[058a1e4] Allowing the use of a custom (non-default location) Homebrew installation on macOS
[aad1797] Clean up handling of system tables in catalog manager.
[a1b53a6] #592: Fix syntax for ALTER ROLE
[ca97afb] ENG-4187: Fixed ASAN & TSAN issues in the cassandra driver test.
[0e68a53] (#573) ENG-4192 Implement minTimeUUID/maxTimeUUID in YCQL
[a63e1f9] #587: TABLE keyword should be optional in GRANT/REVOKE PERMISSION statements
[f8a4d19] #584: Avoid dropping COMMITTED record from logs and relax status handling in release mode
[9a51dd1] #591: Extended lifetime of RequestScope while writing provisional records
[2e73b50] #590: Use rescheduler for aborting transaction in ExecContext::Reset
[0d583ac] #581: Use correct check when QL executor should be rescheduled
[836fc6a] ENG-3601: #570: Use Prometheus compatible names for mem tracker metrics
[5ef6fe8] #567: Resolves fatal error when starting cluster in RF1 with PostgreSQL enabled.
[046c0f1] Remove the old PGSQL service and parser from our code base because we are now using PostgreSQL codebase directly
[4a3a8e4] #572: Change defaults of rpc threads/queues and tablets.
[9561c35] #41: ENG-4170: Implemented ALTER KEYSPACE statement.
[528b5d6] #580: Make ReplicaState::LogPrefix lockfree
[521c35e] #576: Use std::mutex in RaftConsensus instead of simple_spinlock
[91487ce] #575: Avoid calling CompleteWithStatus under lock
[ee65667] #564: Fix performance degradation with authorization enforcement
[33178f3] [ENG-4171] [#568] Fix ZRANGEBYSCORE SegFault.
[7acb661] ENG-3601: #570: Export memtracker stats as metrics
[f7829b0] #536 ENG-4128 Create transaction-status table on DDL path
[ab986ef] [#566] Enable TIMESTAMP type in PostgreSQL; fix float test on ASAN by disabling UBSAN on float.c
[960cb2c] Fixes #164: Select statement using uncovered index
[0325a4f] #512: ENG-3501: New Cassandra C++ driver test with YB ExternalMiniCluster.
[93cc7d8] Adding tests for float4 and float8 PostgreSQL types
[751c17c] Fix macOS packaging script so that it accepts @loader_path library paths
[0313d20] ENG-4125: A drop table/keyspace/role statement should automatically revoke all the permissions granted on the deleted resource
[7c1d28d] ENG-4151: Modify sample apps to accept username/password for Cassandra workloads
[adaee62] #512: ENG-3501: Added cassandra-cpp-driver to yugabyte/thirdparty.
[c98a687] Update minimum CMake version to 3.7.0 for FindICU module
[52fb4a4] yb_release.py: don't complain about the default YB_THIRDPARTY_DIR being different from that in the build descriptor file
[6c346c1] When creating a new resource (table/keyspace/role), the role creating it should get all the permissions on the resource
[47dc36b] Re-enable yb_int4.sql and yb_int8.sql tests, fix overflow handling in ASAN
[d3b589d] #526: Resolve query error after switching role in cqlsh
[fd1a4ec] YSQL Optimize SELECT with fully-specified multi-column primary key
[7e073ae] DELETE and UPDATE Basic Support
[28f4650] Fixes for Monitor/Config commands
[2cbd2dc] #73: ENG-2665 - Cassandra Authorization: Enforcement
[42e5e82] [#523] Enabling more data PostgreSQL types, adding a pg_regress based test suite, and fixing a bug with YBPgStatement lifecycle in the YB FDW
[cda791b] [ENG-3920] Pt. 1/3 Refactor existing monitor architecture to support local implementation of Publish/Subscribe
[50b527f] ENG-4124: Handle schedule failures in tests correctly
[286ea60] ENG-4101: Introduce intrusive MPSC queue and use it in preparer
[0451cc4] ENG-3397. Redis KEYS
[1441732] #522: Convert VERSION SysCatalog entry into flexible config entry.
[eed35bc] ENG-4118: Make all files within a release archive owner-writable to avoid errors during deployment
[9cf50c4] Fix LinkedListTest.TestLoadWhileOneServerDownAndVerify test
[89aa768] Enable some supported YB-Postgres features in parser
[8947924] SELECT with fully-specified multi-column primary key
[4952508] Update thirdparty version for Jenkins on Linux
[1ac4b39] #73: ENG-2665 - Cassandra Authorization: Permissions cache
[fa1b53f] Rename StringPiece to GStringPiece to un-break the build on Ubuntu 18.04
[1dc6d31] ENG-3861: #505: Fix check that reactor could accept new tasks
[b710c64] #507 Fix TestPgTransactions#testTransactionConflicts: read requests could get stuck if transaction status tablet leader changes
[b7fc14d] ENG-4037: Add ability to specify transaction start time externally
[f5bb57f] ENG-4032: Support date string literal before 1400 AD in YCQL.
[c753f84] #482: Raise error when the WHERE clause of a SELECT DISTINCT statement contains reference to a range or non-static columns.
[e71032d] Allow SET SESSION TRANSACTION and DROP DATABASE
[feec3e6] [ENG-3779] Expose JSONB type via yb-client
[f62a4ee] Report errors for unsupported PostgreSQL features in YugaByte
[20c37fe] ENG-4044 Fix how we handle PostgreSQL's text datum to unbreak SELECT with a text key specified
[95fcba2] Support for PostgreSQL in the macOS packaging script
[a3f2e87] Unset the LANG env var when launching PostgreSQL server
[8d14d9b] Decrease execution time of QLTransactionTest.RemoteBootstrap
[2715679] ENG-3949: #479: Decrease log flooding from distributed transactions
[ba68646] Misc extensions and fixes related to YB-PostgreSQL
[883f9a9] Fix how arguments are being passed to the constructor of the MacLibraryPackager class
[87f7429] Integrating PostgreSQL with YugaByte distributed transactions; adding PostgreSQL to yb-ctl and the release package
[438a60c] #493: Fix various issues with transactions and restarts
[d2b3c76] ENG-3898 Extend SELECT query support for YB-PostgreSQL
[f9a851f] Increase the default CQL queue limit to 5k
[d27d140] ENG-3836. Changed DCHECK to Status return in load balancer.
[90656c8] ENG-3987: Fixed GCC version handling
[ef610e4] ENG-3871: Test failure in TestMultipleLeaderRestarts
[4786d33] ENG-3965: Change timeout handling in RPC
[1ddc98b] #471: Implement YCQL date and time standard functions
[d7debca] Add seconds to Alive column.
[2b5fc7e] ENG-3874: Write empty batch with
[453b81c] Full scan support for Postgres API
[627a03f] ENG-3959. Add set_preferred_zones command to yb-admin.
[406a278] (#492) ENG-3416: Fix end-key calculation for range deletes
[86a103a] #490 (ENG-3981) Avoid creating checkpoints dir for system.transactions table
[1308465] #472: Support boolean datatype in YCQL primary key column
[2d2f378] #471: Support date and time datatypes in YCQL
[48adf81] #485 (ENG-3962) fix Tablet::AlterSchema() to flush tablet metadata when schema version changes because of index change also.
[54c2645] ENG-2326: #484 : Periodic sync for Remote bootstrap
[27c5898] ENG-3862: Add an intermediate state when scheduling a delay in RpcRetrier
[03bde5a] Avoid using ntp_adjtime in default clock
[d6e5118] Stabilize TestPgWrapper: correctly shut down backends on SIGTERM, and fix pointer corruption caused by implicit function declarations
[88e1d69] ENG-3949: #479: Fix removing from list of transactions that should be cleaned.
[c71ed15] PR #429: Adding SimpleQueryTest suite from Apache Cassandra to Yugabyte DB's YCQL testsuite:
[aba3ba1] ENG-3916. ZRangeByScore LIMIT option.
[749601b] #480 ENG-3954: Check if a transaction is aborted
[928220a] #369 Fix AlterTableRandomized.TestRandomSequence
[f81514d] ENG-3650: Patch old transactions status table type in sys catalog
[9904950] [#386] Switch ResettableHeartbeater with Periodic timer
[f2c3643] ENG-3896: Allow DESCRIBE permission on ROLE resource only
[ad371b9] ENG-3650: Remove the dependency of transaction coordinator on transaction participant
[f9f1fbb] ENG-3897: Remove calling MVCC w/o lease specified during intents cleanup

yugabyte-db - v1.1.0 (Sep 17, 2018)

Published by ravimurthy about 6 years ago