Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!
Bot releases are visible (Hide)
Published by vbotbuildovich over 1 year ago
rpk cluster storage recovery
which rendered the status
command unusable. by @r-vasquez in #9801
Full Changelog: https://github.com/redpanda-data/redpanda/compare/v23.1.4...v23.1.6
Published by vbotbuildovich over 1 year ago
cloud_storage_enable_remote_write
is false. by @andrwng in #9704
rm
tx
or id_allocator
stms by @mmaslankaprv in #9679
PUT /v1//redpanda-services/restart?service=schema-registry
, now users issue PUT /v1/debug/restart_service?service=schema-registry
by @NyaliaLui in #9659
Full Changelog: https://github.com/redpanda-data/redpanda/compare/v23.1.3...v23.1.4
Published by vbotbuildovich over 1 year ago
Full Changelog: https://github.com/redpanda-data/redpanda/compare/v22.3.14...v22.3.15
Published by vbotbuildovich over 1 year ago
Full Changelog: https://github.com/redpanda-data/redpanda/compare/v23.1.2...v23.1.3
Published by vbotbuildovich over 1 year ago
redpanda_cloud_storage_cache_op_miss
metric was not showing the right value. by @dlex in #9342
redpanda.rpc_server_tls
property when decoding the redpanda.yaml, which means that it will leave the field as a list or as an element depending on what the user has configured before executing rpk commands. by @r-vasquez in #9369
rpk debug bundle
in k8s works for brokers with TLS enabled. by @r-vasquez in #9436
--blocked-reactor-notify-ms
parameter on the fly. by @Lazin in #9351
rpk debug bundle
by @r-vasquez in #9451
cloud_storage_backend
, although this should not be necessary when running on supported backends (GCP, AWS, Azure). by @abhijat in #9270
Full Changelog: https://github.com/redpanda-data/redpanda/compare/v23.1.1...v23.1.2
Published by vbotbuildovich over 1 year ago
redpanda_storage_disk_free_bytes
and redpanda_storage_disk_total_bytes
is corrected from by @jcsp in #9040
redpanda.rpc_server_tls
property when decoding the redpanda.yaml, which means that it will leave the field as a list or as an element depending on what the user has configured before executing rpk commands. by @r-vasquez in #9365
redpanda_cluster_partitions
is incremented per partition, not per replica, on a topic creation by @daisukebe in #9462
rpk container
with Podman by @r-vasquez in #9153
--blocked-reactor-notify-ms
parameter on the fly. by @Lazin in #9351
rpk debug bundle
by @r-vasquez in #9450
Full Changelog: https://github.com/redpanda-data/redpanda/compare/v22.3.13...v22.3.14
Published by github-actions[bot] over 1 year ago
redpanda_storage_disk_free_bytes
and redpanda_storage_disk_total_bytes
is corrected from a counter to a gauge by @jcsp in #9038
redpanda.rpc_server_tls
property when decoding the redpanda.yaml, which means that it will leave the field as a list or as an element depending on what the user has configuredrpk container
with Podman by @r-vasquez in #9152
--blocked-reactor-notify-ms
parameter on the fly by @Lazin in #9356
rpk debug bundle
by @r-vasquez in #9449
Full Changelog: https://github.com/redpanda-data/redpanda/compare/v22.2.10...v22.2.11
Published by vbotbuildovich over 1 year ago
Azure Blob Storage Support
cloud_storage_azure_storage_account
, cloud_storage_azure_container
, cloud_storage_azure_shared_key
. by @VladLazar in #8086
cloud_storage_azure_shared_key
. This makes rotating keys more convenient. by @VladLazar inKerberos Authentication
Automatic Topic Recovery from Cloud Storage
rpk cluster storage recovery
sub-command to rpk
. The command can start automated topic recovery from an archival bucket and poll the status of an on-going recovery process by @Scandiravian in #8836
Ingress/Egress Rate Limits per Node
#7855 Throughput limit can now be applied at node scope. Each individual node will limit the overall ingress throughput of all Kafka client connections it serves to the number specified by kafka_throughput_limit_node_in_bps
cluster property; same can be done on the egress side using kafka_throughput_limit_node_out_bps
. by @dlex in #8335
Node Self-Test Tool
Introduces new self-tests for redpanda allowing users to run mini-benchmarks on disk and network hardware to verify expected performance by @graphcareful in #8172
Self test rpk integration by @graphcareful in #8398
Kafka API / Feature Support
segment.ms
topic property. This controls the maximum time between the first write to a segment, and later closing the segment. This is sometimes useful when one needs topic retention limits to apply within a known time period, rather than at the next segment roll. This is disabled by default. by @andijcr in #8047
log_segment_ms_min
and log_segment_ms_max
cluster configuration properties. These limits are applied to segment.ms
and log_segment_ms
, to protect systems from pathologically small segment roll periods. by @andijcr in #8047
log_segment_ms
cluster configuration property, which is the default value for segment.ms
on topics that do not override it. This is also accessible via the Kafka API under its Kafka-compatible alias log.roll.ms
. The lowest permitted value for this property is 60 seconds. by @andijcr in #8047
Security
Administrative Tools & Guardrails
POST v1/partitions/rebalance
API to manually trigger partition rebalancing by @mmaslankaprv in #7367
vectorized_cluster_partition_num_with_broken_rack_constraint
metric (total number of partitions that don't satisfy the rack awareness constraint) by @ztlpn in #7432
__consumer_offsets
topic by @mmaslankaprv in #7604
target_fetch_quota_byte_rate
- target fetch size quota byte rate for client (bytes per second). Disabled by default by @ZeDRoman in #7658kafka_noproduce_topics
cluster configuration property. The default value of this property is ['__audit']
by @ballard26 in #7614
kafka_nodelete_topics
cluster configuration property. The default value of this property is ['__consumer_offsets', '__redpanda_e2e_probe', '_schemas']
by @ballard26 in #7614
node_isolation_raft_timeout
and node_isolation_heartbeat_timeout
. Both are 3 seconds by default. by @VadimPlh in #7829
rpk group offset-delete
will be added to rpk
by @graphcareful in #8757
:8082/status/ready
by @BenPope in #7080
:8081/status/ready
by @BenPope in #7080
max_concurrent_producer_ids
) to control how many sessions for transaction/idempotency will be saved by @VadimPlh in #7057
rpk redpanda admin brokers decommission-status <node-id>
by @daisukebe in #8376
GET /v1/brokers/<id>/decommission
by @mmaslankaprv in #8167
/v1/partitions/local_summary
reports the count, leaderless count and under-replicated count for partitions with replicas on the node serving the request. This replaces the use of the prometheus endpoint for programs that previously used that to read the vectorized_cluster_partition_under_replicated_replicas
metric. by @jcsp in #9011
redpanda_cloud_storage_segments_metadata_bytes
is added that tracks the amount of memory consumed by segment metadata managed by the remote partition. by @andrwng in #8304
additionalCommandlineArguments
under the configuration
block that allows additional command line arguments to be passed to the redpanda command line. by @koikonom in #8401
redpanda_storage_free_space_alert
update more promptly when the system starts to run low on disk space. by @jcsp in #5252
kafka_api
node configuration property, enabling starting a cluster without client connectivity during initial configuration/bootstrap. by @jcsp in #5126
/v1/features
Admin API endpoint now includes an original_cluster_version
reflecting the logical version at which the cluster was created. by @jcsp in #4996
seed_servers
node configuration may now be identical on each node to form a cluster, even when empty_seed_starts_cluster
is true
(the default). by @andrwng in #7390
rpk cluster config edit
or rpk cluster config set
, print ‘ Cluster needs to be restarted. See more details with 'rpk cluster config status' if restart is required: by @daisukebe in #7421
retention.local.target
settings to bound how much data is restored to local disk, rather than the total retention settings. by @jcsp in #7493
archival_service_[stop|start]_archiving_ntp
are no longer used, and are removed from /metrics API output. by @jcsp in #7547
Unused configuration property
is no longer used and is deprecated. by @jcsp in #7547
vectorized_s3_client.*
metrics have been renamed to vectorized_cloud_client.*
in order to match the naming on the public_metrics
endpoint. by @VladLazar in #8086
--max-message-bytes
to rpk topic produce
to be able to override the max batch size franz-go enforces behind the scenes. by @daisukebe in #7646
segments.bytes
property according to configured min/max values by @mmaslankaprv in #8006
cloud_storage_graceful_transfer_timeout_ms
is added, with a default of 5000ms. Setting this property to null disables the new behavior of waiting for uploads to complete before transferring leadership. by @jcsp in #8560
rpk cluster health
now reports under replicated partitions, and considers the cluster unhealthy if any partitions are under replicated. by @jcsp in #9011
_schemas
topic is missing, return a 500 status code. by @BenPope in #7555
__consumer_offsets
partitions by @dlex in #7406
node_id
in moving_to
when invoking GET /v1/brokers/<id>/decommission
by @daisukebe in #8347
default_topic_replications
by @daisukebe in #7244
/brokers
and /config_status
endpoints consistent by @mmaslankaprv in #8181storage_target_replay_bytes
by ensuring the limit--offset
option parses duration properly, e.g. --offset @2022-02-14:1h
by @daisukebe in #7971
retention.ms
and retention.bytes
topic configurations. by @andrwng in #7747
redpanda.remote.delete
topic property via the legacy AlterConfig API (this API was deprecated in Kafka 2.3.0, but is supported for backward compatibility) by @jcsp in #7922
redpanda_storage_disk_free_bytes
and redpanda_storage_disk_total_bytes
is corrected from by @jcsp in #9020
_schemas
topic to retain forever. by @BenPope in #7553
Full Changelog: https://github.com/redpanda-data/redpanda/compare/v22.3.13...v23.1.1
Published by vbotbuildovich over 1 year ago
Full Changelog: https://github.com/redpanda-data/redpanda/compare/v22.3.12...v22.3.13
Published by github-actions[bot] over 1 year ago
--offset
option parses duration properly, e.g. --offset @2022-02-14:1h
by @daisukebe in #8134
rpk cluster config edit/import
by @r-vasquez in #8477
kafka/client
. Would result in a 500: Internal Server Error
when attempting to access the schema registry. by @michael-redpanda in #8606
Published by vbotbuildovich over 1 year ago
rpk cluster config import/edit
by @r-vasquez in #8391
node_id
in moving_to
when invoking GET /v1/brokers/<id>/decommission
by @daisukebe in #8594
rpk cluster config edit/import
by @r-vasquez in #8475
kafka/client
. Would result in a 500: Internal Server Error
when attempting to access the schema registry. by @michael-redpanda in #8604
Full Changelog: https://github.com/redpanda-data/redpanda/compare/v22.3.11...v22.3.12
Published by vbotbuildovich almost 2 years ago
--offset
option parses duration properly, e.g. --offset @2022-02-14:1h
by @daisukebe in #8132
Full Changelog: https://github.com/redpanda-data/redpanda/compare/v22.3.10...v22.3.11
Published by vbotbuildovich almost 2 years ago
:8082/status/ready
by @BenPope in #7999
:8081/status/ready
by @BenPope in #7999
redpanda.remote.delete
topic property via the legacy AlterConfig API (this API was deprecated in Kafka 2.3.0, but is supported for backward compatibility) by @jcsp in #7960
Full Changelog: https://github.com/redpanda-data/redpanda/compare/v22.3.9...v22.3.10
Published by github-actions[bot] almost 2 years ago
:8082/status/ready
by @BenPope in #8003
:8081/status/ready
by @BenPope in #8003
_schemas
topic to retain forever. by @BenPope in #7561
_schemas
topic is missing, return a 500 status code. by @BenPope in #7569
Full Changelog: https://github.com/redpanda-data/redpanda/compare/v22.1.10...v22.1.11
Published by github-actions[bot] almost 2 years ago
:8082/status/ready
by @BenPope in #8002
:8081/status/ready
by @BenPope in #8002
_schemas
topic to retain forever. by @BenPope in #7560
_schemas
topic is missing, return a 500 status code. by @BenPope in #7568
Full Changelog: https://github.com/redpanda-data/redpanda/compare/v22.2.8...v22.2.9
Published by vbotbuildovich almost 2 years ago
Full Changelog: https://github.com/redpanda-data/redpanda/compare/v22.3.8...v22.3.9
Published by vbotbuildovich almost 2 years ago
Full Changelog: https://github.com/redpanda-data/redpanda/compare/v22.3.7...v22.3.8
Published by vbotbuildovich almost 2 years ago
retention.ms
and retention.bytes
topic configurations. by @VladLazar in #7752
Full Changelog: https://github.com/redpanda-data/redpanda/compare/v22.3.6...v22.3.7
Published by vbotbuildovich almost 2 years ago
Full Changelog: https://github.com/redpanda-data/redpanda/compare/v22.3.5...v22.3.6
Published by github-actions[bot] almost 2 years ago
max_concurrent_producer_ids
) to control how much sessions for transaction/idempotency will be saved by @VadimPlh in #7618 #7580
default_topic_replications
by @daisukebe in #7434
_schemas
topic to retain forever. by @BenPope in #7559
seed_servers
node configuration may now be identical on each node to form a cluster, even when empty_seed_starts_cluster
is true
(the default). by @andrwng in #7501
retention.local.target
settings to bound how much data is restored to local disk, rather than the total retention settings. by @jcsp in #7578
rpk cluster config edit
or rpk cluster config set
, print the following message if restart is required: by @daisukebe in #7517
Cluster needs to be restarted. See more details with 'rpk cluster config status'
_schemas
topic is missing, return a 500 status code. by @BenPope in #7567
Full Changelog: https://github.com/redpanda-data/redpanda/compare/v22.3.4...v22.3.5