What's Changed

• Relay Fixes by @blinktag in https://github.com/streamdal/plumber/pull/361
• Respect --use-tls even if --tls-skip-verify is not specified
• Add relay ID to kafka relay logs
• Fix incorrect debug logs
• Updating a connection now restarts associated relays with new connection data
• Recreate backend and context/cancelFunc when resuming a relay

Full Changelog: https://github.com/streamdal/plumber/compare/v2.5.1...v2.5.2

• Docker image has changed from batchcorp/plumber to streamdal/plumber

Improvements

• Bump jackc/pgx version to support postgres versions 14/15
• Bump postgres version in cdc-postgres example docker-compose.yml
• Toast fields without updates will now contain the value __PLUMBER_TOAST_UNKNOWN__ instead of an empty string

Fixes

• Properly exit single read if --continuous is not specified

Full Changelog: https://github.com/streamdal/plumber/compare/v2.3.0...v2.4.0

What's Changed

Fixes

• Ignore telemetry service errors by @blinktag in https://github.com/batchcorp/plumber/pull/354

Improvements

• Support for cloud events by @blinktag in https://github.com/batchcorp/plumber/pull/347
  See https://github.com/batchcorp/plumber/blob/master/docs/examples.md#publish-cloudevents for example usage

Full Changelog: https://github.com/batchcorp/plumber/compare/v2.2.1...v2.3.0

• Auto update batchcorp/plumber-helm on new Plumber releases
• Ignore context.Canceled error on redis-streams read exit

• Passing --credentials-json flag to plumber manage create connection gcp-pubsub will now pass the file contents to the plumber server

• Default value for plumber manage ... --manage-token flag has changed from batchcorp to streamdal

Bug fixes:

• #340 - Fix azure service bus flags so that either --topic or --queue is required, not both.
• #340 - Fix azure service bus example
• #339 - Fix JSON array writing example

Thank you @azizabah and @chris-aeviator for the reports!

Features

Plumber now supports Memphis!
Run plumber read memphis -h and plumber write memphis -h for flags

Improvements

New flags have been added for Pulsar courtesy of @ckreiling

• --token to specify authentication token as a string or file
• --initial-position to specify where the subscription should start reading from
• --listener-name to specify listener name when connecting to a Pulsar cluster advertising more than 1 DSN

Batch.sh is now Streamdal.com!

This release primarily addresses features and updates related to the streamdal.com platform (formerly batch.sh).

Bug fixes

• https://github.com/batchcorp/plumber/issues/331 - Fix issue with piping data to plumber write on Arch linux

New features

• Relays now accept an optional --dead-letter CLI flag or PLUMBER_RELAY_DEAD_LETTER=true envar, which will force all messages to be written to the collection's dead letter queueu

Breaking Changes

• The default API token when running plumber in server mode is now streamdal instead of batchcorp. This should always be overridden with the PLUMBER_SERVER_AUTH_TOKEN environment variable
• --batch-grpc-disable-tls is flag now --streamdal-grpc-disable-tls
• --batch-grpc-timeout-seconds is flag now --streamdal-grpc-timeout-seconds
• --batch-grpc-address is flag now --streamdal-grpc-address

Specifying PLUMBER_RELAY_RABBIT_DEAD_LETTER envar or --dead-letter CLI flag will force all relayed messages to be sent to the dead letter queue of your collection

• New flag --exclude-binding-key-regex has been added, which can be used to exclude message having a key matching the provided regex.

When using a temporary ephemeral tunnel from CLI via plumber tunnel ..., more data is supplied in the gRPC Connect() call. This allows for more reliable reconnection and avoiding creating multiple tunnels

When a user deletes a tunnel in Console, the tunnel will forcefully exit the plumber client as the tunnel is no longer usable