kafka-streams-cassandra-state-store

What's Changed

• chore(deps): update dependency gradle to v8.8 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/110
• fix(deps): update dependency org.assertj:assertj-core to v3.26.0 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/111
• chore(deps): update gradle/actions action to v3.4.1 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/113
• chore(deps): update gradle/actions action to v3.4.2 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/114

Full Changelog: https://github.com/thriving-dev/kafka-streams-cassandra-state-store/compare/0.8.5...0.8.6

What's Changed

• fix(deps): update dependency org.slf4j:slf4j-simple to v2.0.11 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/78
• fix(deps): update dependency org.junit.jupiter:junit-jupiter to v5.10.2 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/81
• fix(deps): update dependency org.assertj:assertj-core to v3.25.3 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/80
• chore(deps): update dependency gradle to v8.6 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/82
• chore(deps): update gradle/gradle-build-action action to v3 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/83
• chore(deps): update gradle/wrapper-validation-action action to v2 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/84
• fix(deps): update testcontainers-java monorepo to v1.19.4 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/85
• fix(deps): update jetty to v11.0.20 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/86
• fix(deps): update testcontainers-java monorepo to v1.19.5 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/88
• fix(deps): update dependency ch.qos.logback:logback-classic to v1.5.0 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/90
• chore(deps): update gradle/gradle-build-action action to v3.1.0 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/89
• fix(deps): update dependency org.slf4j:slf4j-simple to v2.0.12 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/87
• chore: gradle/actions/setup-gradle supersedes 'gradle-build-action' by @hartmut-co-uk in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/91
• fix(deps): update dependency ch.qos.logback:logback-classic to v1.5.3 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/93
• fix(deps): update testcontainers-java monorepo to v1.19.7 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/92
• chore(deps): update dependency io.quarkus to v3.8.2 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/95
• fix(deps): update quarkus to v3.8.2 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/96
• chore(deps): update dependency gradle to v8.7 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/100
• fix(deps): update dependency com.google.guava:guava to v33.2.0-jre by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/97
• fix(deps): update dependency ch.qos.logback:logback-classic to v1.5.6 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/104
• fix(deps): update jersey monorepo to v3.1.7 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/102
• chore(deps): update gradle/actions action to v3.3.2 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/101
• fix(deps): update dependency org.slf4j:slf4j-simple to v2.0.13 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/105
• chore(deps): update dependency io.github.gradle-nexus.publish-plugin to v2 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/103
• fix(deps): update testcontainers-java monorepo to v1.19.8 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/109
• fix(deps): update jetty to v11.0.21 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/107
• fix(deps): update dependency com.scylladb:java-driver-core to v4.17.0.1 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/106
• fix(deps): update dependency com.google.guava:guava to v33.2.1-jre by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/108
• fix(deps): update dependency org.apache.kafka:kafka-streams to v3.7.0 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/94

Full Changelog: https://github.com/thriving-dev/kafka-streams-cassandra-state-store/compare/0.8.4...0.8.5

What's Changed

• chore(deps): update github/codeql-action action to v3 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/67
• chore(deps): update actions/upload-artifact action to v4 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/66
• chore(deps): update actions/download-artifact action to v4 - autoclosed by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/65
• fix(deps): update dependency com.google.guava:guava to v33 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/74
• fix(deps): update jetty to v11.0.19 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/73
• chore(deps): update gradle/gradle-build-action action to v2.11.1 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/72
• fix(deps): update dependency org.slf4j:slf4j-simple to v2.0.10 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/75
• fix(deps): update dependency org.assertj:assertj-core to v3.25.0 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/76
• fix(deps): update dependency org.assertj:assertj-core to v3.25.1 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/77
• chore(deps): update dependency io.quarkus to v3.6.5 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/71

Full Changelog: https://github.com/thriving-dev/kafka-streams-cassandra-state-store/compare/0.8.3...0.8.4

What's Changed

• fix(deps): update dependency org.junit.jupiter:junit-jupiter to v5.10.1 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/55
• fix(deps): update jetty to v11.0.18 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/56
• fix(deps): update testcontainers-java monorepo to v1.19.3 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/58
• chore(deps): update actions/setup-java action to v4 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/64
• chore(deps): update gradle/gradle-build-action action to v2.11.0 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/63
• fix(deps): update dependency org.apache.kafka:kafka-streams to v3.6.1 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/61
• fix(deps): update dependency ch.qos.logback:logback-classic to v1.4.14 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/59
• fix(deps): update jersey monorepo to v3.1.5 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/60
• chore(deps): update dependency gradle to v8.5 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/62
• chore(deps): update dependency io.quarkus to v3.6.3 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/57

Full Changelog: https://github.com/thriving-dev/kafka-streams-cassandra-state-store/compare/0.8.2...0.8.3

What's Changed

• fix(deps): update dependency org.apache.kafka:kafka-streams to v3.6.0 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/54
• chore(deps): update dependency io.quarkus to v3.5.0 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/53

Full Changelog: https://github.com/thriving-dev/kafka-streams-cassandra-state-store/compare/0.8.1...0.8.2

What's Changed

• chore: use libs.versions.toml (gradle version catalog) by @hartmut-co-uk in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/42
• feat(#40): Migrate to 'thriving-dev/java-library-template' CICD by @hartmut-co-uk in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/43
• refactor: adds missing bind param for saveBatch -> inserts by @hartmut-co-uk in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/52
• fix(deps): update dependency ch.qos.logback:logback-classic to v1.4.11 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/45
• fix(deps): update dependency com.google.guava:guava to v32.1.3-jre by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/46
• fix(deps): update dependency org.slf4j:slf4j-simple to v2.0.9 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/47
• fix(deps): update dependency com.scylladb:java-driver-core to v4.17.0.0 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/50
• fix(deps): update jetty to v11.0.17 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/49
• fix(deps): update jersey monorepo to v3.1.3 by @renovate in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/48

New Contributors

• @renovate made their first contribution in https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/45

Full Changelog: https://github.com/thriving-dev/kafka-streams-cassandra-state-store/compare/0.8.0...0.8.1

Added

• feat: Implement VersionedKeyValueStore<K, V> #21
  • ref KIP-889: Versioned State Stores
  • New store types, provided via CassandraStores
    • partitionedVersionedKeyValueStore
    • globalVersionedKeyValueStore

Added

• Ops: GitHub action step to trigger a publication to Sonatype OSS for main branch and tags
• Ops: New GitHub action for triggering 'gradle release' from repo with automatic semver

Polishing & Cleanup

• chore: example/*-restapi enable datastax-java-driver RequestLogger
• chore: example/partitioned-store-restapi use ScyllaDB
• chore: example/partitioned-store-restapi fix main class + application.id
• chore: polishing, more javadoc+comments, validateIsRunningOrRebalancing()

Changed

• Class is renamed to be more explicit (CassandraReadOnlyKeyValueStore -> CassandraPartitionedReadOnlyKeyValueStore)

Added

• Advanced, optimised, efficient, custom implementation of ReadOnlyKeyValueStore for 'Interactive Queries' for 'partitioned' type CassandraKeyValueStore https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/25
  • Offered by CassandraStateStore static methods, for an example please check the README
    • CassandraStateStore#readOnlyPartitionedKeyValueStore(KafkaStreams, String, CqlSession, String, boolean, String, Serde, Serde)
    • CassandraStateStore#readOnlyPartitionedKeyValueStore(KafkaStreams, String, CqlSession, String, boolean, String, Serde, Serde, Function, StreamPartitioner)
• New example 'partitioned-store-restapi' featuring the new CassandraPartitionedReadOnlyKeyValueStore https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/25
  • Implements a REST API with endpoints for all available 'Interactive Query' methods to play with hands-on

Changed

• Integration test is renamed WordCountGlobalStoreTest -> WordCountGlobalKeyValueStoreTest https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/25
  • test + assertions added for ReadOnlyKeyValueStore.all()

Removed

• First impl. of CassandraStateStore#readOnlyPartitionedKeyValueStore(KafkaStreams, String) was removed and replaced by the more complex methods that return an instance of CassandraPartitionedReadOnlyKeyValueStore (already mentioned above) https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/25

Changed

• to have an explicit naming of store types, it was decided to rename CassandraStores.keyValueStore to CassandraStores.partitionedKeyValueStore https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/24
• the renamed partitionedKeyValueStore is no longer recommended as the default choice https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/24

Added

• Interface CassandraStateStore https://github.com/thriving-dev/kafka-streams-cassandra-state-store/issues/19 https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/20
  • implemented by all the libraries custom StateStore solutions (only CassandraKeyValueStore yet)
  • provides static helper methods to get ReadOnly stores for interactive queries (see docs)

Changed

• dependency updates, incl. kafka-streams 3.5.0 https://github.com/thriving-dev/kafka-streams-cassandra-state-store/pull/22
  Reminder: the library itself does not have any transitive dependencies. All dependencies are compileOnly or for tests.

Added

• feat: Add builder config option - opt-in to enable count for approximateNumEntries #10
• feat: Add builder config option - allow setting execution profiles (for DDL; DML) #11
• feat: Add builder config option - opt-out to avoid tables to be auto-created #9
• feat: add Quarkus examples app as GraalVM native image #7

Changed

• store size via approximateNumEntries is now by default disabled - opt-in option has been added to builder - ref #10

Fixed

• bug: cassandra concurrent schema updates (initial concurrent table auto-creation) #12
• small fix: example 'processor-api-all-range-prefix-count' not runnable

Other

• documentation improved

Changed

• fix: small refactoring to allow better reuse of AbstractCassandraKeyValueStoreRepository

Changed (documentation only)

• feat: improve documentation for recommended kafka streams config
• feat: add documentation on 'Cassandra table partitioning' (avoiding large partitions)

(Added)

• Adds a first set of integration tests with testcontainers
  • Covering
    • WordCountTest testing the kafka streams 'Hello world!' app to work with CassandraKeyValueStore
    • WordCountInteractiveQueriesTest testing interactive queries incl. methods all, range, prefixScan, approximateNumEntries
    • WordCountGlobalStoreTest testing CassandraStores.globalKeyValueStore() and store access via interactive queries
  • Using
    • Cassandra 4.1
    • Redpanda

Changed / Removed

• Simplified overly complex class name to GlobalCassandraKeyValueStoreRepository.

Added

• approximateNumEntries was added using SELECT COUNT(*) with WARN log & request timeout of 5s

Changed / Removed

• keyValueStore now supports org.apache.kafka.streams.state.ReadOnlyKeyValueStore#prefixScan(Object, Serializer)
  • Implements a solution using range on BLOB type key using ((Bytes) from).increment(), identically to RocksDB + InMemory KV Stores
  • The solution now works for all CQL databases, replacing the ScyllaDB specific solution (see right below)
• adapts, enhances example 'processor-api-all-range-prefix-count' (previously 'processor-api-prefixscan')
  • added additional description to example README
  • added/fixed JavaDoc for WordCountProcessor
  • now also runs approximateNumEntries

Removed

• stringKeyValueStore was removed with all belonging code (PartitionedStringKeyScyllaKeyValueStoreRepository, ...)
  • This removes the special implementation of org.apache.kafka.streams.state.ReadOnlyKeyValueStore#prefixScan(Object, Serializer) for ScyllaDB backed stores with String keys.
    (The implementation was based on ScyllaDB LIKE operator query on TEXT type clustering key)
  • This is longer required since replaced with generic solution implemented for keyValueStore (see right above)

Security

• successfully tested the library against 'CQL injection' via withTableOptions(..)
  => tried to add compaction = { 'class' : 'LeveledCompactionStrategy' };DROP TABLE xyz which fails due to wrong syntax in Cassandra 3.11/4.1 & ScyllaDB 5.1

Added

• feat: implements StateStore.query
• improved javadoc
• adds documentation on
  • store types + operations
  • builder & options
  • link to examples
  • known limitations
  • cassandra specifics

Fixed

• for any bug fixes

First public release