spring-kafka

⭐ New Features

• Wrong comparison of server bootstrap addresses in KafkaTemplate.afterSingletonsInstantiated #3472
• Allow @DltHandler Method to be Defined in a parent class of class annotated with @KafkaListener #3465

🐞 Bug Fixes

• Warning log when using AnnotationEnhancer #3469

🔨 Dependency Upgrades

• Bump io.micrometer:micrometer-bom from 1.13.3 to 1.13.4 #3491
• Bump io.micrometer:micrometer-tracing-bom from 1.3.3 to 1.3.4 #3490
• Bump org.springframework.retry:spring-retry from 2.0.8 to 2.0.9 #3489
• Bump io.projectreactor:reactor-bom from 2023.0.9 to 2023.0.10 #3488
• Bump org.springframework:spring-framework-bom from 6.1.12 to 6.1.13 #3487
• Bump org.springframework.data:spring-data-bom from 2024.0.3 to 2024.0.4 #3486

⭐ New Features

• Wrong comparison of server bootstrap addresses in KafkaTemplate.afterSingletonsInstantiated #3473

🐞 Bug Fixes

• Warning log when using AnnotationEnhancer #3470

🔨 Dependency Upgrades

• Bump org.springframework:spring-framework-bom from 6.1.12 to 6.1.13 #3501
• Bump org.springframework.data:spring-data-bom from 2023.1.9 to 2023.1.10 #3500
• Bump org.springframework.retry:spring-retry from 2.0.8 to 2.0.9 #3499
• Bump io.projectreactor:reactor-bom from 2023.0.9 to 2023.0.10 #3498
• Bump io.micrometer:micrometer-bom from 1.12.9 to 1.12.10 #3497
• Bump io.micrometer:micrometer-tracing-bom from 1.2.9 to 1.2.10 #3496

⭐ New Features

• Upgrade to Spring Kafka 3.8.0 #3416
• Error handler throws an exception on blocking retries #3409
• Deserialization error for Acknowledgement in Spring Kafka Listener #3400
• Use the original key in reply messages when using ReplyingKafkaTemplate and SendTo #3395

🐞 Bug Fixes

• AnnotationEnhancer always return the old attributes #3425
• Incorrect JavaDoc for KafkaMessageHeaderAccessor.getBlockingRetryDeliveryAttempt() #3408
• KafkaAdmin clusterId configuration is ignored when observability is enabled and bootstrap supplier is not set #3402
• KafkaConsumer.close() no longer triggers the DefaultKafkaConsumerFactory.listener.removeConsumer() #3375
• Revise AbstractConsumerSeekAware.onPartitionsAssigned() for concurreny #3373
• Fence the MessageLisnterContainer restart once the ConcurrentMessageListenerContainer is stopped #3371
• ConcurrentMessageListenerContainer isChildRunning API is returning false even though active MessageListenerContainer instances are processing messages. #3338

📔 Documentation

• Fix typos in the EnableKafka and tips.adoc #3412
• Fix retry topic documentation for class-level configuration #3396

🔨 Dependency Upgrades

• Bump org.springframework.retry:spring-retry from 2.0.7 to 2.0.8 #3437
• Bump org.junit:junit-bom from 5.11.0-RC1 to 5.11.0 #3436
• Bump org.springframework.data:spring-data-bom from 2024.0.2 to 2024.0.3 #3435
• Bump org.junit:junit-bom from 5.11.0-M2 to 5.11.0-RC1 #3405
• Bump kotlinVersion from 1.9.24 to 1.9.25 #3383

❤️ Contributors

Thank you to all the contributors who worked on this release:

@bky373 and @chickenchickenlove

🐞 Bug Fixes

• KafkaAdmin clusterId configuration is ignored when observability is enabled and bootstrap supplier is not set #3446
• AnnotationEnhancer always return the old attributes #3444
• Incorrect JavaDoc for KafkaMessageHeaderAccessor.getBlockingRetryDeliveryAttempt() #3419
• Fence the MessageLisnterContainer restart once the ConcurrentMessageListenerContainer is stopped #3398
• KafkaConsumer.close() no longer triggers the DefaultKafkaConsumerFactory.listener.removeConsumer() #3390

🔨 Dependency Upgrades

• Bump io.micrometer:micrometer-bom from 1.13.2 to 1.13.3 #3434
• Bump org.springframework:spring-framework-bom from 6.1.11 to 6.1.12 #3433
• Bump io.projectreactor:reactor-bom from 2023.0.8 to 2023.0.9 #3432
• Bump io.micrometer:micrometer-tracing-bom from 1.3.2 to 1.3.3 #3431
• Bump org.springframework.retry:spring-retry from 2.0.7 to 2.0.8 #3430
• Bump org.springframework.data:spring-data-bom from 2024.0.2 to 2024.0.3 #3429
• Bump kotlinVersion from 1.9.24 to 1.9.25 #3379

🐞 Bug Fixes

• KafkaAdmin clusterId configuration is ignored when observability is enabled and bootstrap supplier is not set #3447
• AnnotationEnhancer always return the old attributes #3445
• Incorrect JavaDoc for KafkaMessageHeaderAccessor.getBlockingRetryDeliveryAttempt() #3420
• Fence the MessageLisnterContainer restart once the ConcurrentMessageListenerContainer is stopped #3399

🔨 Dependency Upgrades

• Bump org.springframework.data:spring-data-bom from 2023.1.8 to 2023.1.9 #3443
• Bump io.micrometer:micrometer-tracing-bom from 1.2.8 to 1.2.9 #3442
• Bump io.micrometer:micrometer-bom from 1.12.8 to 1.12.9 #3441
• Bump org.springframework:spring-framework-bom from 6.1.11 to 6.1.12 #3440
• Bump io.projectreactor:reactor-bom from 2023.0.8 to 2023.0.9 #3439
• Bump org.springframework.retry:spring-retry from 2.0.7 to 2.0.8 #3438
• Bump kotlinVersion from 1.9.24 to 1.9.25 #3387

⭐ New Features

• Application receiving ContainerStoppedEvent even though active MessageListenerContainer instances are processing messages. #3340
• Update misleading contents in ConsumerPartitionPausedEvent and features.adoc #3293
• Possible inconsistency in DLT topic naming convention #3291
• Add tracing headers to be mapped to string #3286
• Receiving an empty list when using RecordFilterStrategy on batch messages #2806
• consumer group specific offset seeking for AbstractConsumerSeekAware #2302

🐞 Bug Fixes

• Reset Error reason after ConcurrentContainer is stopped #3372
• Mismatch Between Registered and Found Callbacks in Multi-group Listener Cases #3328
• getUnregisteredListenerContainer return null #3319
• On kotlin application, Spring kafka 3.2.0 doesn't take the message conversion logic, because of the wrong coroutine detection on MessagingMessageListenerAdapter #3277

🔨 Dependency Upgrades

• Bump io.projectreactor:reactor-bom from 2023.0.7 to 2023.0.8 #3363
• Bump io.micrometer:micrometer-bom from 1.13.1 to 1.13.2 #3362
• Bump org.springframework.data:spring-data-bom from 2024.0.1 to 2024.0.2 #3361
• Bump org.springframework.retry:spring-retry from 2.0.6 to 2.0.7 #3360
• Bump io.micrometer:micrometer-tracing-bom from 1.3.1 to 1.3.2 #3359
• Bump kafkaVersion from 3.7.0 to 3.7.1 #3343
• Bump com.fasterxml.jackson:jackson-bom from 2.17.1 to 2.17.2 #3342
• Bump org.junit:junit-bom from 5.10.2 to 5.10.3 #3334
• Bump io.micrometer:micrometer-tracing-bom from 1.3.0 to 1.3.1 #3303
• Bump io.micrometer:micrometer-bom from 1.13.0 to 1.13.1 #3301
• Bump org.springframework.data:spring-data-bom from 2024.0.0 to 2024.0.1 #3300
• Bump io.projectreactor:reactor-bom from 2023.0.6 to 2023.0.7 #3299

❤️ Contributors

Thank you to all the contributors who worked on this release:

@LokeshAlamuri, @artembilan, and @bky373

🐞 Bug Fixes

• getUnregisteredListenerContainer return null #3321

🔨 Dependency Upgrades

• Bump org.springframework:spring-framework-bom from 6.1.10 to 6.1.11 #3357
• Bump io.micrometer:micrometer-bom from 1.13.1 to 1.13.2 #3356
• Bump io.projectreactor:reactor-bom from 2023.0.7 to 2023.0.8 #3355
• Bump org.springframework.retry:spring-retry from 2.0.6 to 2.0.7 #3354
• Bump org.springframework.data:spring-data-bom from 2024.0.1 to 2024.0.2 #3353
• Bump io.micrometer:micrometer-tracing-bom from 1.3.1 to 1.3.2 #3352
• Bump com.fasterxml.jackson:jackson-bom from 2.17.1 to 2.17.2 #3345
• Bump kafkaVersion from 3.7.0 to 3.7.1 #3344
• Bump org.junit:junit-bom from 5.10.2 to 5.10.3 #3336
• Bump org.springframework:spring-framework-bom from 6.1.9 to 6.1.10 #3324

🐞 Bug Fixes

• getUnregisteredListenerContainer return null #3322

🔨 Dependency Upgrades

• Bump org.springframework:spring-framework-bom from 6.1.10 to 6.1.11 #3370
• Bump io.projectreactor:reactor-bom from 2023.0.7 to 2023.0.8 #3369
• Bump io.micrometer:micrometer-tracing-bom from 1.2.7 to 1.2.8 #3368
• Bump org.springframework.data:spring-data-bom from 2023.1.7 to 2023.1.8 #3367
• Bump io.micrometer:micrometer-bom from 1.12.7 to 1.12.8 #3366
• Bump org.springframework.retry:spring-retry from 2.0.6 to 2.0.7 #3365
• Bump org.junit:junit-bom from 5.10.2 to 5.10.3 #3337
• Bump org.springframework:spring-framework-bom from 6.1.9 to 6.1.10 #3327

⭐ New Features

• Add tracing headers to be mapped to string #3287

🐞 Bug Fixes

• On kotlin application, Spring kafka 3.2.0 doesn't take the message conversion logic, because of the wrong coroutine detection on MessagingMessageListenerAdapter #3289

🔨 Dependency Upgrades

• Bump io.micrometer:micrometer-tracing-bom from 1.3.0 to 1.3.1 #3310
• Bump org.springframework:spring-framework-bom from 6.1.8 to 6.1.9 #3309
• Bump io.projectreactor:reactor-bom from 2023.0.6 to 2023.0.7 #3308
• Bump io.micrometer:micrometer-bom from 1.13.0 to 1.13.1 #3306
• Bump org.springframework.data:spring-data-bom from 2024.0.0 to 2024.0.1 #3305
• Bump org.springframework:spring-framework-bom from 6.1.7 to 6.1.8 #3285

⭐ New Features

• Add tracing headers to be mapped to string #3288

🔨 Dependency Upgrades

• Bump org.springframework.data:spring-data-bom from 2023.1.6 to 2023.1.7 #3316
• Bump io.projectreactor:reactor-bom from 2023.0.6 to 2023.0.7 #3315
• Bump org.springframework:spring-framework-bom from 6.1.8 to 6.1.9 #3314
• Bump io.micrometer:micrometer-tracing-bom from 1.2.6 to 1.2.7 #3313
• Bump io.micrometer:micrometer-bom from 1.12.6 to 1.12.7 #3312
• Bump org.springframework:spring-framework-bom from 6.1.7 to 6.1.8 #3279

⭐ New Features

• Implement CommonErrorHandler.handleOne() in CommonDelegatingErrorHandler #3227

🐞 Bug Fixes

• Documentation for configuring custom ConsumerFactory and ProducerFactory beans when using Spring Boot is incorrect #3242
• Switch EmbeddedKafaka#kraft default to false #3238
• Creation of kafkaJaasInitializer bean fails in a read-only filesystem due to creation of temporary file #3217
• KafkaTemplate currentSpan tagging issue #3210

📔 Documentation

• Adding more whats-new for kakfa-client 3.7.0 #3253
• Minor docs cleanup #3245
• Update Boot versions in docs #3233
• Embedded Kafka throws NoSuchFileException #3225
• Fix enforceRebalance #3215
• Fix ackDiscarded. #3212

🔨 Dependency Upgrades

• Bump org.springframework.data:spring-data-bom from 2024.0.0-SNAPSHOT to 2024.0.0 #3273
• Bump org.springframework.retry:spring-retry from 2.0.5 to 2.0.6 #3272
• Bump io.projectreactor:reactor-bom from 2023.0.5 to 2023.0.6 #3270
• Bump org.springframework:spring-framework-bom from 6.1.6 to 6.1.7 #3269
• Bump com.fasterxml.jackson:jackson-bom from 2.17.0 to 2.17.1 #3249
• Bump kotlinVersion from 1.9.23 to 1.9.24 #3248
• Bump org.jetbrains.kotlinx:kotlinx-coroutines-reactor from 1.8.0 to 1.8.1 #3247

❤️ Contributors

Thank you to all the contributors who worked on this release:

@bky373, @chickenchickenlove, @nachomdo, and @sobychacko

⭐ New Features

• Implement CommonErrorHandler.handleOne() in CommonDelegatingErrorHandler #3230

🐞 Bug Fixes

• Documentation for configuring custom ConsumerFactory and ProducerFactory beans when using Spring Boot is incorrect #3244
• Creation of kafkaJaasInitializer bean fails in a read-only filesystem due to creation of temporary file #3219
• KafkaTemplate currentSpan tagging issue #3213

🔨 Dependency Upgrades

• Bump org.springframework:spring-framework-bom from 6.1.6 to 6.1.7 #3262
• Bump org.springframework.data:spring-data-bom from 2023.1.5 to 2023.1.6 #3261
• Bump io.projectreactor:reactor-bom from 2023.0.5 to 2023.0.6 #3260
• Bump org.springframework.retry:spring-retry from 2.0.5 to 2.0.6 #3259
• Bump io.micrometer:micrometer-tracing-bom from 1.2.5 to 1.2.6 #3258
• Bump io.micrometer:micrometer-bom from 1.12.5 to 1.12.6 #3257
• Bump kotlinVersion from 1.9.23 to 1.9.24 #3252

⭐ New Features

• Implement CommonErrorHandler.handleOne() in CommonDelegatingErrorHandler #3231

🐞 Bug Fixes

• KafkaTemplate currentSpan tagging issue #3214

🔨 Dependency Upgrades

• Bump org.springframework:spring-framework-bom from 6.0.19 to 6.0.20 #3266
• Bump org.springframework.retry:spring-retry from 2.0.5 to 2.0.6 #3265
• Bump io.projectreactor:reactor-bom from 2022.0.18 to 2022.0.19 #3264

⭐ New Features

• @PartitionOffset supprt TopicPartitionOffset.SeekPosition #3178
• Add an option to leave consumer group when closing Streams #3168
• Add checkstyle rule on empty-line-separater #3162
• Remove org.apache.kafka native runtime hints #3147
• Adding new KafkaListenerEndpointRegistry.getListenerContainersMatchingId(predicate: Predicate<String>) #3135
• Allows to initialize/inject the Topology object without starting the Kafka streams. #3020
• More and proper tags for observation spans #2609

🐞 Bug Fixes

• Duplicate record consumption due to offset decrease in last offset commit #3186
• Setting the Kafka Streams property default.dsl.store has no effect #3176
• BatchInterceptor is not working properly with retries #3166
• MDCs are missing in logs produced by DefaultErrorHandler. #3151
• In kafka events, the traceId and spanId are not written in the logs #3146

📔 Documentation

• fix typo in JsonDeSerializer.TYPE_MAPPINGS #3144
• Spring Kafka not working properly with Java 21 Virtual Threads, listeners are tied to a platform thread forever #3074

🔨 Dependency Upgrades

• Bump org.springframework:spring-framework-bom from 6.1.5 to 6.1.6 #3194
• Bump io.projectreactor:reactor-bom from 2023.0.4 to 2023.0.5 #3193
• Bump log4jVersion from 2.23.0 to 2.23.1 #3157

❤️ Contributors

Thank you to all the contributors who worked on this release:

@JooHyukKim, @juwit, @sobychacko, and @system205

🐞 Bug Fixes

• Duplicate record consumption due to offset decrease in last offset commit #3190
• Setting the Kafka Streams property default.dsl.store has no effect #3181
• BatchInterceptor is not working properly with retries #3170
• MDCs are missing in logs produced by DefaultErrorHandler. #3154
• In kafka events, the traceId and spanId are not written in the logs #3149

🔨 Dependency Upgrades

• Bump org.springframework.data:spring-data-bom from 2023.1.4 to 2023.1.5 #3201
• Bump org.springframework:spring-framework-bom from 6.1.5 to 6.1.6 #3200
• Bump io.micrometer:micrometer-bom from 1.12.4 to 1.12.5 #3199
• Bump io.micrometer:micrometer-tracing-bom from 1.2.4 to 1.2.5 #3198
• Bump io.projectreactor:reactor-bom from 2023.0.4 to 2023.0.5 #3197

🐞 Bug Fixes

• Duplicate record consumption due to offset decrease in last offset commit #3191
• Setting the Kafka Streams property default.dsl.store has no effect #3182
• BatchInterceptor is not working properly with retries #3171
• MDCs are missing in logs produced by DefaultErrorHandler. #3153
• In kafka events, the traceId and spanId are not written in the logs #3150

🔨 Dependency Upgrades

• Bump org.springframework:spring-framework-bom from 6.0.18 to 6.0.19 #3196
• Bump io.projectreactor:reactor-bom from 2022.0.17 to 2022.0.18 #3195

⭐ New Features

• Upgrade Apache Kafka client version to 3.7.0 #3116
• @RetryableTopic support KL annotated on class part 2 #3112
• @RetryableTopic support @KafkaListener annotated on class part 1 #3107
• Correct class naming convention for 'hat' in serializer/deserializer Doc #3106
• polish retryable topic. #3104
• fix bug at KafkaMessageListenerContainerTests.testInvokeRecordInterceptorAllSkipped() #3091
• Polish KafkaMessageListenerContainer #3090
• Fix race condition at TransactionalContainerTests.testBatchListenerRecoverAfterRollbackProcessorCrash #3081
• Polish KafkaMessageListenerContainer #3079
• Compute New Seek Position From Current Offset #3078
• GH-2775: Deprecate ContainerProperties properties transactionManager #3066
• Polish KafkaTemplate #3065
• ConcurrentMessageListenerContainer#isInExpectedState consistency problem #3063
• Fix TestOOMError#testOOMCMLC throw ConcurrentModificationException #3059
• ReactiveKafkaConsumerTemplate missing receiveBatch method #3057
• Change @RetryableTopic properties SameIntervalTopicReuseStrategy behavior to SINGLE_TOPIC #3052
• Add properties to ContainerProperties.toString #3046
• polish adoc for kafka chapter #3045
• Cleanup ConcurrentMessageListenerContainerMockTests #3044
• Provide API methods of accessing HostInfo in KafkaStreamsInteractiveQueryService #3034
• Non-blocking retry using KafkaListener on class level #3012
• Use application name as default clientId #3001

🐞 Bug Fixes

• Failing to handle deserialization exceptions in batch listener #3114
• Unsafe access to Kafka consumer in seek operation #3108
• KafkaMessageListenerContainer doesn't properly clear threadState of AfterRollbackProcessor #3076
• CommonDelegatingErrorHandler does not check delegates compatibility correctly #3050
• Listener exceptions not saved to the observation #3049
• Enhanced monitoring when KMLC is batch listener #3047
• fix bug about method ConsumerSeekAware.seekRelative #3043
• DefaultErrorHandler is not able to seek in case of an exception during the commit #3019
• Calling DefaultKafkaHeaderMapper constructor with the same ObjectMapper instance may result memory leak #2611

📔 Documentation

• Remove retry-topic-lcf.adoc introduce useLegacyFactoryConfigurer #3084
• Non-Blocking Retries cannot combine with container transactions. #3072

🔨 Dependency Upgrades

• Bump org.springframework:spring-framework-bom from 6.1.4 to 6.1.5 #3130
• Bump io.projectreactor:reactor-bom from 2023.0.3 to 2023.0.4 #3129
• Bump org.apache.zookeeper:zookeeper from 3.8.3 to 3.8.4 #3111
• Bump kotlinVersion from 1.9.22 to 1.9.23 #3110
• Bump com.github.spotbugs from 6.0.7 to 6.0.8 #3096

❤️ Contributors

Thank you to all the contributors who worked on this release:

@Wzy19930507, @qeeqez, @selllami, and @sobychacko

⭐ New Features

• fix bug at KafkaMessageListenerContainerTests.testInvokeRecordInterceptorAllSkipped() #3094
• Align RecordInterceptor and BatchInterceptor lifecycle. #3092
• ConcurrentMessageListenerContainer#isInExpectedState consistency problem #3068
• Fix TestOOMError#testOOMCMLC throw ConcurrentModificationException #3061

🐞 Bug Fixes

• Failing to handle deserialization exceptions in batch listener #3118
• KafkaMessageListenerContainer doesn't properly clear threadState of AfterRollbackProcessor #3102
• Listener exceptions not saved to the observation #3085
• CommonDelegatingErrorHandler does not check delegates compatibility correctly #3062
• DefaultErrorHandler is not able to seek in case of an exception during the commit #3060

📔 Documentation

• Remove retry-topic-lcf.adoc introduce useLegacyFactoryConfigurer #3087

🔨 Dependency Upgrades

• Bump org.springframework.data:spring-data-bom from 2023.1.3 to 2023.1.4 #3139
• Bump org.springframework:spring-framework-bom from 6.1.4 to 6.1.5 #3134
• Bump io.micrometer:micrometer-bom from 1.12.3 to 1.12.4 #3132
• Bump kotlinVersion from 1.9.22 to 1.9.23 #3131
• Bump io.micrometer:micrometer-tracing-bom from 1.2.3 to 1.2.4 #3127
• Bump io.projectreactor:reactor-bom from 2023.0.3 to 2023.0.4 #3125
• Bump org.apache.zookeeper:zookeeper from 3.8.3 to 3.8.4 #3124

⭐ New Features

• Provide a way to support Consumer#enforceRebalance #3075

🐞 Bug Fixes

• Failing to handle deserialization exceptions in batch listener #3119
• KafkaMessageListenerContainer doesn't properly clear threadState of AfterRollbackProcessor #3103
• Listener exceptions not saved to the observation #3086

🔨 Dependency Upgrades

• Bump kotlinVersion from 1.7.20 to 1.7.22 #3133
• Bump org.springframework:spring-framework-bom from 6.0.17 to 6.0.18 #3128
• Bump io.projectreactor:reactor-bom from 2022.0.16 to 2022.0.17 #3126

⭐ New Features

• Provide a recovery callback for the execute method of RetryingDeserializer #3032
• Remove AbstractMessageListenerContainer.isPaused #3016
• Provide a way to support Consumer#enforceRebalance #3011
• Implementation Deserializer.deserialize(String, Headers, ByteBuffer) #3009
• Polish DestinationTopicPropertiesFactory #3004
• Consider providing an API for Kafka Streams Interactive Queries #2942
• Provide a way to customize a transactionIdSuffix #2852
• Non-Blocking Retries: Consider Making it Easier to Route to Different DLTs by Exception Type #2800
• Asynchronous server-side processing in a request/reply scenario #1189

📔 Documentation

• Clarify retries in KSIQS docs #3033

🔨 Dependency Upgrades

• Bump org.springframework:spring-framework-bom from 6.1.3 to 6.1.4 #3039
• Bump com.fasterxml.jackson:jackson-bom from 2.15.3 to 2.15.4 #3038
• Bump io.projectreactor:reactor-bom from 2023.0.2 to 2023.0.3 #3037
• Bump org.junit:junit-bom from 5.10.1 to 5.10.2 #3029
• Bump com.github.spotbugs from 6.0.6 to 6.0.7 #3006

❤️ Contributors

Thank you to all the contributors who worked on this release:

@Wzy19930507 and @sobychacko