spring-batch-redis

Changelog

🔄️ Changes

• ee1ba3c Renamed variables
• ee4e020 merged live and redis reader scan options

🛠 Build

• 9d1acc1 Fixed reader names
• 8c71834 updated after refactoring
• 50fbdf9 Bump for next dev cycle

• 504ec17 Releasing version 3.6.1

Changelog

🚀 Features

• 8afceec Added streamLength method
• e23017c Added size method for readers

🔄️ Changes

• c9f3920 Removed unused SynchronizedPollableItemReader
• c0dc6d4 Removed unused classes

🛠 Build

• 2b0f01d Updated after refactoring
• 169b9a7 Added tests for write operations
• e8fa0aa Fixed scan size estimator test
• 7a6ff03 Bump for next dev cycle

• 77a238d Releasing version 3.6.0

Changelog

🚀 Features

• ec2144f Made memory usage disabled by default
• db9e16d Added mem usage filtering

🔄️ Changes

• 99f31e9 🚨 Simplified code for readers and writers
• ef76317 Cleaned up operation

🛠 Build

• bb13002 disabled memory usage
• 10f3ee9 Disabled memory usage by default
• 312729b Moved mem usage tests to stack only
• 5963b14 Moved flaky test to stack only
• 3cab28c Upgraded gradle
• b9a292a Split out modules tests
• c131018 Refactored base classes
• 4df9b0f Bump for next dev cycle
• 2a6ac98 Centralized waits

• dc7878a Releasing version 3.5.1

Changelog

🚀 Features

• 8ebc28c Exposed keyspace notification reader

🛠 Build

• 40cba94 Bump for next dev cycle

• 3906cea Releasing version 3.5.0

Changelog

🔄️ Changes

• aca1baf 🚨 Introduced reader options

🛠 Build

• 73e411e Added waits
• c05ae3b Bump for next dev cycle
• 4115c24 Added waits

• ff8843b Releasing version 3.4.0

Changelog

🚀 Features

• 55e222a Made generator key range unbounded by default

🐛 Fixes

• bb56f6d Reverted range separator to :

🔄️ Changes

• 286d160 🚨 using setter instead of with methods

🛠 Build

• f6db320 Added wait in byte array test
• 8264c34 Bump for next dev cycle

• 54018c5 Using JDK 19
• 215fa90 Disabled test for releases
• 4c8d2f8 Releasing version 3.3.1

Changelog

🔀 Merge

• 61a3ef3 Merge branch 'master' of https://github.com/redis-developer/spring-batch-redis.git

🚀 Features

• 0ff6d9d Added job failure check in RedisItemReader.read()
• 3f32365 🚨 Added datastructure writer merge and stream id policy

🐛 Fixes

• 144fb07 Synchronized reader and writers main methods
• d1d1dc6 Fixed reader and jobrunner checks
• e20b778 increased default poll interval
• d41784c Added check for reader closed in read method
• 8321c40 Added check for empty collection in AddAll operations

🔄️ Changes

• 66dedb2 Removed codec from builders
• b3d434e Removed codec from reader builder
• a4f3733 Removed JobRunner and simplified reader and writer builders
• d7acb22 🚨 Introduced options classes for writer and estimator
• 9873cbc Added Lua scripts for ds reads and dumps
• 0ea4b64 Removed unused classes
• 69af859 Removed unused classes
• 54aca2a Removed unused class
• 60c56ca Removed unused code

🧰 Tasks

• 77f4163 Removed logging from flushing steps

🛠 Build

• 443b2fb Added waits
• 95905ec Added wait for compare step
• 10c34d9 Added waits for reader and writer close
• f6d691a Ignoring timeout on jobexecution termination for live replications
• eb78256 Bump for next dev cycle
• 7063a09 removed db size check
• fcc81aa Added await in compare
• d889e79 Fixed JobRunner being reused across test suites
• d6097f8 Fixed open checks
• 1918cf5 increased default poll interval and idle timeout
• ea27ffb Added condition checks in job runs
• aab0276 Fixed race conditions in liveReplication
• ea7c217 Fixed race conditions
• eb116ce fixed readLive test
• 4f5bb4d Added sadd and sugaddIncr tests
• 177d1b2 Fixed unused import
• 3c204fb Added JobRunner multithreaded step test
• 0c6193c Added sample and suggestion converter tests
• dd0d3d0 Bump for next dev cycle
• 7f5cdc8 removed testcontainers-redis-junit

⚙️ Dependencies

• e472f49 Upgraded lettucemod

• 66587d8 Releasing version 3.2.3

Changelog

🔀 Merge

• b955e05 Merge branch 'master' of https://github.com/redis-developer/spring-batch-redis.git

🚀 Features

• 71345a5 Made throttled item reader also a pollable item reader

🛠 Build

• 9df76cf Checking readers and writers are closed
• c53652e Bump for next dev cycle

⚙️ Dependencies

• 274dcf9 Updated spring boot

• b7da924 Releasing version 3.2.2

Changelog

🚀 Features

• a081361 Added batch read method

🛠 Build

• 389da3d Removed @Nested test classes
• bc7fd49 Made spring-batch-core API
• 0ada5d8 Waiting until reader and writer are closed before asserting
• dc4e7be Bump for next dev cycle

⚙️ Dependencies

• a942963 Upgraded spring boot and lettucemod

• 72f6127 Releasing version 3.2.1

Changelog

🐛 Fixes

• e6f64a1 Closing StreamItemReader connection on close

🛠 Build

• 06e7712 Bump for next dev cycle

• 99ab2a7 Releasing version 3.2.0

Changelog

🚀 Features

• 4f3c5b5 🚨 Introduced priority queue for keyspace notifications

🐛 Fixes

• cfc6313 Fixed scan key item reader

🔄️ Changes

• 458e963 refactored builder API
• 9f54392 🚨 Introduced ReaderOptions

🛠 Build

• 36df3da Removed changelog format option
• 0e21630 Introduced RedisContainerFactory
• fd19fed Using synchronized list item writers
• ea2d236 consolidated containers
• d0cb811 Fixed logging
• 973bcd5 Added checks for opened/closed item readers and writers
• 4f6cf1f Fixed JobRunner initialization
• bb01c4a Fixed enterprise tests
• bb12c83 Added modules to enterprise database
• 41df854 Bump for next dev cycle
• ee4abdb Fixed target client config
• ff10796 Compiling against JDK 8 API
• a7db8a7 Bump for next dev cycle

📝 Documentation

• d327862 Removed obsolete snapshot badge

⚙️ Dependencies

• e0c9fc9 Upgraded spring boot plugin and lettucemod

Changelog

🔀 Merge

• aeeda49 Merge branch 'master' of https://github.com/redis-developer/spring-batch-redis.git
• 16f5f92 Merge branch 'master' of https://github.com/redis-developer/spring-batch-redis.git

🚀 Features

• c7c5bff feat: Added pruning process to HotKeyFilter
• bfba62a feat: Introduced keyspace notif reader listeners to wire hot-key filter
• a59fcd1 feat!: Added hot/big-key filter

🐛 Fixes

• 3246153 fix: fix: compile issue on HotKeyFilter
• b8d35f4 fix: compile issue
• 5891fc9 fix: Using shutdown method instead of 19-only close
• ddc4933 fix: Introduced stop method in queue reader

🔄️ Changes

• 5d1e0a7 refactor: Using Function.identity() where possible
• 3188ef2 refactor: returning entry set instead of map
• 3149b5a refactor!: polished hot-key filter and changed dependent classes
• 12022a7 refactor: simplified HotKeyFilter
• 488bb02 refactor: cleaned up generics and use of Exception
• 08607c7 refactor!: Simplified test options and removed FlushingStepOptions
• ce455ea refactor: using queue reader close method and handling interrupted
• e9f241d refactor: Fixed invalid method reference
• 0691c38 refactor: introduced key queue for future big key filtering
• f90c73d refactor: using set in notification reader instead of scanning queue for
• 493022c refactor: data-structure operations and keyspace notification reader

🛠 Build

• 4d0a09e build: added enforcer rules
• cbee22f build: Switched to single-jar distributions
• 8e1450b build: Using jreleaser 1.4.0
• 5a18578 test: Added wait for writers to be closed
• 8dcb5fe build: Removed jreleaser checksum
• 58e39ff build: Disabled JReleaser file signing
• c8d41f6 build: Bump for next dev cycle
• af2f722 build: Disabled checksum
• 6a08659 build: Bump for next dev cycle
• 5207b90 build: Upgraded kordamp build and plugins
• f073b31 build: Enabled signing
• 8755a6f test: Disabled unreliable test
• d3fb58d test: Disabled unreliable test
• 0998c9a build: Reverted to snapshot version
• 6115b5a ci: Added publishing to maven central
• b80a010 build: Reverted to snapshot version
• bd943ae ci: Using Redis Github Workflows
• 95d952a test: Added synchronization for async jobs
• 420e7f9 ci: Using default java version
• c612085 test: Waiting for reader to be open before writing to database
• b3753ed ci: Using redis-github-workflows
• f02950d test: fixed race condition in filter test
• 1acf6f6 test: set name on hot key filter
• d54eb05 test: Fixing race condition issues
• 9324820 ci: Reverted to previous workflow
• eaa3b35 test: Fixed overlapping job names
• 6175728 ci: Added step to upload test reports
• c2e77df ci: migrated to Kordamp reusable github workflows
• 1e041d3 build: Upgraded kordamp plugins
• 2bd2371 test: fixed test component name
• cb4b84d test: Fixed readMessages message count
• b78d717 build: Upgraded gradle
• 404b086 build: Upgraded boot and kordamp build plugins
• 606dac7 test: Reduced dataset sizes for faster tests
• d113428 test: Added wait for readMessages completion
• 4bd911e test: Added logging for source/target comparison
• 82d2557 test: Fixed Stream.readMessages
• 545f5cd build: bump for next development cycle

• 3b84a10 Releasing version 3.1.0
• 33496d3 Releasing version 3.1.0
• b72e06d Releasing version 3.1.0
• dee2d6c Releasing version 3.1.0

Changelog

🔀 Merge

• 17454f0 Merge branch 'master' of https://github.com/redis-developer/spring-batch-redis.git

🚀 Features

• 59ee631 Added pending message recovery in StreamItemReader. Resolves #58

🛠 Build

• b086679 bump for next development cycle

• 8c4f7da Releasing version 3.0.7

Changelog

🐛 Fixes

• 39f7aa5 Restored ack method

🛠 Build

• 5543497 bump for next development cycle

• d42b25a Releasing version 3.0.6

Changelog

🔄️ Changes

• acc67a4 simplified reader queuing and stream reader

🛠 Build

• f9efb45 Upgraded github actions
• 5dcb016 Upgraded redis-release-action
• 5b7da59 Updated jreleaser project settings
• 851047e bump for next development cycle

⚙️ Dependencies

• 0b26384 Upgraded lettucemod

• 0e09c96 Releasing version 3.0.5
• 2a47986 Releasing version 3.0.4

Changelog

🚀 Features

• 7b2677e Added checks for empty collections

🛠 Build

• d663b9c bump for next development cycle

• 4f7a627 Releasing version 3.0.3

Changelog

🐛 Fixes

• 3859ead DataStructureOperation should handle NONE type as a delete

🛠 Build

• 8290a88 Running multi-stream tests only on standalone Redis container
• a86c691 Added wait until for stream tests
• 43fdced fixed multi stream tests
• 8273ce5 bump for next dev cycle

⚙️ Dependencies

• 1038c5b Upgraded Spring Boot plugin

• 1f1044c Releasing version 3.0.2

Changelog

🛠 Build

• b86202f bump for next dev cycle

⚙️ Dependencies

• fa21764 Upgraded lettucemod
• 12f2f85 Upgraded to lettucemod 3.1.5

• e8dee57 Releasing version 3.0.1

Changelog

🚀 Features

• 08522fe Added key-slot filter in keyspace notification reader

🔄️ Changes

• b094a64 🚨 Simplified connection pool builder

🛠 Build

• 3b4d230 bump for next dev cycle

• 63d18e4 Releasing version 3.0.0

Changelog

🔄️ Changes

• 5c9ca77 Introduced QueueOptions and FlushingOptions
• 9646706 Using connection pool instead of redis client
• 17ce054 Evolve deprecated Lettuce code

🛠 Build

• 5e9b54f ensure unique job names
• e49e255 fix for comparator results
• 66c01d3 fixed comparator test
• 1f38cf6 Bump for next development cycle

⚙️ Dependencies

• 5e41d52 Upgraded spring boot and lettucemod

• 91f4e0e Releasing version 2.34.1