sarama

Sarama is a Go library for Apache Kafka.

MIT License

Stars
11K
Committers
291

Bot releases are visible (Hide)

sarama - Version 1.34.0 (2022-05-30)

Published by dnwe over 2 years ago

What's Changed

🎉 New Features / Improvements

🐛 Fixes

🔧 Maintenance

New Contributors

Full Changelog: https://github.com/Shopify/sarama/compare/v1.33.0...v1.34.0

sarama - Version 1.33.0 (2022-05-11)

Published by dnwe over 2 years ago

What's Changed

🚨 Breaking Changes

Note: with this change, the user of Sarama is required to use Go 1.13's errors.Is etc (rather then ==) when forming conditionals returned by this library.

🎉 New Features / Improvements

🐛 Fixes

đŸ“Ļ Dependency updates

🔧 Maintenance

➕ Other Changes

New Contributors

Full Changelog: https://github.com/Shopify/sarama/compare/v1.32.0...v1.33.0

sarama - Version 1.32.0 (2022-02-24)

Published by dnwe over 2 years ago

⚠ī¸ This release has been superseded by v1.33.0 and should not be used.


What's Changed

🐛 Fixes

đŸ“Ļ Dependency updates

🔧 Maintenance

➕ Other Changes

Full Changelog: https://github.com/Shopify/sarama/compare/v1.31.1...v1.32.0

sarama - Version 1.31.1 (2022-02-01)

Published by bai over 2 years ago

What's Changed

🎉 New Features / Improvements

🐛 Fixes

đŸ“Ļ Dependency updates

🔧 Maintenance

New Contributors

Full Changelog: https://github.com/Shopify/sarama/compare/v1.31.0...v1.31.1

sarama - Version 1.31.0 (2022-01-18)

Published by dnwe over 2 years ago

What's Changed

🎉 New Features / Improvements

🐛 Fixes

🔧 Maintenance

📝 Documentation

➕ Other Changes

New Contributors

Full Changelog: https://github.com/Shopify/sarama/compare/v1.30.1...v1.31.0

sarama - Version 1.30.1 (2021-12-04)

Published by dnwe almost 3 years ago

What's Changed

🎉 New Features / Improvements

🐛 Fixes

🔧 Maintenance

Notes

  • ℹī¸ from Sarama 1.30.x onward the minimum version of Go toolchain required is 1.16.x

New Contributors

Full Changelog: https://github.com/Shopify/sarama/compare/v1.30.0...v1.30.1

sarama - Version 1.30.0 (2021-09-29)

Published by bai about 3 years ago

⚠ī¸ This release has been superseded by v1.30.1 and should not be used.

regression: enabling rackawareness causes severe throughput drops (#2071) — fixed in v1.30.1 via #2076


ℹī¸ Note: from Sarama 1.30.0 the minimum version of Go toolchain required is 1.16.x


New Features / Improvements

  • #1983 - @zifengyu - allow configure AllowAutoTopicCreation argument in metadata refresh
  • #2000 - @matzew - Using xdg-go module for SCRAM
  • #2003 - @gdm85 - feat: add counter metrics for consumer group join/sync and their failures
  • #1992 - @zhaomoran - feat: support SaslHandshakeRequest v0 for SCRAM
  • #2006 - @faillefer - Add support for DeleteOffsets operation
  • #1909 - @agriffaut - KIP-546 Client quota APIs
  • #1633 - @aldelucca1 - feat: allow balance strategies to provide initial state
  • #1275 - @dnwe - log: add a DebugLogger that proxies to Logger
  • #2018 - @dnwe - feat: use DebugLogger reference for goldenpath log
  • #2019 - @dnwe - feat: add logging & a metric for producer throttle
  • #2023 - @dnwe - feat: add Controller() to ClusterAdmin interface
  • #2025 - @dnwe - feat: support ApiVersionsRequest V3 protocol
  • #2028 - @dnwe - feat: send ApiVersionsRequest on broker open
  • #2034 - @bai - Add support for kafka 3.0.0

Fixes

  • #1990 - @doxsch - fix: correctly pass ValidateOnly through to CreatePartitionsRequest
  • #1988 - @LubergAlexander - fix: correct WithCustomFallbackPartitioner implementation
  • #2001 - @HurSungYun - docs: inform AsyncProducer Close pitfalls
  • #1973 - @qiangmzsx - fix: metrics still taking up too much memory when metrics.UseNilMetrics=true
  • #2007 - @bai - Add support for Go 1.17
  • #2009 - @dnwe - fix: enable nilerr linter and fix iferr checks
  • #2010 - @dnwe - chore: enable exportloopref and misspell linters
  • #2013 - @faillefer - fix(test): disable encoded response/request check when map contains multiple elements
  • #2015 - @bai - Change default branch to main
  • #1718 - @crivera-fastly - fix: correct the error handling in client.InitProducerID()
  • #1984 - @null-sleep - fix(test): bump confluentPlatformVersion from 6.1.1 to 6.2.0
  • #2016 - @dnwe - chore: replace deprecated Go calls
  • #2017 - @dnwe - chore: delete legacy vagrant script
  • #2020 - @dnwe - fix(test): remove testLogger from TrackLeader test
  • #2024 - @dnwe - chore: bump toxiproxy container to v2.1.5
  • #2033 - @bai - Update dependencies
  • #2031 - @gdm85 - docs: do not mention buffered messages in sync producer Close method
  • #2035 - @dnwe - chore: populate the missing kafka versions
  • #2038 - @dnwe - feat: add a fuzzing workflow to github actions

New Contributors

Full Changelog: https://github.com/Shopify/sarama/compare/v1.29.1...v1.30.0

sarama - Version 1.29.1 (2021-06-24)

Published by dnwe over 3 years ago

New Features / Improvements

  • #1966 - @ajanikow - KIP-339: Add Incremental Config updates API
  • #1964 - @ajanikow - Add DelegationToken ResourceType

Fixes

  • #1962 - @hanxiaolin - fix(consumer): call interceptors when MaxProcessingTime expire
  • #1971 - @KerryJava - fix kafka-producer-performance throughput panic
  • #1968 - @dnwe - chore: bump golang.org/x versions
  • #1956 - @joewreschnig - Allow checking the entire ProducerMessage in the mock producers
  • #1963 - @dnwe - fix: ensure backoff timer is re-used
  • #1949 - @dnwe - fix: explicitly use uint64 for payload length
sarama - Version 1.29.0 (2021-05-07)

Published by dnwe over 3 years ago

New Features / Improvements

  • #1917 - @arkady-emelyanov - KIP-554: Add Broker-side SCRAM Config API
  • #1869 - @wyndhblb - zstd: encode+decode performance improvements
  • #1541 - @izolight - add String, (Un)MarshalText for acl types.
  • #1921 - @bai - Add support for Kafka 2.8.0

Fixes

  • #1936 - @dnwe - fix(consumer): follow preferred broker
  • #1933 - @ozzieba - Use gofork for encoding/asn1 to fix ASN errors during Kerberos authentication
  • #1929 - @celrenheit - Handle isolation level in Offset(Request|Response) and require stable offset in FetchOffset(Request|Response)
  • #1926 - @dnwe - fix: correct initial CodeQL findings
  • #1925 - @bai - Test out CodeQL
  • #1923 - @bestgopher - Remove redundant switch-case, fix doc typos
  • #1922 - @bai - Update go dependencies
  • #1898 - @mmaslankaprv - Parsing only known control batches value
  • #1887 - @withshubh - Fix: issues affecting code quality
sarama - Version 1.28.0 (2021-02-15)

Published by bai over 3 years ago

Note that with this release we change RoundRobinBalancer strategy to match Java client behavior. See #1788 for details.

  • #1870 - @kvch - Update Kerberos library to latest major
  • #1876 - @bai - Update docs, reference pkg.go.dev
  • #1846 - @wclaeys - Do not ignore Consumer.Offsets.AutoCommit.Enable config on Close
  • #1747 - @XSAM - fix: mock sync producer does not handle the offset while sending messages
  • #1863 - @bai - Add support for Kafka 2.7.0 + update lz4 and klauspost/compress dependencies
  • #1788 - @kzinglzy - feat[balance_strategy]: announcing a new round robin balance strategy
  • #1862 - @bai - Fix CI setenv permissions issues
  • #1832 - @ilyakaznacheev - Update Godoc link to pkg.go.dev
  • #1822 - @danp - KIP-392: Allow consumers to fetch from closest replica
sarama - Version 1.27.2 (2020-10-21)

Published by d1egoaz almost 4 years ago

Improvements

#1750 - @krantideep95 Adds missing mock responses for mocking consumer group

Fixes

#1817 - reverts #1785 - Add private method to Client interface to prevent implementation

sarama - Version 1.27.1 (2020-10-07)

Published by vvuibert about 4 years ago

Improvements

#1775 - @d1egoaz - Adds a Producer Interceptor example
#1781 - @justin-chen - Refresh brokers given list of seed brokers
#1784 - @justin-chen - Add randomize seed broker method
#1790 - @d1egoaz - remove example binary
#1798 - @bai - Test against Go 1.15
#1785 - @justin-chen - Add private method to Client interface to prevent implementation
#1802 - @uvw - Support Go 1.13 error unwrapping

Fixes

#1791 - @stanislavkozlovski - bump default version to 1.0.0

sarama - Version 1.27.0 (2020-08-11)

Published by d1egoaz about 4 years ago

Improvements

#1466 - @rubenvp8510 - Expose kerberos fast negotiation configuration
#1695 - @KJTsanaktsidis - Use docker-compose to run the functional tests
#1699 - @wclaeys - Consumer group support for manually comitting offsets
#1714 - @bai - Bump Go to version 1.14.3, golangci-lint to 1.27.0
#1726 - @d1egoaz - Include zstd on the functional tests
#1730 - @d1egoaz - KIP-42 Add producer and consumer interceptors
#1738 - @varun06 - fixed variable names that are named same as some std lib package names
#1741 - @varun06 - updated zstd dependency to latest v1.10.10
#1743 - @varun06 - Fixed declaration dependencies and other lint issues in code base
#1763 - @alrs - remove deprecated tls options from test
#1769 - @bai - Add support for Kafka 2.6.0

Fixes

#1697 - @kvch - Use gofork for encoding/asn1 to fix ASN errors during Kerberos authentication
#1744 - @alrs - Fix isBalanced Function Signature

sarama - Version 1.26.4 (2020-05-19)

Published by d1egoaz over 4 years ago

Fixes

  • #1701 - @d1egoaz - Set server name only for the current broker
  • #1694 - @dnwe - testfix: set KAFKA_HEAP_OPTS for zk and kafka
sarama - Version 1.26.3 (2020-05-07)

Published by d1egoaz over 4 years ago

Fixes

  • #1692 - @d1egoaz - Set tls ServerName to fix issue: either ServerName or InsecureSkipVerify must be specified in the tls.Config
sarama - Version 1.26.2 (2020-05-06)

Published by dnwe over 4 years ago

⚠ī¸ Known Issues

This release has been marked as not ready for production and may be unstable, please use v1.26.4.

Improvements

  • #1560 - @iyacontrol - add sync pool for gzip 1-9
  • #1605 - @dnwe - feat: protocol support for V11 fetch w/ rackID
  • #1617 - @sladkoff / @dwi-di / @random-dwi - Add support for alter/list partition reassignements APIs
  • #1632 - @bai - Add support for Go 1.14
  • #1640 - @random-dwi - Feature/fix list partition reassignments
  • #1646 - @mimaison - Add DescribeLogDirs to admin client
  • #1667 - @bai - Add support for kafka 2.5.0

Fixes

  • #1594 - @sladkoff - Sets ConfigEntry.Default flag in addition to the ConfigEntry.Source for Kafka versions > V1_1_0_0
  • #1601 - @alrs - fix: remove use of testing.T.FailNow() inside goroutine
  • #1602 - @d1egoaz - adds a note about consumer groups Consume method
  • #1607 - @darklore - Fix memory leak when Broker.Open and Broker.Close called repeatedly
  • #1613 - @wblakecaldwell - Updated "retrying" log message when BackoffFunc implemented
  • #1614 - @alrs - produce_response.go: Remove Unused Functions
  • #1619 - @alrs - tools/kafka-producer-performance: prune unused flag variables
  • #1639 - @agriffaut - Handle errors with no message but error code
  • #1643 - @kzinglzy - fix config.net.keepalive
  • #1644 - @KJTsanaktsidis - Fix brokers continually allocating new Session IDs
  • #1645 - @Stephan14 - Remove broker(s) which no longer exist in metadata
  • #1650 - @lavoiesl - Return the response error in heartbeatLoop
  • #1661 - @KJTsanaktsidis - Fix "broker received out of order sequence" when brokers die
  • #1666 - @KevinJCross - Bugfix: Allow TLS connections to work over socks proxy.
sarama - Version 1.26.1 (2020-02-04)

Published by bai over 4 years ago

⚠ī¸ This release has been superseded by v1.26.4 and should not be used.

Fetch requests will cause the Kafka broker to continously allocate new Fetch sessions in its cache on every request. Fixed in v1.26.2 via https://github.com/Shopify/sarama/pull/1644


Improvements

  • Add requests-in-flight metric (1539)
  • Fix misleading example for cluster admin (1595)
  • Replace Travis with GitHub Actions, linters housekeeping (1573)
  • Allow BalanceStrategy to provide custom assignment data (1592)

Bug Fixes

  • Adds back Consumer.Offsets.CommitInterval to fix API (1590)
  • Fix error message s/CommitInterval/AutoCommit.Interval (1589)
sarama - Version 1.26.0 (2020-01-24)

Published by d1egoaz over 4 years ago

⚠ī¸ Known Issues

This release has been superceded by v1.26.4 and should not be used.

Fetch requests will cause the Kafka broker to continously allocate new Fetch sessions in its cache on every request. Fixed in v1.26.2 via https://github.com/Shopify/sarama/pull/1644


New Features:

  • Enable zstd compression (1574,1582)
  • Support headers in tools kafka-console-producer (1549)

Improvements:

  • Add SASL AuthIdentity to SASL frames (authzid) (1585).

Bug Fixes:

  • Sending messages with ZStd compression enabled fails in multiple ways (1252).
  • Use the broker for any admin on BrokerConfig (1571).
  • Set DescribeConfigRequest Version field (1576).
  • ConsumerGroup flooding logs with client/metadata update req (1578).
  • MetadataRequest version in DescribeCluster (1580).
  • Fix deadlock in consumer group handleError (1581)
  • Fill in the Fetch{Request,Response} protocol (1582).
  • Retry topic request on ControllerNotAvailable (1586).
sarama - Version 1.25.0 (2020-01-13)

Published by bai almost 5 years ago

⚠ī¸ This release still contained known issues introduced in v1.24.1 and should not be used

Recommended to upgrade to v1.26.4 or rollback to v1.24.0

Known Issues

  • ConsumerGroup flooding logs with client/metadata update req (1544) introduced in v1.24.1
  • Unexpected user-specified time limit error (1562) introduced in v1.24.1

New Features:

  • Support TLS protocol in kafka-producer-performance (1538).
  • Add support for kafka 2.4.0 (1552).

Improvements:

  • Allow the Consumer to disable auto-commit offsets (1164).
  • Produce records with consistent timestamps (1455).

Bug Fixes:

  • Fix incorrect SetTopicMetadata name mentions (1534).
  • Fix client.tryRefreshMetadata Println (1535).
  • Fix panic on calling updateMetadata on closed client (1531).
  • Fix possible faulty metrics in TestFuncProducing (1545).
sarama - Version 1.24.1 (2019-10-31)

Published by bai almost 5 years ago

⚠ī¸ This release introduced two new major regressions over v1.24.0 and should not be used

Known Issues

  • ConsumerGroup flooding logs with client/metadata update req (1544)
  • Unexpected user-specified time limit error (1562)

New Features:

  • Add DescribeLogDirs Request/Response pair (1520).

Bug Fixes:

  • Fix ClusterAdmin returning invalid controller ID on DescribeCluster (1518).
  • Fix issue with consumergroup not rebalancing when new partition is added (1525).
  • Ensure consistent use of read/write deadlines (1529).