v3.4.0

Registry

• Adds TranslateOffsets RPC
• Adds ReassigningTopics RPC
• Updated deps, compiled protos

Topicmappr

• Adds --topics-exclude flag

v3.3.1

• Adds NextInt method to kafkazk.Handler interface
• Updated Docker build deps

v3.3.0

Topicmappr

• Phased reassignments (#281)
• all brokers alias for the --brokers flag
• Error on missing broker rack info (#285)
• Improved leadership optimizer (#298)
• Additional statistical output

Metricsfetcher

• Improved backend failure resiliency (#319)

Autothrottle

• Path-optimal throttle rates (#293)
• Broker-level throttle overrides (#309)
• Refactoring

Registry

• Topic config management (#290)
• SSL support (#301, #307)
• Bugfixes

Libraries

• Minor additions of methods, types
• Minor improvements/bugfixes

Etc.

• Go modules
• Docker, Docker Compose files
• CI

Contributors

(thanks!)

• @jamiealquiza
• @scanterog
• @lizthegrey

v3.2.0

topicmappr

• Adds --optimize-leadership feature
• Automatically ignores topics pending deletion

autothrottle

• Adds the ability for throttle rate overrides to automatically clear once the current rebalance completes
• Improves error handling when fetching/handling state for offline partitions

registry

• Adds the CreateTopic rpc command with targeted broker placement

libraries

• misc. fixes, improvements

v3.1.0

Changes

topicmappr

• Adds automatic tolerance selection in the rebalance sub-command. When --tolerance is set to 0 (default), every tolerance value between 1-100 is computed in parallel. The result that yields the lowest range spread and standard deviation is automatically selected.
• Adds support for gzip compressed metrics/metadata
• Misc. fixes, improvements

metricsfetcher

• Adds support for metrics/metadata gzip compression
• dry-mode
• --verbose flag

v3.0.0

• Introduces the new Registry service in beta. This is a gRPC/HTTP API that allows lookup of Kafka resources (topics, brokers) with search parameters on default attributes (such as a broker's rack ID or topic's replication factor) as well as user-specified custom tags.
• Many refinements and improvements to topicmappr. Some examples:
  • Allows usage of the broker ID 0, which was previously reserved for internal usage.
  • When provided in the --brokers flag, the value -1 automatically expands to all mapped brokers for the topics matched via the --topics flag.
  • The rebalance subcommand reports relocation quantities in GB.
  • Enforcement (with a configurable toleration) of metrics data age when running storage based operations.
  • Misc. edge-case / soft bugs.
• Many refinements to the kafkazk library. Some examples:
  • Rewritten constraints handler.
  • Adds new higher-order functions that replace several use-case specific methods. For example, the previous BrokerMap functions MappedBrokers and NonReplacedBrokers are now satisfied with the new Filter method and appropriate input functions.

v2.1.0

• Introduces the Rebalance command https://github.com/DataDog/kafka-kit/wiki/rebalance-command. This allows partial partition movement to bring a broker set into storage balance with minimum partition movement and optional rack.id scoped relocations. Additionally, it allows simplified in-place scaling.
• Various improvements to the kafkazk library and newly exposed types/methods in the API.

v2.0.0

• Rewrite of the topicmappr command with Cobra #189
• Improved ZooKeeper readiness check 7080283, 9614d93#diff-89b0c08cac51de8b918e081d725fb439R43
• Increased test coverage for the kafkazk library #185

v1.1.0

readme

v1.0.0

Merge pull request #51 from DataDog/jamie/refactor

refactor, tests