Skip to content
This repository has been archived by the owner on Jun 16, 2023. It is now read-only.

Release 2.4.0

Latest
Compare
Choose a tag to compare
@unsleepy22 unsleepy22 released this 15 May 08:54
· 6 commits to master since this release

New features

  • Support exactly-once with async checkpoint via rocksdb and HDFS.
  • Introduce new window mechanism
    1. supports tumbling window and sliding window.
    2. supports count window, processing time window, event time window, session window.
    3. doesn't hold all data before a window is triggered, computes on data arrival.
  • Support gray upgrade
    1. supports per worker/component gray upgrade
    2. supports upgrade rollback
  • Add memory/rocksdb-based KV store.
  • HBase metrics plugin is open source
  • Support multiple metrics uploaders.
  • Add api in MetricClient to register topology-level metrics
  • Support component stream metrics, i.e., stream metrics aggregated in components

Improvements

  • Support deserialize for no-arg class in kryo
  • add getValue method in AsmMetric for quick assert so that unit tests/integration tests don't have to get metrics from
    nimbus

Bug Fix