Skip to content

Version 0.15.0

Compare
Choose a tag to compare
@spenes spenes released this 06 Dec 00:41
· 40 commits to master since this release

Replacing Elasticsearch with Opensearch

Until this version, Snowplow data was loaded to Elasticsearch 6.x in the Mini. However, a licensing change in Elasticsearch prevented us from upgrading it to more recent versions. To make sure we stay up to date with important security fixes, we've decided to replace Elasticsearch with Opensearch. Also, Kibana is replaced with Opensearch Dashboards.

Opensearch is a fork of open source Elasticsearch 7.10. Therefore this change shouldn't affect Mini users much. To minimize the impact further, we've tried to make as minimal a change as possible. In Mini, you can still access Opensearch with the /elasticsearch endpoint and Opensearch Dashboards with the /kibana endpoint.

The only breaking change this migration would bring is the removal of mapping types. Since this change was made in Elasticsearch 7.x, it is part of Opensearch too. For Mini users, it means that you don't have to provide a mapping type in your search queries anymore when accessing your data in good or bad indices. For example, good events count can be found using the following endpoint in previous versions: /elasticsearch/good/good/_count. Starting with 0.15.0, it can be found using this endpoint: /elasticsearch/good/_count.

Changelog

  • Replace Elasticsearch with Opensearch (#367)
  • Bump postgres to 15.1 (#369)
  • Bump collector to 2.8.2 (#369)
  • Bump enrich to 3.6.0 (#369)
  • Bump Iglu Server to 0.8.7 (#369)
  • Change versions in the Packerfile according to the Git tag (#370)