This repository has been archived by the owner on Jun 10, 2024. It is now read-only.
Releases: odpi/egeria-connector-hadoop-ecosystem
Releases · odpi/egeria-connector-hadoop-ecosystem
Mapping updates
🎉 New features
- Now maps both HBase and Hive metadata as relational objects to Egeria
- Adds a "Getting Started" guide and explanation for how the connector works
- Implements entity and relationship delete events
- Adds a configurable option for how delete events in Atlas should propagate to Egeria (as deletes or purges)
🐞Bug fixes
- Fixes various NPEs and other mapping-related exceptions that were occurring during event processing (#288, #289)
🔒 Security fixes
- Updates versions of dependent libraries
🔨 Dependencies
v2.5 - Dependency updates
v2.2 - Dependency updates
v2.1 - repository rename
🎉 New features
- Renames the repository in anticipation of the eventual inclusion of other Hadoop-related connectors (eg. Apache Ranger)
- Updates default ports and protocol (https on 9443 rather than http on 8080) for Egeria v2.0
- Adds default handling of Apache Atlas types that are not directly mapped by traversing the inheritance hierarchy until a mapping is found
🔒 Security fixes
- Updates versions of dependent libraries
- Narrows scope of included dependencies to reduce potential vulnerability exposure
🔨 Dependencies
Library updates
🎉 New features
- Uses new error logging framework from Egeria core
🔒 Security fixes
- Updates versions of dependent libraries
🔨 Dependencies
Bug and security fixes
🐞 Bug fixes
- Fixes supertype / subtype searching
🔒 Security fixes
- Restricts included libraries and jars to limit potential CVE exposure
🔨 Dependencies
Initial release
🎉 New features
- Open Metadata Repository Proxy Connector for Apache Atlas, only partially conformant to mandatory metadata sharing profile of CTS from v2.0.0 of Apache Atlas onwards (currently blocked from full conformance due to limitations within Apache Atlas itself: https://github.com/odpi/egeria-connector-apache-atlas/issues?q=is%3Aissue+is%3Aopen+label%3Awontfix)
- Only implements read (and search) operations, no write, update, delete or purge
- Includes refresh request handling
🔨 Dependencies
🧩 Open metadata type mappings added / changed in this release
(🔖 Attributes, 📦 Entities, 🔗 Relationships, 🏷 Classifications)
| 🧩 | OMRS type | Atlas type(s) | Notes |
|---|---|---|---|
| 📦 | Asset | Asset | |
| 🔖 | AssetOwnerType | hive_principal_type | |
| 🔗 | AssetSchemaType | hbase_table_column_families | |
| 🔗 | AssetSchemaType | hive_table_db | |
| 🔗 | AttributeForSchema | hbase_column_family_columns | |
| 🔗 | AttributeForSchema | hive_table_columns | |
| 🔗 | AttributeForSchema | hive_table_storagedesc | |
| 📦 | Connection | hbase_namespace | generated entity (properties from a single entity instance in Atlas) |
| 📦 | Connection | hive_db | generated entity (properties from a single entity instance in Atlas) |
| 📦 | Connection | sqoop_dbdatastore | generated entity (properties from a single entity instance in Atlas) |
| 🔗 | ConnectionEndpoint | hbase_namespace | generated relationship (all properties for both endpoints are on a single entity instance in Atlas) |
| 🔗 | ConnectionEndpoint | hive_db | generated relationship (all properties for both endpoints are on a single entity instance in Atlas) |
| 🔗 | ConnectionToAsset | hbase_namespace | generated relationship (all properties for both endpoints are on a single entity instance in Atlas) |
| 🔗 | ConnectionToAsset | hive_db | generated relationship (all properties for both endpoints are on a single entity instance in Atlas) |
| 🔗 | ConnectionToAsset | sqoop_dbdatastore | generated relationship (all properties for both endpoints are on a single entity instance in Atlas) |
| 📦 | Database | hive_db | |
| 🔗 | DataContentForDataSet | hbase_table_namespace | |
| 📦 | DataSet | DataSet | |
| 📦 | DataSet | hbase_table | |
| 📦 | DataStore | hbase_namespace | |
| 📦 | DataStore | sqoop_dbdatastore | |
| 📦 | Endpoint | hbase_namespace | generated entity (properties from a single entity instance in Atlas) |
| 📦 | Endpoint | hive_db | generated entity (properties from a single entity instance in Atlas) |
| 📦 | FileFolder | hdfs_path | |
| 📦 | Process | Process | |
| 📦 | Referenceable | Referenceable | |
| 📦 | RelationalColumn | hive_column | |
| 📦 | RelationalColumnType | hive_column | generated entity (properties from a single entity instance in Atlas) |
| 📦 | RelationalDBSchemaType | hive_storagedesc | |
| 📦 | RelationalTable | hive_table | |
| 📦 | RelationalTableType | hive_table | generated entity (properties from a single entity instance in Atlas) |
| 🔗 | SchemaAttributeType | hive_column | generated relationship (all properties for both endpoints are on a single entity instance in Atlas) |
| 🔗 | SchemaAttributeType | hive_table | generated relationship (all properties for both endpoints are on a single entity instance in Atlas) |
| 📦 | TabularColumn | hbase_column | |
| 📦 | TabularSchemaType | hbase_column_family | |
| 📦 | Topic | kafka_topic | |
| 🏷 | all classifications against types above | mapped one-to-one to open types |
Temporary initial release mechanism
This is an initial release mechanism to ensure that we have continuity for the Helm templates in the Egeria core project. We are investigating alternative long-term mechanisms to handle the binary content of releases.