3.8 KiB
title | slug |
---|---|
Upgrade 0.12 to 0.13 | /deployment/upgrade/versions/012-to-013 |
Upgrade from 0.12 to 0.13
Upgrading from 0.12 to 0.13 can be done directly on your instances. This page will list few general details you should take into consideration when running the upgrade.
0.13.3 Highlights
Optimize Memory for Usage Workflow
Implemented better memory management when processing usage data for database connectors
Bug Fixes
- Fix partition logic when profiling BigQuery table with
_PARTITIONTIME
- Handle Snowflake overflow error
- Set catalog for Databrick profiler connector
0.13.2 Highlights
Service Connection Updates
-
Oracle:
- Oracle connector now supports thick mode enabled by default.
- Added:
instantClientDirectory
with the path to the Oracle libraries. They are provided by default for release 19 in the ingestion container.
- Added:
- Oracle connector now supports thick mode enabled by default.
-
Superset:
- The Superset connector now supports the ability to extract metadata directly from the database underlying Superset, making it useful for users who have SSO enabled.
- Added:
connection
field the connection can be of typeApiConnection
,postgresConnection
ormysqlConnection
- Removed:
username
,password
&provider
fields as now these fields will be part ofApiConnection
- Added:
- The Superset connector now supports the ability to extract metadata directly from the database underlying Superset, making it useful for users who have SSO enabled.
0.13.1 Highlights
Deprecating botPrincipals from OpenMetadata Configuration
Starting with 0.13.0
, we have deprecated the initial configurations for Authorizer Bot Principals. This means that all
the configs will be taken care from UI once it's up and running under settings >> bots section. The default once available
and enabled will be ingestion-bot
which will have JWT Token configured. You can edit the same for configuring service
principals instead of using the default JWT Auth mechanism. For more information on configuring Bots, you can
visit Enable Security.
Service Connection Updates
-
Databricks
- Databricks connector now supports usage and lineage extraction.
- Added:
supportsUsageExtraction
,supportsLineageExtraction
- Added:
- Databricks connector now supports usage and lineage extraction.
-
Dagster
- Dagster connector now support fetching metadata from dagster cloud.
- Added:
configSource
- Removed:
hostPort
,numberOfStatus
- Added:
- Dagster connector now support fetching metadata from dagster cloud.
-
Airbyte
- Airbyte connector now support Basic Authentication.
- Added:
username
,password
- Added:
- Airbyte connector now support Basic Authentication.
Lineage Backend
- The import for the Airflow Lineage Backend has been updated from
airflow_provider_openmetadata.lineage.openmetadata.OpenMetadataLineageBackend
toairflow_provider_openmetadata.lineage.backend.OpenMetadataLineageBackend
. - We removed support from Airflow v1.
- The failure callback now only updates the pipeline status if the Pipeline already exists in OpenMetadata.
Webhooks
OpenMetadata will be deprecating the existing webhooks for Slack, MSTeams.
Before upgrading to 0.13.1 it is recommended to save the existing Webhook configs(like webhook url) to use them later.
We have added Alerts/Notifications , which can be configured to receive customised alerts on updates in OM using Triggers, Filtering Information to different destinations like Slack, MsTeams or even Emails. Please use the same webhook config that you had saved from previous version to configure the Alerts Destination after upgrading.
dbt Workflow
- Starting with
0.13.1
dbt ingestion has been separated from the metadata ingestion. It can now be configured as a separate workflow after completing the metadata ingestion workflow - We will remove the dbt configuration from your existing metadata ingestion pipelines and they will keep working as expected.
- After upgrading you will have to create the dbt workflow for the dbt ingestion to start working again.
- dbt workflow can be configured via going to
services->selecting your service->ingestion tab->Add dbt Ingestion