yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-07-16 21:50:27 +00:00
Code Issues Packages Projects Releases Wiki Activity
OpenMetadata/openmetadata-docs/content/deployment/upgrade/versions/012-to-013.md
Onkar Ravgan 14fa96958f
Added dbt workflow docs (#9493) 
* Added dbt workflow docs

* added dbt small case

* Fixed review comments
2022-12-22 13:11:18 +00:00

2.8 KiB
Raw Blame History

title slug
Upgrade 0.12 to 0.13 /deployment/upgrade/versions/012-to-013

Upgrade from 0.12 to 0.13

Upgrading from 0.12 to 0.13 can be done directly on your instances. This page will list few general details you should take into consideration when running the upgrade.

Highlights

Deprecating botPrincipals from OpenMetadata Configuration

Starting with 0.13.0, we have deprecated the initial configurations for Authorizer Bot Pincipals. This means that all the configs will be taken care from UI once it's up and running under settings >> bots section. The default once available and enabled will be ingestion-bot which will have JWT Token configured. You can edit the same for configuring service principals instead of using the default JWT Auth mechanism. For more information on configuring Bots, you can visit Enable Security.

Service Connection Updates

  • Databricks

    • Databricks connector now supports usage and lineage extraction.
      • Added: supportsUsageExtraction, supportsLineageExtraction

  • Dagster

    • Dagster connector now support fetching metadata from dagster cloud.
      • Added: configSource
      • Removed: hostPort, numberOfStatus

  • Airbyte

    • Airbyte connector now support Basic Authentication.
      • Added: username, password

Lineage Backend

In 0.13.1:

  • The import for the Airflow Lineage Backend has been updated from airflow_provider_openmetadata.lineage.openmetadata.OpenMetadataLineageBackend to airflow_provider_openmetadata.lineage.backend.OpenMetadataLineageBackend.
  • We removed support from Airflow v1.
  • The failure callback now only updates the pipeline status if the Pipeline already exists in OpenMetadata.

Webhooks

In 0.13.1 , OpenMetadata will be deprecating the existing webhooks for Slack, MSTeams.

Before upgrading to 0.13.1 it is recommended to save the existing Webhook configs(like webhook url) to use them later.

We have added Alerts/Notifications , which can be configured to receive customised alerts on updates in OM using Triggers, Filtering Information to different destinations like Slack, MsTeams or even Emails. Please use the same webhook config that you had saved from previous version to configure the Alerts Destination after upgrading.

dbt Workflow

  • Starting with 0.13.1 dbt ingestion has been separated from the metadata ingestion. It can now be configured as a separate workflow after completing the metadata ingestion workflow
  • We will remove the dbt configuration from your existing metadata ingestion pipelines and they will keep working as expected.
  • After upgrading you will have to create the dbt workflow for the dbt ingestion to start working again.
  • dbt workflow can be configured via going to services->selecting your service->ingestion tab->Add dbt Ingestion