yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-08-21 15:38:11 +00:00
Code Issues Packages Projects Releases Wiki Activity

Added dbt field in upgrade docs (#7328)

Browse Source 
* Added dbt fields in upgrade docs

* Updates added

* Fixed typos

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
This commit is contained in:
Onkar Ravgan 2022-09-13 18:28:07 +05:30 committed by GitHub
parent 84c36dc57d
commit b217ed5397
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 10 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

10
openmetadata-docs/content/deployment/upgrade/versions/011-to-012.md
View File

@ -43,6 +43,14 @@ internals as well. Main topics to consider:
2. Any past test data will be cleaned up during the upgrade to 0.12.0, as the internal data storage has been improved
3. The Profiler Ingestion Pipelines will be cleaned up during the upgrade to 0.12.0 as well.
### DBT Tests Integration
From 0.12, OpenMetadata supports ingesting the tests and the test results from your DBT project.
- Along with `manifest.json` and `catalog.json` files, We now provide an option to ingest the `run_results.json` file generated from the DBT run and ingest the test results from it.
- The field to enter the `run_results.json` file path is an optional field in the case of local and http DBT configs. The test results will be ingested from this file if it is provided.
- For others the file will be picked from their respective sources if it is available.
### Profiler Workflow Updates
On top of the information above, the `fqnFilterPattern` has been converted into the same patterns we use for ingestion,
@ -100,6 +108,8 @@ upgrade that, but you want to use OM 0.12, reach out to us.
- Removed: `hostPort`
- Databricks
- Removed: `username` and `password`
- DBT Config
- Added: `dbtRunResultsFilePath` and `dbtRunResultsHttpPath` where path of the `run_results.json` file can be passed to get the test results data from DBT.
### Ingestion from CLI