mirror of
https://github.com/open-metadata/OpenMetadata.git
synced 2025-12-10 14:57:57 +00:00
07012db685
* feat: add owner assignment support at metadata ingestion level * docs: Translate comments to English in test_owner * refactor: move the test_owner-related files into correct positions * feat: Add support for more source types * Revert "feat: Add support for more source types" This reverts commit a7649dcb3204cf98b7f4f9be02fbb982d2532193. * feat: Add owner field support in sourceConfig for Database and Dashboard ingestion (fixes #22392) * refactor code with the required style * add owner field in related json file * feat: add topology-based owner config for database/schema/table * Format the code by the pre-commit tools * fix some errors * add a doc to explain this feature * translate all Chinese comments to English and consolidate documentation * remove redundant code * refactor code * refactor code * refactor code * refactor code * Add some tests for owner-config and enhance this feat * Add some tests for owner-config and enhance this feat * fix some error * fix some error * refactor code * Remove the yaml and bash test files and test owner config with pytest style * format the python code * refactor ingestion code * refactor code * fix some error in test_owner_utils --------- Co-authored-by: Ma,Yutao <yutao.ma@sap.com>
This guide will help you setup the Ingestion framework and connectors
OpenMetadata Ingestion is a simple framework to build connectors and ingest metadata of various systems through OpenMetadata APIs. It could be used in an orchestration framework(e.g. Apache Airflow) to ingest metadata. Prerequisites
- Python >= 3.9.x
Docs
Please refer to the documentation here https://docs.open-metadata.org/connectors
TopologyRunner
All the Ingestion Workflows run through the TopologyRunner.
The flow is depicted in the images below.
TopologyRunner Standard Flow
TopologyRunner Multithread Flow
