mirror of
https://github.com/open-metadata/OpenMetadata.git
synced 2025-12-13 08:37:03 +00:00
9b2a244c96
* Add `xx_ent_wiki_sm` multilanguage model constant * Improve `split_column_name` to separate values e.g: `transactionDateUtc` into `["transaction", "date", "utc"]` * Test cases for timestamps and NHS number * E2E broken test with Indian names * Implement subclasses for `NhsRecognizer` and `DateRecognizer` This is to improve accuracy of recognizers after changing the model
This guide will help you setup the Ingestion framework and connectors
OpenMetadata Ingestion is a simple framework to build connectors and ingest metadata of various systems through OpenMetadata APIs. It could be used in an orchestration framework(e.g. Apache Airflow) to ingest metadata. Prerequisites
- Python >= 3.9.x
Docs
Please refer to the documentation here https://docs.open-metadata.org/connectors
TopologyRunner
All the Ingestion Workflows run through the TopologyRunner.
The flow is depicted in the images below.
TopologyRunner Standard Flow
TopologyRunner Multithread Flow
