OpenMetadata

mirror of https://github.com/open-metadata/OpenMetadata.git synced 2026-01-06 12:36:56 +00:00

History

Antoine Balliet 34dc79b5fe

feat: DBT - allow to use email to match users as fallback with ES search (#17349 )

* feat: allow to use email to match dbt model owner

* improve description

* revert add option to parse from email

* feat: implement email matching in case name was not found

* feat: use email to find user as fallback at connector level

2024-08-12 14:54:54 +02:00

examples

MINOR - LKML sample data (#17359 )

2024-08-10 18:01:00 +02:00

operators

Data Insights Refactor (#16532 )

2024-07-30 17:38:43 +05:30

pipelines

MINOR: Add failed rows sample to test case (#15682 )

2024-04-10 17:00:00 +02:00

plugins

…

src

feat: DBT - allow to use email to match users as fallback with ES search (#17349 )

2024-08-12 14:54:54 +02:00

tests

Fixes #17319 : ArrayDataType issue resolved, Fix Queries + Add DB Name to the queries (#17379 )

2024-08-12 09:59:03 +02:00

__init__.py

…

Dockerfile

FIX - Ingestion Airflow Image constraints (#17296 )

2024-08-06 06:44:27 +02:00

Dockerfile.ci

FIX - Ingestion Airflow Image constraints (#17296 )

2024-08-06 06:44:27 +02:00

ingestion_dependency.sh

#15243 - Pydantic V2 & Airflow 2.9 (#16480 )

2024-06-05 21:18:37 +02:00

LICENSE

…

Makefile

FIX - Ingestion Airflow Image constraints (#17296 )

2024-08-06 06:44:27 +02:00

pyproject.toml

Bump Setuptools version (#17225 )

2024-07-30 10:20:05 +05:30

README.md

MINOR: Update README.md python version (#15893 )

2024-04-18 21:33:16 +05:30

setup.py

MINOR: Fix postgres conftest import (#17210 )

2024-07-27 18:08:42 +05:30

sonar-project.properties

…

README.md

This guide will help you setup the Ingestion framework and connectors

OpenMetadata Ingestion is a simple framework to build connectors and ingest metadata of various systems through OpenMetadata APIs. It could be used in an orchestration framework(e.g. Apache Airflow) to ingest metadata. Prerequisites

Python >= 3.8.x

Docs

Please refer to the documentation here https://docs.open-metadata.org/connectors

TopologyRunner

All the Ingestion Workflows run through the TopologyRunner.

The flow is depicted in the images below.

TopologyRunner Standard Flow

TopologyRunner Multithread Flow