yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-12-01 01:56:04 +00:00
Code Issues Packages Projects Releases Wiki Activity
OpenMetadata/ingestion
History
agriev cbbbca5472 Adds percona server for postgresql support (#19322) 
* percona server for postgresql support

The only meaningful difference is version string in percona server for postgresql. So commit propose universal and safe way to detect server version by integer string, not complicated parsing of unformatted string.

* updated tests with get_server_version_num

commented outdated tests

---------

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
(cherry picked from commit dcebc41e3f845933aaa9b9de8761eeb8fc52f9ee)
2025-01-14 01:52:45 +00:00
..
examples
fix: modify fqn to allow quotes with dots (#18719)
2024-11-22 09:33:50 +05:30
operators
chore(release): Prepare Branch for 1.6.3
2025-01-13 07:19:41 +00:00
pipelines
MINOR: Add failed rows sample to test case (#15682)
2024-04-10 17:00:00 +02:00
plugins
…
src
Adds percona server for postgresql support (#19322)
2025-01-14 01:52:45 +00:00
tests
Adds percona server for postgresql support (#19322)
2025-01-14 01:52:45 +00:00
__init__.py
…
Dockerfile
chore(release): Prepare Branch for 1.6.3
2025-01-13 07:19:41 +00:00
Dockerfile.ci
MINOR: Fix Ingestion Dockerfile Compatibility by changing IF syntax (#18098)
2024-10-04 02:52:48 +05:30
ingestion_dependency.sh
#15243 - Pydantic V2 & Airflow 2.9 (#16480)
2024-06-05 21:18:37 +02:00
LICENSE
Docs - Ingestion License (#17893)
2024-09-17 08:58:53 -07:00
Makefile
FIX - Ingestion Airflow Image constraints (#17296)
2024-08-06 06:44:27 +02:00
pyproject.toml
chore(release): Prepare Branch for 1.6.3
2025-01-13 07:19:41 +00:00
README.md
MINOR: Update README.md python version (#15893)
2024-04-18 21:33:16 +05:30
setup.py
MINOR: Kafka dependency conflict resolution (#19278)
2025-01-08 09:13:32 +00:00
sonar-project.properties
Add Sample data, modify regex pattern (#14467)
2024-01-11 14:23:33 +05:30

README.md

This guide will help you setup the Ingestion framework and connectors
This guide will help you setup the Ingestion framework and connectors

Python version 3.8+

OpenMetadata Ingestion is a simple framework to build connectors and ingest metadata of various systems through OpenMetadata APIs. It could be used in an orchestration framework(e.g. Apache Airflow) to ingest metadata. Prerequisites

  • Python >= 3.8.x

Docs

Please refer to the documentation here https://docs.open-metadata.org/connectors

TopologyRunner

All the Ingestion Workflows run through the TopologyRunner.

The flow is depicted in the images below.

TopologyRunner Standard Flow

image

TopologyRunner Multithread Flow

image