yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-10-13 09:48:19 +00:00
Code Issues Packages Projects Releases Wiki Activity
OpenMetadata/ingestion
History
Pere Miquel Brull a3bfd4e696
Part of #11968 - Restructure Profiler Workflow and PII Processor (#13059) 
* Structure PII

* Restructure Profiler Workflow

* Update signature for abc

* remove profiler sink

* Fix tests

* Fix lint

* Fix test

* Fix test
2023-09-04 11:02:57 +02:00
..
examples
draft: implementation of lightdash connector. (#12957)
2023-08-31 17:28:07 +02:00
operators
Part of #11968 - Restructure Profiler Workflow and PII Processor (#13059)
2023-09-04 11:02:57 +02:00
pipelines
Automated Lineage by Query for Python SDK & CLI (#12672)
2023-07-31 19:25:41 +05:30
plugins
Add Pylint print checker and py-checkstyle as required (#8849)
2022-11-17 16:44:26 +00:00
src
Part of #11968 - Restructure Profiler Workflow and PII Processor (#13059)
2023-09-04 11:02:57 +02:00
tests
Part of #11968 - Restructure Profiler Workflow and PII Processor (#13059)
2023-09-04 11:02:57 +02:00
__init__.py
…
.coveragerc
Add E2E CLI tests coverage to Sonar (#9908)
2023-01-25 11:51:25 +01:00
Dockerfile
fix: Align Docker Base Image to use airflow 2.5.3 (#12737)
2023-08-04 12:08:58 +05:30
Dockerfile.ci
fix: Align Docker Base Image to use airflow 2.5.3 (#12737)
2023-08-04 12:08:58 +05:30
ingestion_dependency.sh
…
LICENSE
…
README.md
[WIP] - Add Scarf gateway (#9652)
2023-01-11 09:33:09 +01:00
setup.cfg
Part of #7272 - Centralize Workflows, Status, and Exception Management (#13029)
2023-08-30 15:49:42 +02:00
setup.py
Fixed #8418 added new connector couchbase (#12836)
2023-08-29 11:16:32 +05:30
sonar-project.properties
Add E2E CLI tests coverage to Sonar (#9908)
2023-01-25 11:51:25 +01:00

README.md

This guide will help you setup the Ingestion framework and connectors
This guide will help you setup the Ingestion framework and connectors

Python version 3.7+

OpenMetadata Ingestion is a simple framework to build connectors and ingest metadata of various systems through OpenMetadata APIs. It could be used in an orchestration framework(e.g. Apache Airflow) to ingest metadata. Prerequisites

  • Python >= 3.7.x

Docs

Please refer to the documentation here https://docs.open-metadata.org/connectors