yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-12-04 19:44:58 +00:00
Code Issues Packages Projects Releases Wiki Activity
OpenMetadata/ingestion
History
Pere Miquel Brull 1b2ea54d4f
Fix #2316 - Append Tasks & Add Status in Airflow (#2738) 
* Add license

* Add date to timestamp helper

* Prepare pipeline status operation

* Update and clean tasks from client

* Update tasks from client

* Check if pipeline is empty

* Keep all current pipeline info

* Append and clean tasks

* format

* Add status information

* Test pipelineStatus update

* Update task on clear

* Log status on callback

* Update lineage and status docs

* Update lineage docs

* Format

* Logic to handle DAG status

* Lint and format

* Update lineage tests
2022-02-13 17:51:25 +01:00
..
.idea
Fix #1471: Add Intellij idea settings to repo (#1472)
2021-11-30 12:14:54 -08:00
connectors
[issue-1698] - Airflow DockerOperator setup (#1730)
2021-12-18 16:41:38 +01:00
examples
issue #2611: added clickhouse connector (#2679)
2022-02-10 08:32:01 -08:00
pipelines
Usage fix - removed service_name from bulk_sink (#1956)
2022-01-04 17:12:10 +05:30
src
Fix #2316 - Append Tasks & Add Status in Airflow (#2738)
2022-02-13 17:51:25 +01:00
tests
Fix #2316 - Append Tasks & Add Status in Airflow (#2738)
2022-02-13 17:51:25 +01:00
__init__.py
[issue-1079] - MlFlow Connector (#1677)
2021-12-11 18:40:19 -08:00
Dockerfile
[issue-1698] - Airflow DockerOperator setup (#1730)
2021-12-18 16:41:38 +01:00
ingestion_dependency.sh
Added DBT to airflow, modified tables.json - added profile data, fixed user's displayName (#1501)
2021-12-01 08:32:29 -08:00
LICENSE
Ingestion Setup.py modification
2021-08-13 01:40:56 +05:30
README.md
[issue-1698] - Airflow DockerOperator setup (#1730)
2021-12-18 16:41:38 +01:00
setup.cfg
[issue-1976] - Ingestion SonarCloud (#2085)
2022-01-07 10:28:38 +01:00
setup.py
issue #2611: added clickhouse connector (#2679)
2022-02-10 08:32:01 -08:00
sonar-project.properties
update name (#2138)
2022-01-10 08:56:12 -08:00

README.md

This guide will help you setup the Ingestion framework and connectors
This guide will help you setup the Ingestion framework and connectors

Python version 3.8+

OpenMetadata Ingestion is a simple framework to build connectors and ingest metadata of various systems through OpenMetadata APIs. It could be used in an orchestration framework(e.g. Apache Airflow) to ingest metadata. Prerequisites

  • Python >= 3.8.x

Docs

Please refer to the documentation here https://docs.open-metadata.org/connectors