yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-07-19 07:17:38 +00:00
Code Issues Packages Projects Releases Wiki Activity
OpenMetadata/ingestion
History
Teddy 9ef3ff7a58
Cost analysis agg (#13408) 
* feat: updated DI workflow to inherit from BaseWorkflow + split processor and producer classes

* feat: __init__.py files creation

* feat: updated workflow import classes in code and doc

* feat: moved kpi runner from runner to processor folder

* fix: skip failure on list entities

* feat: deleted unused files

* feat: updated status reporter

* feat: ran linting

* feat: fix test error with typing and fqn

* feat: updated test dependencies

* feat: ran linting

* feat: move execution order up

* feat: updated cost analysis report to align with new workflow

* feat: fix entity already exists for pipeline entity status

* feat: ran python linting

* feat: move skip_on_failure to method

* feat: added unusedReport to DI

* feat: added aggregated unused report

* feat: ran linting

* feat: reverted compose file changes

---------

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2023-10-03 09:27:18 +02:00
..
examples
Cost analysis agg (#13408)
2023-10-03 09:27:18 +02:00
operators
Issue 12679 - Handle Entity Object Instantiation Error + Refactor Workflow (#13384)
2023-10-02 12:05:30 +02:00
pipelines
Automated Lineage by Query for Python SDK & CLI (#12672)
2023-07-31 19:25:41 +05:30
plugins
Fix Latest Pylint 3.0.0 issues (#13413)
2023-10-03 07:43:09 +02:00
src
Cost analysis agg (#13408)
2023-10-03 09:27:18 +02:00
tests
Batch PII tagging (#13385)
2023-10-02 14:44:41 +02:00
__init__.py
…
.coveragerc
Add E2E CLI tests coverage to Sonar (#9908)
2023-01-25 11:51:25 +01:00
Dockerfile
Creating make script for code freeze automation (#12976)
2023-09-13 15:10:28 +05:30
Dockerfile.ci
Upgrade: airflow base image from 2.5.3 to 2.6.3 (#13151)
2023-09-12 20:04:25 +05:30
ingestion_dependency.sh
…
LICENSE
…
README.md
…
setup.cfg
Part of #7272 - Centralize Workflows, Status, and Exception Management (#13029)
2023-08-30 15:49:42 +02:00
setup.py
Fix Latest Pylint 3.0.0 issues (#13413)
2023-10-03 07:43:09 +02:00
sonar-project.properties
Add E2E CLI tests coverage to Sonar (#9908)
2023-01-25 11:51:25 +01:00

README.md

This guide will help you setup the Ingestion framework and connectors
This guide will help you setup the Ingestion framework and connectors

Python version 3.7+

OpenMetadata Ingestion is a simple framework to build connectors and ingest metadata of various systems through OpenMetadata APIs. It could be used in an orchestration framework(e.g. Apache Airflow) to ingest metadata. Prerequisites

  • Python >= 3.7.x

Docs

Please refer to the documentation here https://docs.open-metadata.org/connectors