yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-11-02 19:48:17 +00:00
Code Issues Packages Projects Releases Wiki Activity
OpenMetadata/ingestion
History
Teddy 60de33d7cf
Fixes #11384 - Implement mem. optimization for sys. metrics (#11460) 
* fix: optimize system metrics retrieval for memory

* fix: ran python linting

* fix: logic to retrieve unique system metrics operations

* fix: added logic to clean up query before parsing it

* fix: added E2E tests for rds, bq, snflk system metrics

* fix: ran python linting

* fix: fix postgres query + add default byte size to env var

* fix: ran python linting
2023-05-09 12:05:35 +02:00
..
examples
Fix sample usage DAG directory (#11276)
2023-04-26 06:53:10 +02:00
operators
Rel to #10805 - Ingestion docs glue & Kerberos Dep (#11157)
2023-04-20 10:56:46 +02:00
pipelines
Revert Change (#9534)
2022-12-28 14:05:18 +01:00
plugins
Add Pylint print checker and py-checkstyle as required (#8849)
2022-11-17 16:44:26 +00:00
src
Fixes #11384 - Implement mem. optimization for sys. metrics (#11460)
2023-05-09 12:05:35 +02:00
tests
Fixes #11384 - Implement mem. optimization for sys. metrics (#11460)
2023-05-09 12:05:35 +02:00
__init__.py
…
.coveragerc
Add E2E CLI tests coverage to Sonar (#9908)
2023-01-25 11:51:25 +01:00
Dockerfile
Bump python-daemon (#11477)
2023-05-08 09:59:57 +02:00
Dockerfile.ci
Bump python-daemon (#11477)
2023-05-08 09:59:57 +02:00
ingestion_dependency.sh
Prepare Ingestion Base Docker image (#8065)
2022-10-11 07:50:49 +02:00
LICENSE
…
README.md
[WIP] - Add Scarf gateway (#9652)
2023-01-11 09:33:09 +01:00
setup.cfg
Fix#7272: Improve logging when initializing workflow from CLI (#7522)
2022-09-19 08:00:00 -07:00
setup.py
Fix#11311: Add IBM dependency for i Series in DB2 connector (#11381)
2023-05-02 15:50:39 +02:00
sonar-project.properties
Add E2E CLI tests coverage to Sonar (#9908)
2023-01-25 11:51:25 +01:00

README.md

This guide will help you setup the Ingestion framework and connectors
This guide will help you setup the Ingestion framework and connectors

Python version 3.7+

OpenMetadata Ingestion is a simple framework to build connectors and ingest metadata of various systems through OpenMetadata APIs. It could be used in an orchestration framework(e.g. Apache Airflow) to ingest metadata. Prerequisites

  • Python >= 3.7.x

Docs

Please refer to the documentation here https://docs.open-metadata.org/connectors