yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2026-01-05 20:17:07 +00:00
Code Issues Packages Projects Releases Wiki Activity
OpenMetadata/ingestion
History
Teddy ac77f33b08
Fixes #7447 -- Add freshness metrics to profiler (#9159) 
* refactor(profiler): integrated getter func.

Removed metric getter function from their own file.
Added metric getter to their own interface classs.
created dispatch by value methdo to dispatch metric getter func.

* feature(profiler): added systemProfiler schema

* feat(profiler): workflow fresh. & snflk impl.

* feat(profiler): freshness endpoint for put and get

* feat(profiler): added system met. for redshift

* feat(profiler): freshness met. for bigquery

* fix(profiler): keyword not found in func

* feat(profiler): Added sample data for freshness

* fix(profiler): fetch previous day for BQ

* fix(profiler): sonar + data fetching logic

* fix: typo in SystemMetric Class

* fix: linting

* fix: extracted out EntityList class into models.py
2022-12-07 14:33:30 +01:00
..
connectors
Remove Click and Add ArgParse (#8182)
2022-10-31 18:12:26 +05:30
examples
Fixes #7447 -- Add freshness metrics to profiler (#9159)
2022-12-07 14:33:30 +01:00
operators
Add Airflow deps installation (#8131)
2022-10-13 11:06:27 +02:00
pipelines
Fix #8738: Improve Search Relevancy (#8739)
2022-11-16 15:43:41 -08:00
plugins
Add Pylint print checker and py-checkstyle as required (#8849)
2022-11-17 16:44:26 +00:00
src
Fixes #7447 -- Add freshness metrics to profiler (#9159)
2022-12-07 14:33:30 +01:00
tests
Fixes #7447 -- Add freshness metrics to profiler (#9159)
2022-12-07 14:33:30 +01:00
__init__.py
…
.coveragerc
Prepare CI for Airflow APIs (#6240)
2022-07-21 12:29:57 +02:00
Dockerfile
Add table query test (#9000)
2022-11-25 06:56:12 +01:00
Dockerfile.ci
Fix Mysql bigint (#8665)
2022-11-11 10:12:23 +01:00
ingestion_dependency.sh
Prepare Ingestion Base Docker image (#8065)
2022-10-11 07:50:49 +02:00
LICENSE
…
README.md
Fixed Broken docs links (#9125)
2022-12-02 15:42:06 +01:00
setup.cfg
Fix#7272: Improve logging when initializing workflow from CLI (#7522)
2022-09-19 08:00:00 -07:00
setup.py
Fix #8858 - Add chart description and add lineage flexibility (#9124)
2022-12-02 16:22:09 +01:00
sonar-project.properties
Fix SonarCloud coverage for Python code (#8144)
2022-10-14 15:17:40 +02:00

README.md

This guide will help you setup the Ingestion framework and connectors
This guide will help you setup the Ingestion framework and connectors

Python version 3.8+

OpenMetadata Ingestion is a simple framework to build connectors and ingest metadata of various systems through OpenMetadata APIs. It could be used in an orchestration framework(e.g. Apache Airflow) to ingest metadata. Prerequisites

  • Python >= 3.8.x

Docs

Please refer to the documentation here https://docs.open-metadata.org/connectors