yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2026-01-08 21:48:22 +00:00
Code Issues Packages Projects Releases Wiki Activity
OpenMetadata/ingestion
History
Teddy 61ef55290e
MINOR - generic profiler optimization for sampling and BQ (#14507) 
* fix: limit sampling to specific column

* fix: handle bigquery struct columns

* fix: default partition to 1 DAY for BQ

* fix: default to __TABLES__ for BQ table metrics

* style: ran python linting

* style: fix linting

* fix: python style

* fix: set partition to DAY if not HOUR
2023-12-27 19:13:44 +01:00
..
examples
MINOR - Clean ingestion ES code and auth providers (#14358)
2023-12-19 12:08:48 +01:00
operators
#14425 - Create ingestion-base-slim image (#14426)
2023-12-19 11:09:38 +01:00
pipelines
MINOR - Clean ingestion ES code and auth providers (#14358)
2023-12-19 12:08:48 +01:00
plugins
Fix Latest Pylint 3.0.0 issues (#13413)
2023-10-03 07:43:09 +02:00
src
MINOR - generic profiler optimization for sampling and BQ (#14507)
2023-12-27 19:13:44 +01:00
tests
MINOR - generic profiler optimization for sampling and BQ (#14507)
2023-12-27 19:13:44 +01:00
__init__.py
…
Dockerfile
#14425 - Create ingestion-base-slim image (#14426)
2023-12-19 11:09:38 +01:00
Dockerfile.ci
#14425 - Create ingestion-base-slim image (#14426)
2023-12-19 11:09:38 +01:00
ingestion_dependency.sh
fix: AIRFLOW_DB_PROPERTIES default value in docker compose files (#14274)
2023-12-06 19:56:19 +05:30
LICENSE
…
Makefile
#11857 - Store workflow status in the Ingestion Pipeline Status (#14462)
2023-12-22 15:43:50 +01:00
pyproject.toml
Add Custom metrics sample data (#14069)
2023-11-22 11:57:19 +01:00
README.md
…
setup.py
#14425 - Create ingestion-base-slim image (#14426)
2023-12-19 11:09:38 +01:00
sonar-project.properties
…

README.md

This guide will help you setup the Ingestion framework and connectors
This guide will help you setup the Ingestion framework and connectors

Python version 3.7+

OpenMetadata Ingestion is a simple framework to build connectors and ingest metadata of various systems through OpenMetadata APIs. It could be used in an orchestration framework(e.g. Apache Airflow) to ingest metadata. Prerequisites

  • Python >= 3.7.x

Docs

Please refer to the documentation here https://docs.open-metadata.org/connectors