yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-12-02 02:26:00 +00:00
Code Issues Packages Projects Releases Wiki Activity
OpenMetadata/ingestion
History
Milan Bariya 3d1bbb1037
Add a configurationto skip Snowflake transient and tmp tables (#10665) 
* Add a configurationto skip  Snowflake transient and tmp tables

* Fix Python checkstyle

* add separate query for transient tables

* Move skipTempTables into SnowflakeConnection

* Fix merge conflict

* change skip word to include

* Add title in json file

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2023-03-28 06:29:59 +02:00
..
connectors
Remove Click and Add ArgParse (#8182)
2022-10-31 18:12:26 +05:30
examples
Fix #10454: Improve Search Relevancy, by adding functional scoring an… (#10455)
2023-03-09 21:37:08 +05:30
operators
[WIP] - Test Connection - Prepare the new test connection ingestion+UI logic (#10660)
2023-03-28 06:29:13 +02:00
pipelines
Revert Change (#9534)
2022-12-28 14:05:18 +01:00
plugins
Add Pylint print checker and py-checkstyle as required (#8849)
2022-11-17 16:44:26 +00:00
src
Add a configurationto skip Snowflake transient and tmp tables (#10665)
2023-03-28 06:29:59 +02:00
tests
[WIP] - Test Connection - Prepare the new test connection ingestion+UI logic (#10660)
2023-03-28 06:29:13 +02:00
__init__.py
…
.coveragerc
Add E2E CLI tests coverage to Sonar (#9908)
2023-01-25 11:51:25 +01:00
Dockerfile
Bump main branch to version 1.0.0 (#10040)
2023-02-02 12:56:14 +01:00
Dockerfile.ci
Fix #9707 - Install instantclient and enable thick mode (#9761)
2023-01-19 08:08:56 +01:00
ingestion_dependency.sh
Prepare Ingestion Base Docker image (#8065)
2022-10-11 07:50:49 +02:00
LICENSE
…
README.md
[WIP] - Add Scarf gateway (#9652)
2023-01-11 09:33:09 +01:00
setup.cfg
Fix#7272: Improve logging when initializing workflow from CLI (#7522)
2022-09-19 08:00:00 -07:00
setup.py
Fixes#8038: Change how status is handled after running workflow (#10710)
2023-03-24 17:59:06 +01:00
sonar-project.properties
Add E2E CLI tests coverage to Sonar (#9908)
2023-01-25 11:51:25 +01:00

README.md

This guide will help you setup the Ingestion framework and connectors
This guide will help you setup the Ingestion framework and connectors

Python version 3.7+

OpenMetadata Ingestion is a simple framework to build connectors and ingest metadata of various systems through OpenMetadata APIs. It could be used in an orchestration framework(e.g. Apache Airflow) to ingest metadata. Prerequisites

  • Python >= 3.7.x

Docs

Please refer to the documentation here https://docs.open-metadata.org/connectors