yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-12-05 12:07:16 +00:00
Code Issues Packages Projects Releases Wiki Activity
OpenMetadata/ingestion
History
Pere Miquel Brull a9135e8db5
Mask queries, Table sample data and Topic sample data (#12139) 
* Filter out PII queries

* Mask topic PII

* Mask topic PII

* Update sample data test

* Format

* Moved logic to repository or PIIMasker

* Fix test

* chore(ui): update sample data api endpoint for topic

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2023-06-26 11:47:39 +02:00
..
examples
Mask queries, Table sample data and Topic sample data (#12139)
2023-06-26 11:47:39 +02:00
operators
Set logger level for ingestion-base (#12137)
2023-06-25 08:20:46 -07:00
pipelines
Adding MD5 hash to fullyQualifiedName and names to simplify DB indexes for lookups and increasing the size of FQN (#11960)
2023-06-19 15:43:05 +05:30
plugins
Add Pylint print checker and py-checkstyle as required (#8849)
2022-11-17 16:44:26 +00:00
src
Mask queries, Table sample data and Topic sample data (#12139)
2023-06-26 11:47:39 +02:00
tests
Fix #11659: Add support for filter patterns in dbt workflow (#12063)
2023-06-26 11:30:35 +05:30
__init__.py
[issue-1079] - MlFlow Connector (#1677)
2021-12-11 18:40:19 -08:00
.coveragerc
Add E2E CLI tests coverage to Sonar (#9908)
2023-01-25 11:51:25 +01:00
Dockerfile
fixed mysqlclient dep (#12087)
2023-06-22 15:18:39 +05:30
Dockerfile.ci
fixed mysqlclient dep (#12087)
2023-06-22 15:18:39 +05:30
ingestion_dependency.sh
Prepare Ingestion Base Docker image (#8065)
2022-10-11 07:50:49 +02:00
LICENSE
Ingestion Setup.py modification
2021-08-13 01:40:56 +05:30
README.md
[WIP] - Add Scarf gateway (#9652)
2023-01-11 09:33:09 +01:00
setup.cfg
Fix#7272: Improve logging when initializing workflow from CLI (#7522)
2022-09-19 08:00:00 -07:00
setup.py
Added Azure Blob Storage to dbt config (#11839)
2023-06-22 10:58:38 +05:30
sonar-project.properties
Add E2E CLI tests coverage to Sonar (#9908)
2023-01-25 11:51:25 +01:00

README.md

This guide will help you setup the Ingestion framework and connectors
This guide will help you setup the Ingestion framework and connectors

Python version 3.7+

OpenMetadata Ingestion is a simple framework to build connectors and ingest metadata of various systems through OpenMetadata APIs. It could be used in an orchestration framework(e.g. Apache Airflow) to ingest metadata. Prerequisites

  • Python >= 3.7.x

Docs

Please refer to the documentation here https://docs.open-metadata.org/connectors