OpenMetadata

mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-09-25 08:50:18 +00:00

History

Abdallah Serghine 05c57857aa

Fixes ISSUE-19095: auto refresh boto credentials (#19098 )

When using using the assumeRole connection option with jobs involving
AWS services, the default 1 hour of boto might not cut it and the job
fails, one way of solving this is to refresh the credentials when they
expire, this ensures there is always valid credentials for the job
regardless for how long it runs.

Co-authored-by: Abdallah Serghine <abdallah.serghine@olx.pl>
Co-authored-by: IceS2 <pjt1991@gmail.com>

2025-01-03 10:51:15 +01:00

examples

fix: modify fqn to allow quotes with dots (#18719 )

2024-11-22 09:33:50 +05:30

operators

fix: PostgreSQL installation in Ingestion Docker (#18114 )

2024-10-04 11:31:01 +05:30

pipelines

…

plugins

…

src

Fixes ISSUE-19095: auto refresh boto credentials (#19098 )

2025-01-03 10:51:15 +01:00

tests

TEST - Add bots search RBAC validation (#19159 )

2025-01-02 15:32:03 +01:00

__init__.py

…

Dockerfile

MINOR: Fix Ingestion Dockerfile Compatibility by changing IF syntax (#18098 )

2024-10-04 02:52:48 +05:30

Dockerfile.ci

MINOR: Fix Ingestion Dockerfile Compatibility by changing IF syntax (#18098 )

2024-10-04 02:52:48 +05:30

ingestion_dependency.sh

#15243 - Pydantic V2 & Airflow 2.9 (#16480 )

2024-06-05 21:18:37 +02:00

LICENSE

Docs - Ingestion License (#17893 )

2024-09-17 08:58:53 -07:00

Makefile

FIX - Ingestion Airflow Image constraints (#17296 )

2024-08-06 06:44:27 +02:00

pyproject.toml

MINOR: add reportExplicitAny = false for basedpyright (#18777 )

2024-11-25 14:38:04 +00:00

README.md

MINOR: Update README.md python version (#15893 )

2024-04-18 21:33:16 +05:30

setup.py

Feature : Cockroach db connector (#18961 )

2025-01-02 13:07:55 +05:30

sonar-project.properties

…

README.md

This guide will help you setup the Ingestion framework and connectors

OpenMetadata Ingestion is a simple framework to build connectors and ingest metadata of various systems through OpenMetadata APIs. It could be used in an orchestration framework(e.g. Apache Airflow) to ingest metadata. Prerequisites

Python >= 3.8.x

Docs

Please refer to the documentation here https://docs.open-metadata.org/connectors

TopologyRunner

All the Ingestion Workflows run through the TopologyRunner.

The flow is depicted in the images below.

TopologyRunner Standard Flow

TopologyRunner Multithread Flow