yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-07-30 20:59:57 +00:00
Code Issues Packages Projects Releases Wiki Activity
OpenMetadata/openmetadata-docs/content/openmetadata/connectors/pipeline/airflow/cli.md
Pere Miquel Brull 321cb4626c
Docs - Airflow and pipeline connectors (#6008) 
* Airflow and pipeline connectors

* Revert dockerfile
2022-07-11 16:54:40 +02:00

1.2 KiB
Raw Blame History

title slug
Run Airflow Connector using the CLI /openmetadata/connectors/pipeline/airflow/cli

Source Configuration - Service Connection

  • hostPort: URL to the Airflow instance.
  • numberOfStatus: Number of status we want to look back to in every ingestion (e.g., Past executions from a DAG).
  • connection: Airflow metadata database connection. See these docs for supported backends.

In terms of connection we support the following selections:

  • backend: Should not be used from the UI. This is only applicable when ingesting Airflow metadata locally by running the ingestion from a DAG. It will use the current Airflow SQLAlchemy connection to extract the data.
  • MySQL, Postgres, MSSQL and SQLite: Pass the required credentials to reach out each of these services. We will create a connection to the pointed database and read Airflow data from there.