2023-12-13 14:03:08 +01:00
|
|
|
---
|
|
|
|
|
title: Connectors
|
|
|
|
|
slug: /connectors
|
|
|
|
|
---
|
|
|
|
|
|
|
|
|
|
# Connectors
|
|
|
|
|
|
|
|
|
|
OpenMetadata can extract metadata from the following list of connectors below.
|
|
|
|
|
|
|
|
|
|
## Ingestion Deployment
|
|
|
|
|
|
|
|
|
|
To run the Ingestion via the UI you'll need to use the OpenMetadata Ingestion Container, which comes shipped with
|
|
|
|
|
custom Airflow plugins to handle the workflow deployment. If you want to install it manually in an already existing
|
|
|
|
|
Airflow host, you can follow [this](/deployment/ingestion/openmetadata) guide.
|
|
|
|
|
|
|
|
|
|
If you don't want to use the OpenMetadata Ingestion container to configure the workflows via the UI, then you can check
|
|
|
|
|
the following docs to run the Ingestion Framework in any orchestrator externally.
|
|
|
|
|
|
|
|
|
|
{% tilesContainer %}
|
|
|
|
|
{% tile
|
|
|
|
|
title="Run Connectors from the OpenMetadata UI"
|
|
|
|
|
description="Learn how to manage your deployment to run connectors from the UI"
|
|
|
|
|
link="/deployment/ingestion/openmetadata"
|
|
|
|
|
/ %}
|
|
|
|
|
{% tile
|
|
|
|
|
title="External Schedulers"
|
|
|
|
|
description="Get more information about running the Ingestion Framework Externally"
|
2024-02-23 08:53:10 +01:00
|
|
|
link="/deployment/ingestion/external"
|
2023-12-13 14:03:08 +01:00
|
|
|
/ %}
|
|
|
|
|
{% /tilesContainer %}
|
|
|
|
|
|
|
|
|
|
## Database / DataWarehouse Services
|
|
|
|
|
|
2024-02-26 09:10:54 +01:00
|
|
|
{% connectorsListContainer %}
|
|
|
|
|
|
|
|
|
|
{% connectorInfoCard name="Athena" stage="PROD" href="/connectors/database/athena" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="AzureSQL" stage="PROD" href="/connectors/database/azuresql" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="BigQuery" stage="PROD" href="/connectors/database/bigquery" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="BigTable" stage="BETA" href="/connectors/database/bigtable" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="Clickhouse" stage="PROD" href="/connectors/database/clickhouse" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="Couchbase" stage="BETA" href="/connectors/database/couchbase" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="Datalake" stage="PROD" href="/connectors/database/datalake" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="Databricks" stage="PROD" href="/connectors/database/databricks" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="DB2" stage="PROD" href="/connectors/database/db2" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="Delta Lake" stage="PROD" href="/connectors/database/deltalake" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="Domo" stage="PROD" href="/connectors/database/domo-database" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="Druid" stage="PROD" href="/connectors/database/druid" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="DynamoDB" stage="PROD" href="/connectors/database/dynamodb" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="Glue" stage="PROD" href="/connectors/database/glue" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="Greenplum" stage="BETA" href="/connectors/database/greenplum" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="Hive" stage="PROD" href="/connectors/database/hive" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="Iceberg" stage="BETA" href="/connectors/database/iceberg" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="Impala" stage="PROD" href="/connectors/database/impala" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="MariaDB" stage="PROD" href="/connectors/database/mariadb" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="MongoDB" stage="PROD" href="/connectors/database/mongodb" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="MSSQL" stage="PROD" href="/connectors/database/mssql" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="MySQL" stage="PROD" href="/connectors/database/mysql" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="Oracle" stage="PROD" href="/connectors/database/oracle" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="PinotDB" stage="PROD" href="/connectors/database/pinotdb" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="Postgres" stage="PROD" href="/connectors/database/postgres" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="Presto" stage="PROD" href="/connectors/database/presto" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="Redshift" stage="PROD" href="/connectors/database/redshift" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="Salesforce" stage="PROD" href="/connectors/database/salesforce" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="SAP Hana" stage="PROD" href="/connectors/database/sap-hana" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="SAS" stage="BETA" href="/connectors/database/sas" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="SingleStore" stage="PROD" href="/connectors/database/singlestore" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="Snowflake" stage="PROD" href="/connectors/database/snowflake" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="SQLite" stage="PROD" href="/connectors/database/sqlite" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="Trino" stage="PROD" href="/connectors/database/trino" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="Unity Catalog" stage="PROD" href="/connectors/database/unity-catalog" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="Vertica" stage="PROD" href="/connectors/database/vertica" platform="OpenMetadata" / %}
|
|
|
|
|
|
|
|
|
|
{% /connectorsListContainer %}
|
2023-12-13 14:03:08 +01:00
|
|
|
|
|
|
|
|
## Dashboard Services
|
|
|
|
|
|
2024-02-26 09:10:54 +01:00
|
|
|
{% connectorsListContainer %}
|
|
|
|
|
|
|
|
|
|
{% connectorInfoCard name="Domo" stage="PROD" href="/connectors/dashboard/domo-dashboard" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="Looker" stage="PROD" href="/connectors/dashboard/looker" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="Metabase" stage="PROD" href="/connectors/dashboard/metabase" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="Mode" stage="PROD" href="/connectors/dashboard/mode" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="PowerBI" stage="PROD" href="/connectors/dashboard/powerbi" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="Qlik Sense" stage="PROD" href="/connectors/dashboard/qliksense" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="QuickSight" stage="PROD" href="/connectors/dashboard/quicksight" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="Redash" stage="PROD" href="/connectors/dashboard/redash" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="Superset" stage="PROD" href="/connectors/dashboard/superset" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="Tableau" stage="PROD" href="/connectors/dashboard/tableau" platform="OpenMetadata" / %}
|
|
|
|
|
|
|
|
|
|
{% /connectorsListContainer %}
|
2023-12-13 14:03:08 +01:00
|
|
|
|
|
|
|
|
## Messaging Services
|
|
|
|
|
|
2024-02-26 09:10:54 +01:00
|
|
|
{% connectorsListContainer %}
|
|
|
|
|
|
|
|
|
|
{% connectorInfoCard name="Kafka" stage="PROD" href="/connectors/messaging/kafka" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="Kinesis" stage="PROD" href="/connectors/messaging/kinesis" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="Redpanda" stage="PROD" href="/connectors/messaging/redpanda" platform="OpenMetadata" / %}
|
|
|
|
|
|
|
|
|
|
{% /connectorsListContainer %}
|
2023-12-13 14:03:08 +01:00
|
|
|
|
|
|
|
|
## Pipeline Services
|
|
|
|
|
|
2024-02-26 09:10:54 +01:00
|
|
|
{% connectorsListContainer %}
|
|
|
|
|
|
|
|
|
|
{% connectorInfoCard name="Airbyte" stage="PROD" href="/connectors/pipeline/airbyte" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="Airflow" stage="PROD" href="/connectors/pipeline/airflow" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="Dagster" stage="PROD" href="/connectors/pipeline/dagster" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="Databricks" stage="PROD" href="/connectors/pipeline/databricks-pipeline" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="Domo" stage="PROD" href="/connectors/pipeline/domo-pipeline" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="Fivetran" stage="PROD" href="/connectors/pipeline/fivetran" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="Glue" stage="PROD" href="/connectors/pipeline/glue-pipeline" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="NiFi" stage="PROD" href="/connectors/pipeline/nifi" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="Spline" stage="BETA" href="/connectors/pipeline/spline" platform="OpenMetadata" / %}
|
|
|
|
|
|
|
|
|
|
{% /connectorsListContainer %}
|
|
|
|
|
|
2023-12-13 14:03:08 +01:00
|
|
|
|
|
|
|
|
## ML Model Services
|
|
|
|
|
|
2024-02-26 09:10:54 +01:00
|
|
|
{% connectorsListContainer %}
|
|
|
|
|
|
|
|
|
|
{% connectorInfoCard name="MLflow" stage="PROD" href="/connectors/ml-model/mlflow" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="Sagemaker" stage="PROD" href="/connectors/ml-model/sagemaker" platform="OpenMetadata" / %}
|
|
|
|
|
|
|
|
|
|
{% /connectorsListContainer %}
|
2023-12-13 14:03:08 +01:00
|
|
|
|
|
|
|
|
## Storage Services
|
|
|
|
|
|
2024-02-26 09:10:54 +01:00
|
|
|
{% connectorsListContainer %}
|
|
|
|
|
|
|
|
|
|
{% connectorInfoCard name="S3" stage="PROD" href="/connectors/storage/s3" platform="OpenMetadata" / %}
|
|
|
|
|
|
|
|
|
|
{% /connectorsListContainer %}
|
|
|
|
|
|
2023-12-13 14:03:08 +01:00
|
|
|
|
|
|
|
|
## Metadata Services
|
|
|
|
|
|
2024-02-26 09:10:54 +01:00
|
|
|
{% connectorsListContainer %}
|
|
|
|
|
|
|
|
|
|
{% connectorInfoCard name="Amundsen" stage="PROD" href="/connectors/metadata/amundsen" platform="OpenMetadata" / %}
|
|
|
|
|
{% connectorInfoCard name="Atlas" stage="PROD" href="/connectors/metadata/atlas" platform="OpenMetadata" / %}
|
2024-02-28 13:44:11 +05:30
|
|
|
{% connectorInfoCard name="Alation" stage="PROD" href="/connectors/metadata/alation" platform="OpenMetadata" / %}
|
2024-02-26 09:10:54 +01:00
|
|
|
|
|
|
|
|
{% /connectorsListContainer %}
|
|
|
|
|
|
2023-12-13 14:03:08 +01:00
|
|
|
|
|
|
|
|
## Search Services
|
|
|
|
|
|
2024-02-26 09:10:54 +01:00
|
|
|
{% connectorsListContainer %}
|
|
|
|
|
|
|
|
|
|
{% connectorInfoCard name="Elasticsearch" stage="PROD" href="/connectors/search/elasticsearch" platform="OpenMetadata" / %}
|
|
|
|
|
|
|
|
|
|
{% /connectorsListContainer %}
|
