2024-06-18 15:53:06 +02:00
---
2025-06-20 19:46:38 +05:30
title: Databricks Pipeline | OpenMetadata Integration Guide
2024-06-18 15:53:06 +02:00
slug: /connectors/pipeline/databricks-pipeline
---
{% connectorDetailsHeader
name="Databricks"
stage="PROD"
platform="OpenMetadata"
2025-03-13 13:58:04 +05:30
availableFeatures=["Pipelines", "Pipeline Status", "Usage"]
2024-06-18 15:53:06 +02:00
unavailableFeatures=["Owners", "Tags", "Lineage"]
/ %}
In this section, we provide guides and references to use the Databricks Pipeline connector.
Configure and schedule Databricks Pipeline metadata workflows from the OpenMetadata UI:
- [Metadata Ingestion ](#metadata-ingestion )
2025-04-04 13:59:31 +05:30
- [Troubleshooting ](/connectors/pipeline/databricks-pipeline/troubleshooting )
2024-06-18 15:53:06 +02:00
2024-12-12 11:34:09 +05:30
{% partial file="/v1.7/connectors/ingestion-modes-tiles.md" variables={yamlPath: "/connectors/pipeline/databricks-pipeline/yaml"} /%}
2024-06-18 15:53:06 +02:00
## Metadata Ingestion
{% partial
2024-12-12 11:34:09 +05:30
file="/v1.7/connectors/metadata-ingestion-ui.md"
2024-06-18 15:53:06 +02:00
variables={
connector: "Databricks Pipeline",
2024-12-12 11:34:09 +05:30
selectServicePath: "/images/v1.7/connectors/databrickspipeline/select-service.png",
addNewServicePath: "/images/v1.7/connectors/databrickspipeline/add-new-service.png",
serviceConnectionPath: "/images/v1.7/connectors/databrickspipeline/service-connection.png",
2024-06-18 15:53:06 +02:00
}
/%}
{% stepsContainer %}
{% extraContent parentTagName="stepsContainer" %}
#### Connection Details
- **Host and Port**: Enter the fully qualified hostname and port number for your Databricks Pipeline deployment in the Host and Port field.
- **Token**: Generated Token to connect to Databricks Pipeline.
- **HTTP Path**: Databricks Pipeline compute resources URL.
- **Connection Arguments (Optional)**: Enter the details for any additional connection arguments such as security or protocol configs that can be sent to Databricks during the connection. These details must be added as Key-Value pairs.
- In case you are using Single-Sign-On (SSO) for authentication, add the `authenticator` details in the Connection Arguments as a Key-Value pair as follows: `"authenticator" : "sso_login_url"`
2024-12-12 11:34:09 +05:30
{% partial file="/v1.7/connectors/test-connection.md" /%}
2024-06-18 15:53:06 +02:00
2024-12-12 11:34:09 +05:30
{% partial file="/v1.7/connectors/pipeline/configure-ingestion.md" /%}
2024-06-18 15:53:06 +02:00
2024-12-12 11:34:09 +05:30
{% partial file="/v1.7/connectors/ingestion-schedule-and-deploy.md" /%}
2024-06-18 15:53:06 +02:00
{% /stepsContainer %}