2023-04-20 10:22:13 +05:30
---
title: Databricks Pipeline
2023-05-04 12:37:18 -07:00
slug: /connectors/pipeline/databricks-pipeline
2023-04-20 10:22:13 +05:30
---
# Databricks Pipeline
2023-08-02 10:46:20 +05:30
{% multiTablesWrapper %}
| Feature | Status |
|--:--------------------------|--:---------------------------|
| Stage | PROD |
| Metadata | {% icon iconName="check" /%} |
2023-08-02 10:53:08 +05:30
| Supported Versions | -- |
2023-08-02 10:46:20 +05:30
{% /multiTablesWrapper %}
2023-04-20 10:22:13 +05:30
In this section, we provide guides and references to use the Databricks Pipeline connector.
Configure and schedule Databricks Pipeline metadata workflows from the OpenMetadata UI:
- [Requirements ](#requirements )
- [Metadata Ingestion ](#metadata-ingestion )
2023-07-06 15:11:13 +02:00
{% partial file="/v1.1.0/connectors/ingestion-modes-tiles.md" variables={yamlPath: "/connectors/pipeline/databricks-pipeline/yaml"} /%}
2023-04-20 10:22:13 +05:30
## Requirements
{%inlineCallout icon="description" bold="OpenMetadata 0.12 or later" href="/deployment"%}
To deploy OpenMetadata, check the Deployment guides.
{% /inlineCallout %}
## Metadata Ingestion
2023-07-06 15:11:13 +02:00
{% partial
file="/v1.1.0/connectors/metadata-ingestion-ui.md"
variables={
connector: "Databricks Pipeline",
selectServicePath: "/images/v1.1.0/connectors/databrickspipeline/select-service.png",
addNewServicePath: "/images/v1.1.0/connectors/databrickspipeline/add-new-service.png",
serviceConnectionPath: "/images/v1.1.0/connectors/databrickspipeline/service-connection.png",
}
/%}
2023-04-20 10:22:13 +05:30
2023-07-06 15:11:13 +02:00
{% stepsContainer %}
2023-04-20 10:22:13 +05:30
{% extraContent parentTagName="stepsContainer" %}
2023-07-06 15:11:13 +02:00
#### Connection Details
2023-04-20 10:22:13 +05:30
- **Host and Port**: Enter the fully qualified hostname and port number for your Databricks Pipeline deployment in the Host and Port field.
- **Token**: Generated Token to connect to Databricks Pipeline.
- **HTTP Path**: Databricks Pipeline compute resources URL.
- **Connection Arguments (Optional)**: Enter the details for any additional connection arguments such as security or protocol configs that can be sent to Databricks during the connection. These details must be added as Key-Value pairs.
- In case you are using Single-Sign-On (SSO) for authentication, add the `authenticator` details in the Connection Arguments as a Key-Value pair as follows: `"authenticator" : "sso_login_url"`
2023-06-28 20:31:50 +05:30
2023-07-06 15:11:13 +02:00
{% partial file="/v1.1.0/connectors/test-connection.md" /%}
2023-04-20 10:22:13 +05:30
2023-07-06 15:11:13 +02:00
{% partial file="/v1.1.0/connectors/pipeline/configure-ingestion.md" /%}
2023-04-20 10:22:13 +05:30
2023-07-06 15:11:13 +02:00
{% partial file="/v1.1.0/connectors/ingestion-schedule-and-deploy.md" /%}
2023-04-20 10:22:13 +05:30
{% /stepsContainer %}
2023-07-06 15:11:13 +02:00
{% partial file="/v1.1.0/connectors/troubleshooting.md" /%}