2023-08-27 10:55:55 +02:00
---
title: Databricks
slug: /connectors/database/databricks
---
# Databricks
{% multiTablesWrapper %}
| Feature | Status |
| :----------------- | :--------------------------- |
| Stage | PROD |
| Metadata | {% icon iconName="check" /%} |
| Query Usage | {% icon iconName="check" /%} |
| Data Profiler | {% icon iconName="check" /%} |
| Data Quality | {% icon iconName="check" /%} |
2023-10-31 10:06:25 +01:00
| Stored Procedures | {% icon iconName="cross" /%} |
2023-08-27 10:55:55 +02:00
| DBT | {% icon iconName="check" /%} |
| Supported Versions | Databricks Runtime Version 9+ |
| Feature | Status |
| :----------- | :--------------------------- |
| Lineage | {% icon iconName="check" /%} |
| Table-level | {% icon iconName="check" /%} |
| Column-level | {% icon iconName="check" /%} |
{% /multiTablesWrapper %}
In this section, we provide guides and references to use the Databricks connector.
Configure and schedule Databricks metadata and profiler workflows from the OpenMetadata UI:
2023-11-24 18:12:05 -08:00
- [Unity Catalog ](#unity-catalog )
2023-08-27 10:55:55 +02:00
- [Metadata Ingestion ](#metadata-ingestion )
- [Query Usage ](/connectors/ingestion/workflows/usage )
- [Data Profiler ](/connectors/ingestion/workflows/profiler )
- [Data Quality ](/connectors/ingestion/workflows/data-quality )
- [Lineage ](/connectors/ingestion/lineage )
- [dbt Integration ](/connectors/ingestion/workflows/dbt )
2023-09-12 12:22:40 +02:00
{% partial file="/v1.2/connectors/ingestion-modes-tiles.md" variables={yamlPath: "/connectors/database/databricks/yaml"} /%}
2023-08-27 10:55:55 +02:00
2023-09-12 12:22:40 +02:00
{% partial file="/v1.2/connectors/external-ingestion-deployment.md" /%}
2023-08-27 10:55:55 +02:00
{%inlineCallout icon="description" bold="OpenMetadata 0.12 or later" href="/deployment"%}
To deploy OpenMetadata, check the Deployment guides.
{%/inlineCallout%}
2023-11-24 18:12:05 -08:00
## Unity Catalog
2023-12-04 11:22:46 +05:30
If you are using unity catalog in Databricks, then checkout the [Unity Catalog ](/connectors/database/unity-catalog ) connector.
2023-11-24 18:12:05 -08:00
2023-08-27 10:55:55 +02:00
## Metadata Ingestion
{% partial
2023-09-12 12:22:40 +02:00
file="/v1.2/connectors/metadata-ingestion-ui.md"
2023-08-27 10:55:55 +02:00
variables={
connector: "Databricks",
2023-09-12 12:22:40 +02:00
selectServicePath: "/images/v1.2/connectors/databricks/select-service.png",
addNewServicePath: "/images/v1.2/connectors/databricks/add-new-service.png",
serviceConnectionPath: "/images/v1.2/connectors/databricks/service-connection.png",
2023-08-27 10:55:55 +02:00
}
/%}
{% stepsContainer %}
{% extraContent parentTagName="stepsContainer" %}
#### Connection Details
- **Host and Port**: Enter the fully qualified hostname and port number for your Databricks deployment in the Host and Port field.
- **Token**: Generated Token to connect to Databricks.
- **HTTP Path**: Databricks compute resources URL.
- **connectionTimeout**: The maximum amount of time (in seconds) to wait for a successful connection to the data source. If the connection attempt takes longer than this timeout period, an error will be returned.
- **Catalog**: Catalog of the data source(Example: hive_metastore). This is optional parameter, if you would like to restrict the metadata reading to a single catalog. When left blank, OpenMetadata Ingestion attempts to scan all the catalog.
- **DatabaseSchema**: databaseSchema of the data source. This is optional parameter, if you would like to restrict the metadata reading to a single databaseSchema. When left blank, OpenMetadata Ingestion attempts to scan all the databaseSchema.
2023-09-12 12:22:40 +02:00
{% partial file="/v1.2/connectors/database/advanced-configuration.md" /%}
2023-08-27 10:55:55 +02:00
{% /extraContent %}
2023-09-12 12:22:40 +02:00
{% partial file="/v1.2/connectors/test-connection.md" /%}
2023-08-27 10:55:55 +02:00
2023-09-12 12:22:40 +02:00
{% partial file="/v1.2/connectors/database/configure-ingestion.md" /%}
2023-08-27 10:55:55 +02:00
2023-09-12 12:22:40 +02:00
{% partial file="/v1.2/connectors/ingestion-schedule-and-deploy.md" /%}
2023-08-27 10:55:55 +02:00
{% /stepsContainer %}
2023-09-12 12:22:40 +02:00
{% partial file="/v1.2/connectors/troubleshooting.md" /%}
2023-08-27 10:55:55 +02:00
2023-09-12 12:22:40 +02:00
{% partial file="/v1.2/connectors/database/related.md" /%}