2024-06-18 15:53:06 +02:00
|
|
|
---
|
|
|
|
title: Databricks Connector Troubleshooting
|
|
|
|
slug: /connectors/database/databricks/troubleshooting
|
|
|
|
---
|
|
|
|
|
2025-04-04 14:33:30 +05:30
|
|
|
{% partial file="/v1.7/connectors/troubleshooting.md" /%}
|
2024-06-18 15:53:06 +02:00
|
|
|
|
|
|
|
## Databricks connection details
|
|
|
|
|
|
|
|
```
|
|
|
|
source:
|
|
|
|
type: databricks
|
|
|
|
serviceName: local_databricks
|
|
|
|
serviceConnection:
|
|
|
|
config:
|
|
|
|
catalog: hive_metastore
|
|
|
|
databaseSchema: default
|
|
|
|
token: <databricks token>
|
|
|
|
hostPort: localhost:443
|
|
|
|
connectionArguments:
|
|
|
|
http_path: <http path of databricks cluster>
|
|
|
|
sourceConfig:
|
|
|
|
config:
|
|
|
|
type: DatabaseMetadata
|
|
|
|
sink:
|
|
|
|
type: metadata-rest
|
|
|
|
config: {}
|
|
|
|
workflowConfig:
|
|
|
|
openMetadataServerConfig:
|
|
|
|
hostPort: http://localhost:8585/api
|
|
|
|
authProvider: no-auth
|
|
|
|
```
|
|
|
|
|
|
|
|
Here are the steps to get `hostPort`, `token` and `http_path`.
|
|
|
|
|
|
|
|
First login to Azure Databricks and from side bar select SQL Warehouse (In SQL section)
|
|
|
|
|
|
|
|
|
|
|
|
{% image
|
2024-12-12 11:34:09 +05:30
|
|
|
src="/images/v1.7/connectors/databricks/select-sql-warehouse.png"
|
2024-06-18 15:53:06 +02:00
|
|
|
alt="Select Sql Warehouse"
|
|
|
|
caption="Select Sql Warehouse" /%}
|
|
|
|
|
|
|
|
|
|
|
|
Now click on sql Warehouse from the SQL Warehouses list.
|
|
|
|
|
|
|
|
|
|
|
|
{% image
|
2024-12-12 11:34:09 +05:30
|
|
|
src="/images/v1.7/connectors/databricks/Open-sql-warehouse.png"
|
2024-06-18 15:53:06 +02:00
|
|
|
alt="Open Sql Warehouse"
|
|
|
|
caption="Open Sql Warehouse" /%}
|
|
|
|
|
|
|
|
|
|
|
|
Now inside that page go to Connection details section.
|
|
|
|
In this page Server hostname and Port is your `hostPort`, HTTP path is your `http_path`.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
{% image
|
2024-12-12 11:34:09 +05:30
|
|
|
src="/images/v1.7/connectors/databricks/Connection-details.png"
|
2024-06-18 15:53:06 +02:00
|
|
|
alt="Connection details"
|
|
|
|
caption="Connection details" /%}
|
|
|
|
|
|
|
|
|
|
|
|
In Connection details section page click on Create a personal access token.
|
|
|
|
|
|
|
|
{% image
|
2024-12-12 11:34:09 +05:30
|
|
|
src="/images/v1.7/connectors/databricks/Open-create-tocken-page.png"
|
2024-06-18 15:53:06 +02:00
|
|
|
alt="Open create tocken"
|
|
|
|
caption="Open create tocken" /%}
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Now In this page you can create new `token`.
|
|
|
|
|
|
|
|
|
|
|
|
{% image
|
2024-12-12 11:34:09 +05:30
|
|
|
src="/images/v1.7/connectors/databricks/Generate-token.png"
|
2024-06-18 15:53:06 +02:00
|
|
|
alt="Generate tocken"
|
|
|
|
caption="Generate tocken" /%}
|
|
|
|
|