diff --git a/openmetadata-docs/content/connectors/database/databricks/airflow.md b/openmetadata-docs/content/connectors/database/databricks/airflow.md index 28d9e68225f..0576241ab5b 100644 --- a/openmetadata-docs/content/connectors/database/databricks/airflow.md +++ b/openmetadata-docs/content/connectors/database/databricks/airflow.md @@ -372,6 +372,8 @@ By updating the YAML configuration, you will be able to extract metadata from di To ingest the Query Usage and Lineage information, the `serviceConnection` configuration will remain the same. However, the `sourceConfig` is now modeled after this JSON Schema. +Note: To get Query Usage and Lineage details, need a Azure Databricks Premium account. + ### 1. Define the YAML Config This is a sample config for Databricks Usage: diff --git a/openmetadata-docs/content/connectors/database/databricks/cli.md b/openmetadata-docs/content/connectors/database/databricks/cli.md index 521fb024fe6..b24459d599c 100644 --- a/openmetadata-docs/content/connectors/database/databricks/cli.md +++ b/openmetadata-docs/content/connectors/database/databricks/cli.md @@ -325,6 +325,8 @@ you will be able to extract metadata from different sources. To ingest the Query Usage and Lineage information, the `serviceConnection` configuration will remain the same. However, the `sourceConfig` is now modeled after this JSON Schema. +Note: To get Query Usage and Lineage details, need a Azure Databricks Premium account. + ### 1. Define the YAML Config This is a sample config for Databricks Usage: diff --git a/openmetadata-docs/content/connectors/database/databricks/troubleshooting.md b/openmetadata-docs/content/connectors/database/databricks/troubleshooting.md new file mode 100644 index 00000000000..04c91b27d3e --- /dev/null +++ b/openmetadata-docs/content/connectors/database/databricks/troubleshooting.md @@ -0,0 +1,83 @@ +--- +title: Databricks Connector Troubleshooting +slug: /connectors/database/databricks/troubleshooting +--- + +# Troubleshooting + +## Databricks connection details + +``` +source: + type: databricks + serviceName: local_databricks + serviceConnection: + config: + token: + hostPort: localhost:443 + connectionArguments: + http_path: + sourceConfig: + config: + type: DatabaseMetadata +sink: + type: metadata-rest + config: {} +workflowConfig: + openMetadataServerConfig: + hostPort: http://localhost:8585/api + authProvider: no-auth +``` + +Here are the steps to get `hostPort`, `token` and `http_path`. + +First login to Azure Databricks and from side bar select SQL Warehouse (In SQL section) + +
+Select Sql Warehouse +
+ +Now click on sql Warehouse from the SQL Warehouses list. + +
+Open Sql Warehouse +
+ +Now inside that page go to Connection details section. +In this page Server hostname and Port is your `hostPort`, HTTP path is your `http_path`. + +
+Connection details +
+ +In Connection details section page click on Create a personal access token. + +
+Open create tocken +
+ +Now In this page you can create new `token`. + +
+Generate tocken +
diff --git a/openmetadata-docs/content/menu.md b/openmetadata-docs/content/menu.md index f51d08331f1..adc5d91301e 100644 --- a/openmetadata-docs/content/menu.md +++ b/openmetadata-docs/content/menu.md @@ -240,6 +240,8 @@ site_menu: url: /connectors/database/databricks/airflow - category: Connectors / Database / Databricks / CLI url: /connectors/database/databricks/cli + - category: Connectors / Database / Databricks / Troubleshooting + url: /connectors/database/databricks/troubleshooting - category: Connectors / Database / Datalake url: /connectors/database/datalake - category: Connectors / Database / Datalake / Airflow diff --git a/openmetadata-docs/images/openmetadata/connectors/databricks/Connection-details.png b/openmetadata-docs/images/openmetadata/connectors/databricks/Connection-details.png new file mode 100644 index 00000000000..9f9e1108d80 Binary files /dev/null and b/openmetadata-docs/images/openmetadata/connectors/databricks/Connection-details.png differ diff --git a/openmetadata-docs/images/openmetadata/connectors/databricks/Generate-token.png b/openmetadata-docs/images/openmetadata/connectors/databricks/Generate-token.png new file mode 100644 index 00000000000..8eba5244c68 Binary files /dev/null and b/openmetadata-docs/images/openmetadata/connectors/databricks/Generate-token.png differ diff --git a/openmetadata-docs/images/openmetadata/connectors/databricks/Open-create-tocken-page.png b/openmetadata-docs/images/openmetadata/connectors/databricks/Open-create-tocken-page.png new file mode 100644 index 00000000000..6f687c46965 Binary files /dev/null and b/openmetadata-docs/images/openmetadata/connectors/databricks/Open-create-tocken-page.png differ diff --git a/openmetadata-docs/images/openmetadata/connectors/databricks/Open-sql-warehouse.png b/openmetadata-docs/images/openmetadata/connectors/databricks/Open-sql-warehouse.png new file mode 100644 index 00000000000..801b7a5e23f Binary files /dev/null and b/openmetadata-docs/images/openmetadata/connectors/databricks/Open-sql-warehouse.png differ diff --git a/openmetadata-docs/images/openmetadata/connectors/databricks/select-sql-warehouse.png b/openmetadata-docs/images/openmetadata/connectors/databricks/select-sql-warehouse.png new file mode 100644 index 00000000000..4d04928c8bb Binary files /dev/null and b/openmetadata-docs/images/openmetadata/connectors/databricks/select-sql-warehouse.png differ