Docs: Troubleshoot Section Addition in Pipeline till DBT Cloud (#20612)

This commit is contained in:
Rounak Dhillon 2025-04-04 13:59:31 +05:30 committed by GitHub
parent 4aed3acbd7
commit acd2926413
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
28 changed files with 130 additions and 36 deletions

View File

@ -361,10 +361,14 @@ site_menu:
url: /connectors/pipeline/airbyte
- category: Connectors / Pipeline / Airbyte / Run Externally
url: /connectors/pipeline/airbyte/yaml
- category: Connectors / Pipeline / Airbyte / Troubleshooting
url: /connectors/pipeline/airbyte/troubleshooting
- category: Connectors / Pipeline / Airflow
url: /connectors/pipeline/airflow
- category: Connectors / Pipeline / Airflow / Run Externally
url: /connectors/pipeline/airflow/yaml
- category: Connectors / Pipeline / Airflow / Troubleshooting
url: /connectors/search/airflow/troubleshooting
- category: Connectors / Pipeline / Airflow / Lineage Backend
url: /connectors/pipeline/airflow/lineage-backend
- category: Connectors / Pipeline / Airflow / Lineage Operator
@ -385,10 +389,14 @@ site_menu:
url: /connectors/pipeline/dagster
- category: Connectors / Pipeline / Dagster / Run Externally
url: /connectors/pipeline/dagster/yaml
- category: Connectors / Pipeline / Dagster / Troubleshooting
url: /connectors/pipeline/dagster/troubleshooting
- category: Connectors / Pipeline / dbt Cloud
url: /connectors/pipeline/dbtcloud
- category: Connectors / Pipeline / dbt Cloud / Run Externally
url: /connectors/pipeline/dbtcloud/yaml
- category: Connectors / Pipeline / dbt Cloud / Troubleshooting
url: /connectors/pipeline/dbtcloud/troubleshooting
- category: Connectors / Pipeline / KafkaConnect
url: /connectors/pipeline/kafkaconnect
- category: Connectors / Pipeline / KafkaConnect / Run Externally
@ -402,6 +410,8 @@ site_menu:
url: /connectors/pipeline/datafactory
- category: Connectors / Pipeline / Azure Data Factory / Run Externally
url: /connectors/pipeline/datafactory/yaml
- category: Connectors / Pipeline / Azure Data Factory / Troubleshooting
url: /connectors/pipeline/datafactory/troubleshooting
- category: Connectors / Pipeline / Stitch
url: /connectors/pipeline/stitch
- category: Connectors / Pipeline / Stitch / Run Externally
@ -412,6 +422,8 @@ site_menu:
url: /connectors/pipeline/databricks-pipeline
- category: Connectors / Pipeline / Databricks Pipeline / Run Externally
url: /connectors/pipeline/databricks-pipeline/yaml
- category: Connectors / Pipeline / Databricks Pipeline / Troubleshooting
url: /connectors/pipeline/databricks-pipeline/troubleshooting
- category: Connectors / Pipeline / Domo Pipeline
url: /connectors/pipeline/domo-pipeline
- category: Connectors / Pipeline / Domo Pipeline / Run Externally

View File

@ -16,6 +16,7 @@ In this section, we provide guides and references to use the Airbyte connector.
Configure and schedule Airbyte metadata and profiler workflows from the OpenMetadata UI:
- [Metadata Ingestion](#metadata-ingestion)
- [Troubleshooting](/connectors/pipeline/airbyte/troubleshooting)
{% partial file="/v1.6/connectors/ingestion-modes-tiles.md" variables={yamlPath: "/connectors/pipeline/airbyte/yaml"} /%}
@ -53,5 +54,3 @@ Configure and schedule Airbyte metadata and profiler workflows from the OpenMeta
{% partial file="/v1.6/connectors/ingestion-schedule-and-deploy.md" /%}
{% /stepsContainer %}
{% partial file="/v1.6/connectors/troubleshooting.md" /%}

View File

@ -0,0 +1,6 @@
---
title: Airbyte Connector Troubleshooting Guide | OpenMetadata Support
slug: /connectors/pipeline/airbyte/troubleshooting
---
{% partial file="/v1.6/connectors/troubleshooting.md" /%}

View File

@ -15,6 +15,8 @@ In this section, we provide guides and references to use the Airflow connector.
Configure and schedule Airflow metadata workflow from the OpenMetadata UI:
- [Troubleshooting](/connectors/search/airflow/troubleshooting)
{% partial file="/v1.6/connectors/ingestion-modes-tiles.md" variables={yamlPath: "/connectors/pipeline/airflow/yaml"} /%}
## Requirements
@ -62,5 +64,3 @@ In terms of `connection` we support the following selections:
{% partial file="/v1.6/connectors/ingestion-schedule-and-deploy.md" /%}
{% /stepsContainer %}
{% partial file="/v1.6/connectors/troubleshooting.md" /%}

View File

@ -0,0 +1,6 @@
---
title: Airflow Connector Troubleshooting Guide | OpenMetadata Support
slug: /connectors/search/airflow/troubleshooting
---
{% partial file="/v1.6/connectors/troubleshooting.md" /%}

View File

@ -22,7 +22,7 @@ Configure and schedule Dagster metadata and profiler workflows from the OpenMeta
- [Service Name](#service-name)
- [Connection Details](#connection-details)
- [Metadata Ingestion Options](#metadata-ingestion-options)
- [Troubleshooting](#troubleshooting)
- [Troubleshooting](/connectors/pipeline/dagster/troubleshooting)
- [Workflow Deployment Error](#workflow-deployment-error)
{% partial file="/v1.6/connectors/ingestion-modes-tiles.md" variables={yamlPath: "/connectors/pipeline/dagster/yaml"} /%}
@ -70,5 +70,3 @@ The ingestion framework uses [dagster graphql python client](https://docs.dagste
{% partial file="/v1.6/connectors/ingestion-schedule-and-deploy.md" /%}
{% /stepsContainer %}
{% partial file="/v1.6/connectors/troubleshooting.md" /%}

View File

@ -0,0 +1,6 @@
---
title: Dagster Connector Troubleshooting Guide | OpenMetadata Support
slug: /connectors/pipeline/dagster/troubleshooting
---
{% partial file="/v1.6/connectors/troubleshooting.md" /%}

View File

@ -16,6 +16,7 @@ In this section, we provide guides and references to use the Databricks Pipeline
Configure and schedule Databricks Pipeline metadata workflows from the OpenMetadata UI:
- [Metadata Ingestion](#metadata-ingestion)
- [Troubleshooting](/connectors/pipeline/databricks-pipeline/troubleshooting)
{% partial file="/v1.6/connectors/ingestion-modes-tiles.md" variables={yamlPath: "/connectors/pipeline/databricks-pipeline/yaml"} /%}
@ -49,5 +50,3 @@ Configure and schedule Databricks Pipeline metadata workflows from the OpenMetad
{% partial file="/v1.6/connectors/ingestion-schedule-and-deploy.md" /%}
{% /stepsContainer %}
{% partial file="/v1.6/connectors/troubleshooting.md" /%}

View File

@ -0,0 +1,6 @@
---
title: Databricks Pipeline Troubleshooting Guide | OpenMetadata Support
slug: /connectors/pipeline/databricks-pipeline/troubleshooting
---
{% partial file="/v1.6/connectors/troubleshooting.md" /%}

View File

@ -23,7 +23,7 @@ Configure and schedule Azure Data Factory metadata and profiler workflows from t
- [Service Name](#service-name)
- [Connection Details](#connection-details)
- [Metadata Ingestion Options](#metadata-ingestion-options)
- [Troubleshooting](#troubleshooting)
- [Troubleshooting](/connectors/pipeline/datafactory/troubleshooting)
- [Workflow Deployment Error](#workflow-deployment-error)
{% partial file="/v1.6/connectors/ingestion-modes-tiles.md" variables={yamlPath: "/connectors/pipeline/datafactory/yaml"} /%}
@ -121,9 +121,6 @@ Steps to retrieve and display the lineage information for a Data Factory service
By successfully completing these steps, the lineage information for the service will be displayed.
{% partial file="/v1.6/connectors/troubleshooting.md" /%}
### Missing Lineage
If lineage information is not displayed for a Data Factory service, follow these steps to diagnose the issue.
1. *Permissions*: Ensure that the service principal or managed identity youre using has the necessary permissions in the Data Factory resource. (Reader, Contributor or Data Factory Contributor role at minimum).

View File

@ -0,0 +1,6 @@
---
title: Azure Data Factory Troubleshooting Guide | OpenMetadata Support
slug: /connectors/pipeline/datafactory/troubleshooting
---
{% partial file="/v1.6/connectors/troubleshooting.md" /%}

View File

@ -22,7 +22,7 @@ Configure and schedule dbt Cloud metadata and profiler workflows from the OpenMe
- [Service Name](#service-name)
- [Connection Details](#connection-details)
- [Metadata Ingestion Options](#metadata-ingestion-options)
- [Troubleshooting](#troubleshooting)
- [Troubleshooting](/connectors/pipeline/dbtcloud/troubleshooting)
- [Workflow Deployment Error](#workflow-deployment-error)
{% partial file="/v1.6/connectors/ingestion-modes-tiles.md" variables={yamlPath: "/connectors/pipeline/dbtcloud/yaml"} /%}
@ -99,10 +99,6 @@ By successfully completing these steps, the lineage information for the service
src="/images/v1.6/connectors/dbtcloud/lineage.png"
alt="DBT Cloud Lineage" /%}
{% partial file="/v1.6/connectors/troubleshooting.md" /%}
### Missing Lineage
If lineage information is not displayed for a DBT Cloud service, follow these steps to diagnose the issue.
1. *DBT Cloud Account*: Make sure that the DBT cloud instance you are ingesting have the necessary permissions to fetch jobs and run graphql queries over the API.

View File

@ -0,0 +1,6 @@
---
title: DBT Cloud Troubleshooting Guide | OpenMetadata Support
slug: /connectors/pipeline/dbtcloud/troubleshooting
---
{% partial file="/v1.6/connectors/troubleshooting.md" /%}

View File

@ -564,10 +564,14 @@ site_menu:
url: /connectors/pipeline/airbyte
- category: Connectors / Pipeline / Airbyte / Run Externally
url: /connectors/pipeline/airbyte/yaml
- category: Connectors / Pipeline / Airbyte / Troubleshooting
url: /connectors/pipeline/airbyte/troubleshooting
- category: Connectors / Pipeline / Airflow
url: /connectors/pipeline/airflow
- category: Connectors / Pipeline / Airflow / Run Externally
url: /connectors/pipeline/airflow/yaml
- category: Connectors / Pipeline / Airflow / Troubleshooting
url: /connectors/search/airflow/troubleshooting
- category: Connectors / Pipeline / Airflow / Lineage Backend
url: /connectors/pipeline/airflow/lineage-backend
- category: Connectors / Pipeline / Airflow / Lineage Operator
@ -582,10 +586,14 @@ site_menu:
url: /connectors/pipeline/dagster
- category: Connectors / Pipeline / Dagster / Run Externally
url: /connectors/pipeline/dagster/yaml
- category: Connectors / Pipeline / Dagster / Troubleshooting
url: /connectors/pipeline/dagster/troubleshooting
- category: Connectors / Pipeline / dbt Cloud
url: /connectors/pipeline/dbtcloud
- category: Connectors / Pipeline / dbt Cloud / Run Externally
url: /connectors/pipeline/dbtcloud/yaml
- category: Connectors / Pipeline / dbt Cloud / Troubleshooting
url: /connectors/pipeline/dbtcloud/troubleshooting
- category: Connectors / Pipeline / KafkaConnect
url: /connectors/pipeline/kafkaconnect
- category: Connectors / Pipeline / KafkaConnect / Run Externally
@ -594,6 +602,8 @@ site_menu:
url: /connectors/pipeline/databricks-pipeline
- category: Connectors / Pipeline / Databricks Pipeline / Run Externally
url: /connectors/pipeline/databricks-pipeline/yaml
- category: Connectors / Pipeline / Databricks Pipeline / Troubleshooting
url: /connectors/pipeline/databricks-pipeline/troubleshooting
- category: Connectors / Pipeline / Domo Pipeline
url: /connectors/pipeline/domo-pipeline
- category: Connectors / Pipeline / Domo Pipeline / Run Externally

View File

@ -369,10 +369,14 @@ site_menu:
url: /connectors/pipeline/airbyte
- category: Connectors / Pipeline / Airbyte / Run Externally
url: /connectors/pipeline/airbyte/yaml
- category: Connectors / Pipeline / Airbyte / Troubleshooting
url: /connectors/pipeline/airbyte/troubleshooting
- category: Connectors / Pipeline / Airflow
url: /connectors/pipeline/airflow
- category: Connectors / Pipeline / Airflow / Run Externally
url: /connectors/pipeline/airflow/yaml
- category: Connectors / Pipeline / Airflow / Troubleshooting
url: /connectors/search/airflow/troubleshooting
- category: Connectors / Pipeline / Airflow / Lineage Backend
url: /connectors/pipeline/airflow/lineage-backend
- category: Connectors / Pipeline / Airflow / Lineage Operator
@ -393,10 +397,14 @@ site_menu:
url: /connectors/pipeline/dagster
- category: Connectors / Pipeline / Dagster / Run Externally
url: /connectors/pipeline/dagster/yaml
- category: Connectors / Pipeline / Dagster / Troubleshooting
url: /connectors/pipeline/dagster/troubleshooting
- category: Connectors / Pipeline / dbt Cloud
url: /connectors/pipeline/dbtcloud
- category: Connectors / Pipeline / dbt Cloud / Run Externally
url: /connectors/pipeline/dbtcloud/yaml
- category: Connectors / Pipeline / dbt Cloud / Troubleshooting
url: /connectors/pipeline/dbtcloud/troubleshooting
- category: Connectors / Pipeline / KafkaConnect
url: /connectors/pipeline/kafkaconnect
- category: Connectors / Pipeline / KafkaConnect / Run Externally
@ -410,6 +418,8 @@ site_menu:
url: /connectors/pipeline/datafactory
- category: Connectors / Pipeline / Azure Data Factory / Run Externally
url: /connectors/pipeline/datafactory/yaml
- category: Connectors / Pipeline / Azure Data Factory / Troubleshooting
url: /connectors/pipeline/datafactory/troubleshooting
- category: Connectors / Pipeline / Stitch
url: /connectors/pipeline/stitch
- category: Connectors / Pipeline / Stitch / Run Externally
@ -420,6 +430,8 @@ site_menu:
url: /connectors/pipeline/databricks-pipeline
- category: Connectors / Pipeline / Databricks Pipeline / Run Externally
url: /connectors/pipeline/databricks-pipeline/yaml
- category: Connectors / Pipeline / Databricks Pipeline / Troubleshooting
url: /connectors/pipeline/databricks-pipeline/troubleshooting
- category: Connectors / Pipeline / Domo Pipeline
url: /connectors/pipeline/domo-pipeline
- category: Connectors / Pipeline / Domo Pipeline / Run Externally

View File

@ -16,6 +16,7 @@ In this section, we provide guides and references to use the Airbyte connector.
Configure and schedule Airbyte metadata and profiler workflows from the OpenMetadata UI:
- [Metadata Ingestion](#metadata-ingestion)
- [Troubleshooting](/connectors/pipeline/airbyte/troubleshooting)
{% partial file="/v1.7/connectors/ingestion-modes-tiles.md" variables={yamlPath: "/connectors/pipeline/airbyte/yaml"} /%}
@ -53,5 +54,3 @@ Configure and schedule Airbyte metadata and profiler workflows from the OpenMeta
{% partial file="/v1.7/connectors/ingestion-schedule-and-deploy.md" /%}
{% /stepsContainer %}
{% partial file="/v1.7/connectors/troubleshooting.md" /%}

View File

@ -0,0 +1,6 @@
---
title: Airbyte Connector Troubleshooting Guide | OpenMetadata Support
slug: /connectors/pipeline/airbyte/troubleshooting
---
{% partial file="/v1.7/connectors/troubleshooting.md" /%}

View File

@ -15,6 +15,8 @@ In this section, we provide guides and references to use the Airflow connector.
Configure and schedule Airflow metadata workflow from the OpenMetadata UI:
- [Troubleshooting](/connectors/search/airflow/troubleshooting)
{% partial file="/v1.7/connectors/ingestion-modes-tiles.md" variables={yamlPath: "/connectors/pipeline/airflow/yaml"} /%}
## Requirements
@ -62,5 +64,3 @@ In terms of `connection` we support the following selections:
{% partial file="/v1.7/connectors/ingestion-schedule-and-deploy.md" /%}
{% /stepsContainer %}
{% partial file="/v1.7/connectors/troubleshooting.md" /%}

View File

@ -0,0 +1,6 @@
---
title: Airflow Connector Troubleshooting Guide | OpenMetadata Support
slug: /connectors/search/airflow/troubleshooting
---
{% partial file="/v1.7/connectors/troubleshooting.md" /%}

View File

@ -22,7 +22,7 @@ Configure and schedule Dagster metadata and profiler workflows from the OpenMeta
- [Service Name](#service-name)
- [Connection Details](#connection-details)
- [Metadata Ingestion Options](#metadata-ingestion-options)
- [Troubleshooting](#troubleshooting)
- [Troubleshooting](/connectors/pipeline/dagster/troubleshooting)
- [Workflow Deployment Error](#workflow-deployment-error)
{% partial file="/v1.7/connectors/ingestion-modes-tiles.md" variables={yamlPath: "/connectors/pipeline/dagster/yaml"} /%}
@ -70,5 +70,3 @@ The ingestion framework uses [dagster graphql python client](https://docs.dagste
{% partial file="/v1.7/connectors/ingestion-schedule-and-deploy.md" /%}
{% /stepsContainer %}
{% partial file="/v1.7/connectors/troubleshooting.md" /%}

View File

@ -0,0 +1,6 @@
---
title: Dagster Connector Troubleshooting Guide | OpenMetadata Support
slug: /connectors/pipeline/dagster/troubleshooting
---
{% partial file="/v1.6/connectors/troubleshooting.md" /%}

View File

@ -16,6 +16,7 @@ In this section, we provide guides and references to use the Databricks Pipeline
Configure and schedule Databricks Pipeline metadata workflows from the OpenMetadata UI:
- [Metadata Ingestion](#metadata-ingestion)
- [Troubleshooting](/connectors/pipeline/databricks-pipeline/troubleshooting)
{% partial file="/v1.7/connectors/ingestion-modes-tiles.md" variables={yamlPath: "/connectors/pipeline/databricks-pipeline/yaml"} /%}
@ -49,5 +50,3 @@ Configure and schedule Databricks Pipeline metadata workflows from the OpenMetad
{% partial file="/v1.7/connectors/ingestion-schedule-and-deploy.md" /%}
{% /stepsContainer %}
{% partial file="/v1.7/connectors/troubleshooting.md" /%}

View File

@ -0,0 +1,6 @@
---
title: Databricks Pipeline Troubleshooting Guide | OpenMetadata Support
slug: /connectors/pipeline/databricks-pipeline/troubleshooting
---
{% partial file="/v1.7/connectors/troubleshooting.md" /%}

View File

@ -23,7 +23,7 @@ Configure and schedule Azure Data Factory metadata and profiler workflows from t
- [Service Name](#service-name)
- [Connection Details](#connection-details)
- [Metadata Ingestion Options](#metadata-ingestion-options)
- [Troubleshooting](#troubleshooting)
- [Troubleshooting](/connectors/pipeline/datafactory/troubleshooting)
- [Workflow Deployment Error](#workflow-deployment-error)
{% partial file="/v1.7/connectors/ingestion-modes-tiles.md" variables={yamlPath: "/connectors/pipeline/datafactory/yaml"} /%}
@ -121,9 +121,6 @@ Steps to retrieve and display the lineage information for a Data Factory service
By successfully completing these steps, the lineage information for the service will be displayed.
{% partial file="/v1.7/connectors/troubleshooting.md" /%}
### Missing Lineage
If lineage information is not displayed for a Data Factory service, follow these steps to diagnose the issue.
1. *Permissions*: Ensure that the service principal or managed identity youre using has the necessary permissions in the Data Factory resource. (Reader, Contributor or Data Factory Contributor role at minimum).

View File

@ -0,0 +1,6 @@
---
title: Azure Data Factory Troubleshooting Guide | OpenMetadata Support
slug: /connectors/pipeline/datafactory/troubleshooting
---
{% partial file="/v1.7/connectors/troubleshooting.md" /%}

View File

@ -22,7 +22,7 @@ Configure and schedule dbt Cloud metadata and profiler workflows from the OpenMe
- [Service Name](#service-name)
- [Connection Details](#connection-details)
- [Metadata Ingestion Options](#metadata-ingestion-options)
- [Troubleshooting](#troubleshooting)
- [Troubleshooting](/connectors/pipeline/dbtcloud/troubleshooting)
- [Workflow Deployment Error](#workflow-deployment-error)
{% partial file="/v1.7/connectors/ingestion-modes-tiles.md" variables={yamlPath: "/connectors/pipeline/dbtcloud/yaml"} /%}
@ -99,10 +99,6 @@ By successfully completing these steps, the lineage information for the service
src="/images/v1.7/connectors/dbtcloud/lineage.png"
alt="DBT Cloud Lineage" /%}
{% partial file="/v1.7/connectors/troubleshooting.md" /%}
### Missing Lineage
If lineage information is not displayed for a DBT Cloud service, follow these steps to diagnose the issue.
1. *DBT Cloud Account*: Make sure that the DBT cloud instance you are ingesting have the necessary permissions to fetch jobs and run graphql queries over the API.

View File

@ -0,0 +1,6 @@
---
title: DBT Cloud Troubleshooting Guide | OpenMetadata Support
slug: /connectors/pipeline/dbtcloud/troubleshooting
---
{% partial file="/v1.7/connectors/troubleshooting.md" /%}

View File

@ -572,10 +572,14 @@ site_menu:
url: /connectors/pipeline/airbyte
- category: Connectors / Pipeline / Airbyte / Run Externally
url: /connectors/pipeline/airbyte/yaml
- category: Connectors / Pipeline / Airbyte / Troubleshooting
url: /connectors/pipeline/airbyte/troubleshooting
- category: Connectors / Pipeline / Airflow
url: /connectors/pipeline/airflow
- category: Connectors / Pipeline / Airflow / Run Externally
url: /connectors/pipeline/airflow/yaml
- category: Connectors / Pipeline / Airflow / Troubleshooting
url: /connectors/search/airflow/troubleshooting
- category: Connectors / Pipeline / Airflow / Lineage Backend
url: /connectors/pipeline/airflow/lineage-backend
- category: Connectors / Pipeline / Airflow / Lineage Operator
@ -590,10 +594,14 @@ site_menu:
url: /connectors/pipeline/dagster
- category: Connectors / Pipeline / Dagster / Run Externally
url: /connectors/pipeline/dagster/yaml
- category: Connectors / Pipeline / Dagster / Troubleshooting
url: /connectors/pipeline/dagster/troubleshooting
- category: Connectors / Pipeline / dbt Cloud
url: /connectors/pipeline/dbtcloud
- category: Connectors / Pipeline / dbt Cloud / Run Externally
url: /connectors/pipeline/dbtcloud/yaml
- category: Connectors / Pipeline / dbt Cloud / Troubleshooting
url: /connectors/pipeline/dbtcloud/troubleshooting
- category: Connectors / Pipeline / KafkaConnect
url: /connectors/pipeline/kafkaconnect
- category: Connectors / Pipeline / KafkaConnect / Run Externally
@ -602,6 +610,8 @@ site_menu:
url: /connectors/pipeline/databricks-pipeline
- category: Connectors / Pipeline / Databricks Pipeline / Run Externally
url: /connectors/pipeline/databricks-pipeline/yaml
- category: Connectors / Pipeline / Databricks Pipeline / Troubleshooting
url: /connectors/pipeline/databricks-pipeline/troubleshooting
- category: Connectors / Pipeline / Domo Pipeline
url: /connectors/pipeline/domo-pipeline
- category: Connectors / Pipeline / Domo Pipeline / Run Externally