Docs: Lineage Addition till Impala (#19227)

This commit is contained in:
RounakDhillon 2025-01-06 10:17:50 +05:30 committed by GitHub
parent 38a970b829
commit ec43812a8c
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
16 changed files with 28 additions and 8 deletions

View File

@ -17,6 +17,7 @@ Configure and schedule Druid metadata and profiler workflows from the OpenMetada
- [Metadata Ingestion](#metadata-ingestion) - [Metadata Ingestion](#metadata-ingestion)
- [Data Profiler](/how-to-guides/data-quality-observability/profiler/workflow) - [Data Profiler](/how-to-guides/data-quality-observability/profiler/workflow)
- [Lineage](/how-to-guides/data-lineage/workflow)
- [Data Quality](/how-to-guides/data-quality-observability/quality) - [Data Quality](/how-to-guides/data-quality-observability/quality)
- [dbt Integration](/connectors/ingestion/workflows/dbt) - [dbt Integration](/connectors/ingestion/workflows/dbt)

View File

@ -18,6 +18,7 @@ Configure and schedule Druid metadata and profiler workflows from the OpenMetada
- [Requirements](#requirements) - [Requirements](#requirements)
- [Metadata Ingestion](#metadata-ingestion) - [Metadata Ingestion](#metadata-ingestion)
- [Data Profiler](#data-profiler) - [Data Profiler](#data-profiler)
- [Lineage](#lineage)
- [Data Quality](#data-quality) - [Data Quality](#data-quality)
- [dbt Integration](#dbt-integration) - [dbt Integration](#dbt-integration)
@ -140,6 +141,8 @@ source:
{% partial file="/v1.6/connectors/yaml/database/source-config.md" /%} {% partial file="/v1.6/connectors/yaml/database/source-config.md" /%}
{% partial file="/v1.6/connectors/yaml/lineage.md" variables={connector: "druid"} /%}
{% partial file="/v1.6/connectors/yaml/ingestion-sink.md" /%} {% partial file="/v1.6/connectors/yaml/ingestion-sink.md" /%}
{% partial file="/v1.6/connectors/yaml/workflow-config.md" /%} {% partial file="/v1.6/connectors/yaml/workflow-config.md" /%}

View File

@ -20,7 +20,7 @@ Configure and schedule Greenplum metadata and profiler workflows from the OpenMe
- [Query Usage](/connectors/ingestion/workflows/usage) - [Query Usage](/connectors/ingestion/workflows/usage)
- [Data Profiler](/how-to-guides/data-quality-observability/profiler/workflow) - [Data Profiler](/how-to-guides/data-quality-observability/profiler/workflow)
- [Data Quality](/how-to-guides/data-quality-observability/quality) - [Data Quality](/how-to-guides/data-quality-observability/quality)
- [Lineage](/connectors/ingestion/lineage) - [Lineage](/how-to-guides/data-lineage/workflow)
- [dbt Integration](/connectors/ingestion/workflows/dbt) - [dbt Integration](/connectors/ingestion/workflows/dbt)
- [Enable Security](#securing-greenplum-connection-with-ssl-in-openmetadata) - [Enable Security](#securing-greenplum-connection-with-ssl-in-openmetadata)

View File

@ -287,9 +287,7 @@ For IAM authentication, it is recommended to select the `allow` mode or another
caCertificate: "/path/to/ca/certificate" caCertificate: "/path/to/ca/certificate"
``` ```
## Lineage {% partial file="/v1.6/connectors/yaml/lineage.md" variables={connector: "greenplum"} /%}
You can learn more about how to ingest lineage [here](/connectors/ingestion/workflows/lineage).
## dbt Integration ## dbt Integration

View File

@ -18,6 +18,7 @@ Configure and schedule Hive metadata and profiler workflows from the OpenMetadat
- [Requirements](#requirements) - [Requirements](#requirements)
- [Metadata Ingestion](#metadata-ingestion) - [Metadata Ingestion](#metadata-ingestion)
- [Data Profiler](/how-to-guides/data-quality-observability/profiler/workflow) - [Data Profiler](/how-to-guides/data-quality-observability/profiler/workflow)
- [Lineage](/how-to-guides/data-lineage/workflow)
- [Data Quality](/how-to-guides/data-quality-observability/quality) - [Data Quality](/how-to-guides/data-quality-observability/quality)
- [dbt Integration](/connectors/ingestion/workflows/dbt) - [dbt Integration](/connectors/ingestion/workflows/dbt)
- [Enable Security](#securing-hive-connection-with-ssl-in-openmetadata) - [Enable Security](#securing-hive-connection-with-ssl-in-openmetadata)

View File

@ -17,6 +17,7 @@ Configure and schedule Hive metadata and profiler workflows from the OpenMetadat
- [Requirements](#requirements) - [Requirements](#requirements)
- [Metadata Ingestion](#metadata-ingestion) - [Metadata Ingestion](#metadata-ingestion)
- [Data Profiler](#data-profiler) - [Data Profiler](#data-profiler)
- [Lineage](#lineage)
- [Data Quality](#data-quality) - [Data Quality](#data-quality)
- [dbt Integration](#dbt-integration) - [dbt Integration](#dbt-integration)
- [Enable Security](#securing-hive-connection-with-ssl-in-openmetadata) - [Enable Security](#securing-hive-connection-with-ssl-in-openmetadata)
@ -113,6 +114,8 @@ You can also ingest the metadata using Postgres metastore. This step is optional
{% partial file="/v1.6/connectors/yaml/ingestion-sink-def.md" /%} {% partial file="/v1.6/connectors/yaml/ingestion-sink-def.md" /%}
{% partial file="/v1.6/connectors/yaml/lineage.md" variables={connector: "hive"} /%}
{% partial file="/v1.6/connectors/yaml/workflow-config-def.md" /%} {% partial file="/v1.6/connectors/yaml/workflow-config-def.md" /%}
#### Advanced Configuration #### Advanced Configuration

View File

@ -16,6 +16,7 @@ In this section, we provide guides and references to use the Impala connector.
Configure and schedule Impala metadata and profiler workflows from the OpenMetadata UI: Configure and schedule Impala metadata and profiler workflows from the OpenMetadata UI:
- [Metadata Ingestion](#metadata-ingestion) - [Metadata Ingestion](#metadata-ingestion)
- [Data Profiler](/how-to-guides/data-quality-observability/profiler/workflow) - [Data Profiler](/how-to-guides/data-quality-observability/profiler/workflow)
- [Lineage](/how-to-guides/data-lineage/workflow)
- [Data Quality](/how-to-guides/data-quality-observability/quality) - [Data Quality](/how-to-guides/data-quality-observability/quality)
- [dbt Integration](/connectors/ingestion/workflows/dbt) - [dbt Integration](/connectors/ingestion/workflows/dbt)
- [Enable Security](#securing-impala-connection-with-ssl-in-openmetadata) - [Enable Security](#securing-impala-connection-with-ssl-in-openmetadata)

View File

@ -17,6 +17,7 @@ Configure and schedule Impala metadata and profiler workflows from the OpenMetad
- [Requirements](#requirements) - [Requirements](#requirements)
- [Metadata Ingestion](#metadata-ingestion) - [Metadata Ingestion](#metadata-ingestion)
- [Data Profiler](#data-profiler) - [Data Profiler](#data-profiler)
- [Lineage](#lineage)
- [Data Quality](#data-quality) - [Data Quality](#data-quality)
- [dbt Integration](#dbt-integration) - [dbt Integration](#dbt-integration)
- [Enable Security](#securing-impala-connection-with-ssl-in-openmetadata) - [Enable Security](#securing-impala-connection-with-ssl-in-openmetadata)
@ -94,6 +95,8 @@ This is a sample config for Hive:
{% partial file="/v1.6/connectors/yaml/database/source-config-def.md" /%} {% partial file="/v1.6/connectors/yaml/database/source-config-def.md" /%}
{% partial file="/v1.6/connectors/yaml/lineage.md" variables={connector: "impala"} /%}
{% partial file="/v1.6/connectors/yaml/ingestion-sink-def.md" /%} {% partial file="/v1.6/connectors/yaml/ingestion-sink-def.md" /%}
{% partial file="/v1.6/connectors/yaml/workflow-config-def.md" /%} {% partial file="/v1.6/connectors/yaml/workflow-config-def.md" /%}

View File

@ -17,6 +17,7 @@ Configure and schedule Druid metadata and profiler workflows from the OpenMetada
- [Metadata Ingestion](#metadata-ingestion) - [Metadata Ingestion](#metadata-ingestion)
- [Data Profiler](/how-to-guides/data-quality-observability/profiler/workflow) - [Data Profiler](/how-to-guides/data-quality-observability/profiler/workflow)
- [Lineage](/how-to-guides/data-lineage/workflow)
- [Data Quality](/how-to-guides/data-quality-observability/quality) - [Data Quality](/how-to-guides/data-quality-observability/quality)
- [dbt Integration](/connectors/ingestion/workflows/dbt) - [dbt Integration](/connectors/ingestion/workflows/dbt)

View File

@ -18,6 +18,7 @@ Configure and schedule Druid metadata and profiler workflows from the OpenMetada
- [Requirements](#requirements) - [Requirements](#requirements)
- [Metadata Ingestion](#metadata-ingestion) - [Metadata Ingestion](#metadata-ingestion)
- [Data Profiler](#data-profiler) - [Data Profiler](#data-profiler)
- [Lineage](#lineage)
- [Data Quality](#data-quality) - [Data Quality](#data-quality)
- [dbt Integration](#dbt-integration) - [dbt Integration](#dbt-integration)
@ -84,6 +85,8 @@ This is a sample config for Druid:
{% partial file="/v1.7/connectors/yaml/database/source-config-def.md" /%} {% partial file="/v1.7/connectors/yaml/database/source-config-def.md" /%}
{% partial file="/v1.6/connectors/yaml/lineage.md" variables={connector: "druid"} /%}
{% partial file="/v1.7/connectors/yaml/ingestion-sink-def.md" /%} {% partial file="/v1.7/connectors/yaml/ingestion-sink-def.md" /%}
{% partial file="/v1.7/connectors/yaml/workflow-config-def.md" /%} {% partial file="/v1.7/connectors/yaml/workflow-config-def.md" /%}

View File

@ -20,7 +20,7 @@ Configure and schedule Greenplum metadata and profiler workflows from the OpenMe
- [Query Usage](/connectors/ingestion/workflows/usage) - [Query Usage](/connectors/ingestion/workflows/usage)
- [Data Profiler](/how-to-guides/data-quality-observability/profiler/workflow) - [Data Profiler](/how-to-guides/data-quality-observability/profiler/workflow)
- [Data Quality](/how-to-guides/data-quality-observability/quality) - [Data Quality](/how-to-guides/data-quality-observability/quality)
- [Lineage](/connectors/ingestion/lineage) - [Lineage](/how-to-guides/data-lineage/workflow)
- [dbt Integration](/connectors/ingestion/workflows/dbt) - [dbt Integration](/connectors/ingestion/workflows/dbt)
- [Enable Security](#securing-greenplum-connection-with-ssl-in-openmetadata) - [Enable Security](#securing-greenplum-connection-with-ssl-in-openmetadata)

View File

@ -287,9 +287,7 @@ For IAM authentication, it is recommended to select the `allow` mode or another
caCertificate: "/path/to/ca/certificate" caCertificate: "/path/to/ca/certificate"
``` ```
## Lineage {% partial file="/v1.7/connectors/yaml/lineage.md" variables={connector: "greenplum"} /%}
You can learn more about how to ingest lineage [here](/connectors/ingestion/workflows/lineage).
## dbt Integration ## dbt Integration

View File

@ -18,6 +18,7 @@ Configure and schedule Hive metadata and profiler workflows from the OpenMetadat
- [Requirements](#requirements) - [Requirements](#requirements)
- [Metadata Ingestion](#metadata-ingestion) - [Metadata Ingestion](#metadata-ingestion)
- [Data Profiler](/how-to-guides/data-quality-observability/profiler/workflow) - [Data Profiler](/how-to-guides/data-quality-observability/profiler/workflow)
- [Lineage](/how-to-guides/data-lineage/workflow)
- [Data Quality](/how-to-guides/data-quality-observability/quality) - [Data Quality](/how-to-guides/data-quality-observability/quality)
- [dbt Integration](/connectors/ingestion/workflows/dbt) - [dbt Integration](/connectors/ingestion/workflows/dbt)
- [Enable Security](#securing-hive-connection-with-ssl-in-openmetadata) - [Enable Security](#securing-hive-connection-with-ssl-in-openmetadata)

View File

@ -17,6 +17,7 @@ Configure and schedule Hive metadata and profiler workflows from the OpenMetadat
- [Requirements](#requirements) - [Requirements](#requirements)
- [Metadata Ingestion](#metadata-ingestion) - [Metadata Ingestion](#metadata-ingestion)
- [Data Profiler](#data-profiler) - [Data Profiler](#data-profiler)
- [Lineage](#lineage)
- [Data Quality](#data-quality) - [Data Quality](#data-quality)
- [dbt Integration](#dbt-integration) - [dbt Integration](#dbt-integration)
- [Enable Security](#securing-hive-connection-with-ssl-in-openmetadata) - [Enable Security](#securing-hive-connection-with-ssl-in-openmetadata)
@ -113,6 +114,8 @@ You can also ingest the metadata using Postgres metastore. This step is optional
{% partial file="/v1.7/connectors/yaml/ingestion-sink-def.md" /%} {% partial file="/v1.7/connectors/yaml/ingestion-sink-def.md" /%}
{% partial file="/v1.7/connectors/yaml/lineage.md" variables={connector: "hive"} /%}
{% partial file="/v1.7/connectors/yaml/workflow-config-def.md" /%} {% partial file="/v1.7/connectors/yaml/workflow-config-def.md" /%}
#### Advanced Configuration #### Advanced Configuration

View File

@ -16,6 +16,7 @@ In this section, we provide guides and references to use the Impala connector.
Configure and schedule Impala metadata and profiler workflows from the OpenMetadata UI: Configure and schedule Impala metadata and profiler workflows from the OpenMetadata UI:
- [Metadata Ingestion](#metadata-ingestion) - [Metadata Ingestion](#metadata-ingestion)
- [Data Profiler](/how-to-guides/data-quality-observability/profiler/workflow) - [Data Profiler](/how-to-guides/data-quality-observability/profiler/workflow)
- [Lineage](/how-to-guides/data-lineage/workflow)
- [Data Quality](/how-to-guides/data-quality-observability/quality) - [Data Quality](/how-to-guides/data-quality-observability/quality)
- [dbt Integration](/connectors/ingestion/workflows/dbt) - [dbt Integration](/connectors/ingestion/workflows/dbt)
- [Enable Security](#securing-impala-connection-with-ssl-in-openmetadata) - [Enable Security](#securing-impala-connection-with-ssl-in-openmetadata)

View File

@ -17,6 +17,7 @@ Configure and schedule Impala metadata and profiler workflows from the OpenMetad
- [Requirements](#requirements) - [Requirements](#requirements)
- [Metadata Ingestion](#metadata-ingestion) - [Metadata Ingestion](#metadata-ingestion)
- [Data Profiler](#data-profiler) - [Data Profiler](#data-profiler)
- [Lineage](#lineage)
- [Data Quality](#data-quality) - [Data Quality](#data-quality)
- [dbt Integration](#dbt-integration) - [dbt Integration](#dbt-integration)
- [Enable Security](#securing-impala-connection-with-ssl-in-openmetadata) - [Enable Security](#securing-impala-connection-with-ssl-in-openmetadata)
@ -94,6 +95,8 @@ This is a sample config for Hive:
{% partial file="/v1.7/connectors/yaml/database/source-config-def.md" /%} {% partial file="/v1.7/connectors/yaml/database/source-config-def.md" /%}
{% partial file="/v1.7/connectors/yaml/lineage.md" variables={connector: "impala"} /%}
{% partial file="/v1.7/connectors/yaml/ingestion-sink-def.md" /%} {% partial file="/v1.7/connectors/yaml/ingestion-sink-def.md" /%}
{% partial file="/v1.7/connectors/yaml/workflow-config-def.md" /%} {% partial file="/v1.7/connectors/yaml/workflow-config-def.md" /%}