From 01df6e872354ea7d3e8de1e1d41a42433262f365 Mon Sep 17 00:00:00 2001 From: =?UTF-8?q?Sergio=20G=C3=B3mez=20Villamor?= Date: Thu, 24 Jul 2025 12:13:08 +0200 Subject: [PATCH] docs(airflow): add missing config docs (#14200) --- docs/lineage/airflow.md | 32 +++++++++++++++++--------------- 1 file changed, 17 insertions(+), 15 deletions(-) diff --git a/docs/lineage/airflow.md b/docs/lineage/airflow.md index bd7a74dd35..9a745988a0 100644 --- a/docs/lineage/airflow.md +++ b/docs/lineage/airflow.md @@ -58,21 +58,23 @@ No additional configuration is required to use the plugin. However, there are so enabled = True # default ``` -| Name | Default value | Description | -| -------------------------- | -------------------- | ---------------------------------------------------------------------------------------- | -| enabled | true | If the plugin should be enabled. | -| conn_id | datahub_rest_default | The name of the datahub rest connection. | -| cluster | prod | name of the airflow cluster, this is equivalent to the `env` of the instance | -| capture_ownership_info | true | Extract DAG ownership. | -| capture_ownership_as_group | false | When extracting DAG ownership, treat DAG owner as a group rather than a user | -| capture_tags_info | true | Extract DAG tags. | -| capture_executions | true | Extract task runs and success/failure statuses. This will show up in DataHub "Runs" tab. | -| materialize_iolets | true | Create or un-soft-delete all entities referenced in lineage. | -| enable_extractors | true | Enable automatic lineage extraction. | -| disable_openlineage_plugin | true | Disable the OpenLineage plugin to avoid duplicative processing. | -| log_level | _no change_ | [debug] Set the log level for the plugin. | -| debug_emitter | false | [debug] If true, the plugin will log the emitted events. | -| enable_datajob_lineage | true | If true, the plugin will emit input/output lineage for DataJobs. | +| Name | Default value | Description | +| -------------------------- | -------------------- | ------------------------------------------------------------------------------------------------------------------- | +| enabled | true | If the plugin should be enabled. | +| conn_id | datahub_rest_default | The name of the datahub rest connection. | +| cluster | prod | name of the airflow cluster, this is equivalent to the `env` of the instance | +| platform_instance | | The instance of the platform that all assets produced by this plugin belong to. It is optional. | +| capture_ownership_info | true | Extract DAG ownership. | +| capture_ownership_as_group | false | When extracting DAG ownership, treat DAG owner as a group rather than a user | +| capture_tags_info | true | Extract DAG tags. | +| capture_executions | true | Extract task runs and success/failure statuses. This will show up in DataHub "Runs" tab. | +| materialize_iolets | true | Create or un-soft-delete all entities referenced in lineage. | +| render_templates | true | If true, jinja-templated fields will be automatically rendered to improve the accuracy of SQL statement extraction. | +| enable_extractors | true | Enable automatic lineage extraction. | +| disable_openlineage_plugin | true | Disable the OpenLineage plugin to avoid duplicative processing. | +| log_level | _no change_ | [debug] Set the log level for the plugin. | +| debug_emitter | false | [debug] If true, the plugin will log the emitted events. | +| enable_datajob_lineage | true | If true, the plugin will emit input/output lineage for DataJobs. | ## Automatic lineage extraction