2023-04-20 21:08:22 -07:00

1.4 KiB

Ingesting metadata from dbt requires either using the dbt module or the dbt-cloud module.

Concept Mapping

Source Concept DataHub Concept Notes
"dbt" Data Platform
dbt Source Dataset Subtype source
dbt Seed Dataset Subtype seed
dbt Model Dataset Subtype model
dbt Snapshot Dataset Subtype snapshot
dbt Test Assertion
dbt Test Result Assertion Run Result

Note:

  1. It also generates lineage between the dbt nodes (e.g. ephemeral nodes that depend on other dbt sources) as well as lineage between the dbt nodes and the underlying (target) platform nodes (e.g. BigQuery Table -> dbt Source, dbt View -> BigQuery View).
  2. We also support automated actions (like add a tag, term or owner) based on properties defined in dbt meta.