yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-07-24 17:59:52 +00:00
Code Issues Packages Projects Releases Wiki Activity
OpenMetadata/openmetadata-docs/content/v1.6.x-SNAPSHOT/main-concepts/metadata-standard/schemas/metadataIngestion/dbtPipeline.md
Pere Miquel Brull 60ed221cf1
DOCS - Update Version Snapshots (#17589)
2024-08-27 14:41:12 +05:30

1.4 KiB
Raw Blame History

title slug
dbtPipeline /main-concepts/metadata-standard/schemas/metadataingestion/dbtpipeline

dbtPipeline

DBT Pipeline Configuration.

Properties

  • type: Pipeline type. Refer to #/definitions/dbtConfigType. Default: DBT.
  • dbtConfigSource: Available sources to fetch DBT catalog and manifest files.
  • dbtUpdateDescriptions (boolean): Optional configuration to update the description from DBT or not. Default: False.
  • includeTags (boolean): Optional configuration to toggle the tags ingestion. Default: True.
  • dbtClassificationName (string): Custom OpenMetadata Classification name for dbt tags. Default: dbtTags.
  • schemaFilterPattern: Regex to only fetch tables or databases that matches the pattern. Refer to ../type/filterPattern.json#/definitions/filterPattern.
  • tableFilterPattern: Regex exclude tables or databases that matches the pattern. Refer to ../type/filterPattern.json#/definitions/filterPattern.
  • parsingTimeoutLimit (integer): Configuration to set the timeout for parsing the query in seconds. Default: 300.
  • databaseFilterPattern: Regex to only fetch databases that matches the pattern. Refer to ../type/filterPattern.json#/definitions/filterPattern.

Definitions

  • dbtConfigType (string): DBT Config Pipeline type. Must be one of: ['DBT']. Default: DBT.

Documentation file automatically generated at 2023-10-27 13:55:46.343512.