yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-10-26 16:22:09 +00:00
Code Issues Packages Projects Releases Wiki Activity
OpenMetadata/openmetadata-docs/content/v1.7.x-SNAPSHOT/main-concepts/metadata-standard/schemas/metadataIngestion/dbtPipeline.md
tarunpandey23 69342d4783
Feat: update generate docs schema (#19372) 
* Updated generate_docs_schema

* Updated generate_docs_schema

* Updated generate_docs_schema

* applied generate_docs_schema script

* Revert the changes in this file

---------

Co-authored-by: Tarun <tarun.p@deuexsolutions.com>
Co-authored-by: Prajwal214 <167504578+Prajwal214@users.noreply.github.com>
2025-01-15 17:46:55 +05:30

1.7 KiB
Raw Blame History

title slug
dbtPipeline /main-concepts/metadata-standard/schemas/metadataingestion/dbtpipeline

dbtPipeline

DBT Pipeline Configuration.

Properties

  • type: Pipeline type. Refer to #/definitions/dbtConfigType. Default: DBT.
  • dbtConfigSource: Available sources to fetch DBT catalog and manifest files.
  • searchAcrossDatabases (boolean): Optional configuration to search across databases for tables or not. Default: False.
  • dbtUpdateDescriptions (boolean): Optional configuration to update the description from DBT or not. Default: False.
  • dbtUpdateOwners (boolean): Optional configuration to update the owners from DBT or not. Default: False.
  • includeTags (boolean): Optional configuration to toggle the tags ingestion. Default: True.
  • dbtClassificationName (string): Custom OpenMetadata Classification name for dbt tags. Default: dbtTags.
  • schemaFilterPattern: Regex to only fetch tables or databases that matches the pattern. Refer to ../type/filterPattern.json#/definitions/filterPattern.
  • tableFilterPattern: Regex exclude tables or databases that matches the pattern. Refer to ../type/filterPattern.json#/definitions/filterPattern.
  • parsingTimeoutLimit (integer): Configuration to set the timeout for parsing the query in seconds. Default: 300.
  • databaseFilterPattern: Regex to only fetch databases that matches the pattern. Refer to ../type/filterPattern.json#/definitions/filterPattern.

Definitions

  • dbtConfigType (string): DBT Config Pipeline type. Must be one of: ['DBT']. Default: DBT.

Documentation file automatically generated at 2025-01-15 09:05:41.923720+00:00.