yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-10-31 02:29:03 +00:00
Code Issues Packages Projects Releases Wiki Activity
OpenMetadata/openmetadata-docs/content/v1.1.1/main-concepts/metadata-standard/schemas/metadataIngestion/databaseServiceQueryLineagePipeline.md

1.4 KiB
Raw Blame History

title slug
databaseServiceQueryLineagePipeline /main-concepts/metadata-standard/schemas/metadataingestion/databaseservicequerylineagepipeline

DatabaseServiceQueryLineagePipeline

DatabaseService Query Lineage Pipeline Configuration.

Properties

  • type: Pipeline type. Refer to #/definitions/databaseLineageConfigType. Default: DatabaseLineage.
  • queryLogDuration (integer): Configuration to tune how far we want to look back in query logs to process lineage data. Default: 1.
  • queryLogFilePath (string): Configuration to set the file path for query logs.
  • resultLimit (integer): Configuration to set the limit for query logs. Default: 1000.
  • schemaFilterPattern: Regex to only fetch tables or databases that matches the pattern. Refer to ../type/filterPattern.json#/definitions/filterPattern.
  • tableFilterPattern: Regex exclude tables or databases that matches the pattern. Refer to ../type/filterPattern.json#/definitions/filterPattern.
  • databaseFilterPattern: Regex to only fetch databases that match the pattern. Refer to ../type/filterPattern.json#/definitions/filterPattern.

Definitions

  • databaseLineageConfigType (string): Database Source Config Usage Pipeline type. Must be one of: ['DatabaseLineage']. Default: DatabaseLineage.

Documentation file automatically generated at 2023-07-07 05:50:35.981927.