yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-07-22 17:01:41 +00:00
Code Issues Packages Projects Releases Wiki Activity
OpenMetadata/openmetadata-docs/content/v1.1.0/main-concepts/metadata-standard/schemas/metadataIngestion/databaseServiceQueryLineagePipeline.md
Aniket Katkar cf2aafa770
changes in script to generate schemas documentation (#12325) 
* changes in script to generate schemas documentation

* generated schema doc changes

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2023-07-11 09:59:51 +02:00

1.4 KiB
Raw Blame History

title slug
databaseServiceQueryLineagePipeline /main-concepts/metadata-standard/schemas/metadataingestion/databaseservicequerylineagepipeline

DatabaseServiceQueryLineagePipeline

DatabaseService Query Lineage Pipeline Configuration.

Properties

  • type: Pipeline type. Refer to #/definitions/databaseLineageConfigType. Default: DatabaseLineage.
  • queryLogDuration (integer): Configuration to tune how far we want to look back in query logs to process lineage data. Default: 1.
  • queryLogFilePath (string): Configuration to set the file path for query logs.
  • resultLimit (integer): Configuration to set the limit for query logs. Default: 1000.
  • schemaFilterPattern: Regex to only fetch tables or databases that matches the pattern. Refer to ../type/filterPattern.json#/definitions/filterPattern.
  • tableFilterPattern: Regex exclude tables or databases that matches the pattern. Refer to ../type/filterPattern.json#/definitions/filterPattern.
  • databaseFilterPattern: Regex to only fetch databases that matches the pattern. Refer to ../type/filterPattern.json#/definitions/filterPattern.

Definitions

  • databaseLineageConfigType (string): Database Source Config Usage Pipeline type. Must be one of: ['DatabaseLineage']. Default: DatabaseLineage.

Documentation file automatically generated at 2023-07-07 05:50:35.981927.