mirror of
https://github.com/open-metadata/OpenMetadata.git
synced 2025-07-12 03:29:53 +00:00
69342d4783
* Updated generate_docs_schema * Updated generate_docs_schema * Updated generate_docs_schema * applied generate_docs_schema script * Revert the changes in this file --------- Co-authored-by: Tarun <tarun.p@deuexsolutions.com> Co-authored-by: Prajwal214 <167504578+Prajwal214@users.noreply.github.com>
2.6 KiB
2.6 KiB
| title | slug |
|---|---|
| storageServiceMetadataPipeline | /main-concepts/metadata-standard/schemas/metadataingestion/storageservicemetadatapipeline |
StorageServiceMetadataPipeline
StorageService Metadata Pipeline Configuration.
Properties
type: Pipeline type. Refer to #/definitions/storageMetadataConfigType. Default:"StorageMetadata".containerFilterPattern: Regex to only fetch containers that matches the pattern. Refer to ../type/filterPattern.json#/definitions/filterPattern.storageMetadataConfigSource- One of
- : Refer to #/definitions/noMetadataConfigurationSource.
- : Refer to ./storage/storageMetadataLocalConfig.json.
- : Refer to ./storage/storageMetadataHttpConfig.json.
- : Refer to ./storage/storageMetadataS3Config.json.
- : Refer to ./storage/storageMetadataADLSConfig.json.
- : Refer to ./storage/storageMetadataGCSConfig.json.
- One of
markDeletedContainers(boolean): Optional configuration to soft delete containers in OpenMetadata if the source containers are deleted. Also, if the topic is deleted, all the associated entities with that containers will be deleted. Default:true.overrideMetadata(boolean): Set the 'Override Metadata' toggle to control whether to override the existing metadata in the OpenMetadata server with the metadata fetched from the source. If the toggle is set to true, the metadata fetched from the source will override the existing metadata in the OpenMetadata server. If the toggle is set to false, the metadata fetched from the source will not override the existing metadata in the OpenMetadata server. This is applicable for fields like description, tags, owner and displayName. Default:false.includeTags(boolean): Optional configuration to toggle the tags ingestion. Default:false.
Definitions
storageMetadataConfigType(string): Object Store Source Config Metadata Pipeline type. Must be one of:["StorageMetadata"]. Default:"StorageMetadata".noMetadataConfigurationSource(object): No manifest file available. Ingestion would look for bucket-level metadata file instead. Cannot contain additional properties.
Documentation file automatically generated at 2025-01-15 09:05:25.266839+00:00.