OpenMetadata/docs/openmetadata-apis/schemas/entities/pipeline.md

Pipeline

This schema defines the Pipeline entity. A pipeline enables flow of data from source to destination through a series of processing steps. ETL is a type of pipeline where the series of steps Extract, Transform, and load the data.

$id: https://github.com/open-metadata/OpenMetadata/blob/main/catalog-rest-service/src/main/resources/json/schema/entity/data/pipeline.json

Type: object

Properties

• id required
  • Unique identifier that identifies a pipeline instance.
  • $ref: ../../type/basic.json#/definitions/uuid
• name required
  • Name that identifies this pipeline instance uniquely.
  • Type: string
  • Length: between 1 and 64
• fullyQualifiedName
  • A unique name that identifies a pipeline in the format 'ServiceName.PipelineName'.
  • Type: string
  • Length: between 1 and 64
• description
  • Description of this pipeline.
  • Type: string
• href
  • Link to the resource corresponding to this entity.
  • $ref: ../../type/basic.json#/definitions/href
• owner
  • Owner of this pipeline.
  • $ref: ../../type/entityReference.json
• service required
  • Link to service where this pipeline is hosted in.
  • $ref: ../../type/entityReference.json