# Pipeline

This schema defines the Pipeline entity. A pipeline enables the flow of data from source to destination through a series of processing steps. ETL is a type of pipeline where the series of steps Extract, Transform and Load the data.

**$id: **[**https://open-metadata.org/schema/entity/data/pipeline.json**](https://open-metadata.org/schema/entity/data/pipeline.json)

Type: `object`

## Properties

* **id** `required`
  * Unique identifier that identifies a pipeline instance.
  * $ref: [../../type/basic.json#/definitions/uuid](../types/basic.md#uuid)
* **name** `required`
  * Name that identifies this pipeline instance uniquely.
  * Type: `string`
  * Length: between 1 and 64
* **displayName**
  * Display Name that identifies this Pipeline. It could be title or label from the source services.
  * Type: `string`
* **fullyQualifiedName**
  * A unique name that identifies a pipeline in the format 'ServiceName.PipelineName'.
  * Type: `string`
  * Length: between 1 and 64
* **description**
  * Description of this Pipeline.
  * Type: `string`
* **version**
  * Metadata version of the entity.
  * $ref: [../../type/basic.json#/definitions/entityVersion](../types/basic.md#entityversion)
* **updatedAt**
  * Last update time corresponding to the new version of the entity.
  * $ref: [../../type/basic.json#/definitions/dateTime](../types/basic.md#datetime)
* **updatedBy**
  * User who made the update.
  * Type: `string`
* **pipelineUrl**
  * Pipeline URL to visit/manage. This URL points to respective pipeline service UI.
  * Type: `string`
  * String format must be a "uri"
* **concurrency**
  * Concurrency of the Pipeline.
  * Type: `integer`
* **pipelineLocation**
  * Pipeline Code Location.
  * Type: `string`
* **startDate**
  * Start date of the workflow.
  * $ref: [../../type/basic.json#/definitions/dateTime](../types/basic.md#datetime)
* **tasks**
  * All the tasks that are part of pipeline.
  * Type: `array`
    * **Items**
    * $ref: [../../type/entityReference.json](../types/entityreference.md)
* **followers**
  * Followers of this Pipeline.
  * $ref: [../../type/entityReference.json#/definitions/entityReferenceList](../types/entityreference.md#entityreferencelist)
* **tags**
  * Tags for this Pipeline.
  * Type: `array`
    * **Items**
    * $ref: [../../type/tagLabel.json](../types/taglabel.md)
* **href**
  * Link to the resource corresponding to this entity.
  * $ref: [../../type/basic.json#/definitions/href](../types/basic.md#href)
* **owner**
  * Owner of this pipeline.
  * $ref: [../../type/entityReference.json](../types/entityreference.md)
* **service** `required`
  * Link to service where this pipeline is hosted in.
  * $ref: [../../type/entityReference.json](../types/entityreference.md)

_This document was updated on: Monday, October 18, 2021_