parthp2107 a12c99f3ac
Doc update (#309)
* added updated documentation and formatted schema description

* added updated documentation and formatted schema description

* minor doc changes

Co-authored-by: parthp2107 <parth.panchal@deuexsoultions.com>
2021-08-26 13:33:44 +05:30

35 lines
1.4 KiB
Markdown

# Pipeline
This schema defines the Pipeline entity. A pipeline enables the flow of data from source to destination through a series of processing steps. ETL is a type of pipeline where the series of steps Extract, Transform and Load the data.
<b id="https/open-metadata.org/schema/entity/data/pipeline.json">&#36;id: https://open-metadata.org/schema/entity/data/pipeline.json</b>
Type: `object`
## Properties
- **id** `required`
- Unique identifier that identifies a pipeline instance.
- $ref: [../../type/basic.json#/definitions/uuid](../types/basic.md#uuid)
- **name** `required`
- Name that identifies this pipeline instance uniquely.
- Type: `string`
- Length: between 1 and 64
- **fullyQualifiedName**
- A unique name that identifies a pipeline in the format 'ServiceName.PipelineName'.
- Type: `string`
- Length: between 1 and 64
- **description**
- Description of this pipeline.
- Type: `string`
- **href**
- Link to the resource corresponding to this entity.
- $ref: [../../type/basic.json#/definitions/href](../types/basic.md#href)
- **owner**
- Owner of this pipeline.
- $ref: [../../type/entityReference.json](../types/entityreference.md)
- **service** `required`
- Link to service where this pipeline is hosted in.
- $ref: [../../type/entityReference.json](../types/entityreference.md)
_This document was updated on: Thursday, August 26, 2021_