2021-10-12 14:28:29 +05:30
|
|
|
# Pipeline Service
|
|
|
|
|
|
|
|
|
|
This schema defines the Pipeline Service entity, such as Airflow and Prefect.
|
|
|
|
|
|
2021-11-29 21:15:30 +00:00
|
|
|
**$id:** [**https://open-metadata.org/schema/entity/services/messagingservice.json**](https://open-metadata.org/schema/entity/services/messagingservice.json)
|
2021-10-12 14:28:29 +05:30
|
|
|
|
|
|
|
|
Type: `object`
|
|
|
|
|
|
2021-12-09 18:19:32 +05:30
|
|
|
This schema <u>does not</u> accept additional properties.
|
|
|
|
|
|
2021-10-12 14:28:29 +05:30
|
|
|
## Properties
|
2021-12-09 18:19:32 +05:30
|
|
|
- **id** `required`
|
|
|
|
|
- Unique identifier of this pipeline service instance.
|
|
|
|
|
- $ref: [../../type/basic.json#/definitions/uuid](../types/basic.md#uuid)
|
|
|
|
|
- **name** `required`
|
|
|
|
|
- Name that identifies this pipeline service.
|
|
|
|
|
- Type: `string`
|
|
|
|
|
- Length: between 1 and 128
|
|
|
|
|
- **serviceType**
|
|
|
|
|
- Type of pipeline service such as Airflow or Prefect...
|
|
|
|
|
- $ref: [#/definitions/pipelineServiceType](#pipelineservicetype)
|
|
|
|
|
- **description**
|
|
|
|
|
- Description of a pipeline service instance.
|
|
|
|
|
- Type: `string`
|
|
|
|
|
- **displayName**
|
|
|
|
|
- Display Name that identifies this pipeline service. It could be title or label from the source services.
|
|
|
|
|
- Type: `string`
|
|
|
|
|
- **version**
|
|
|
|
|
- Metadata version of the entity.
|
|
|
|
|
- $ref: [../../type/entityHistory.json#/definitions/entityVersion](../types/entityhistory.md#entityversion)
|
|
|
|
|
- **updatedAt**
|
|
|
|
|
- Last update time corresponding to the new version of the entity.
|
|
|
|
|
- $ref: [../../type/basic.json#/definitions/dateTime](../types/basic.md#datetime)
|
|
|
|
|
- **updatedBy**
|
|
|
|
|
- User who made the update.
|
|
|
|
|
- Type: `string`
|
|
|
|
|
- **pipelineUrl** `required`
|
|
|
|
|
- Pipeline Service Management/UI URL.
|
|
|
|
|
- Type: `string`
|
|
|
|
|
- String format must be a "uri"
|
|
|
|
|
- **ingestionSchedule**
|
|
|
|
|
- Schedule for running metadata ingestion jobs.
|
|
|
|
|
- $ref: [../../type/schedule.json](../types/schedule.md)
|
|
|
|
|
- **href**
|
|
|
|
|
- Link to the resource corresponding to this pipeline service.
|
|
|
|
|
- $ref: [../../type/basic.json#/definitions/href](../types/basic.md#href)
|
|
|
|
|
- **changeDescription**
|
|
|
|
|
- Change that lead to this version of the entity.
|
|
|
|
|
- $ref: [../../type/entityHistory.json#/definitions/changeDescription](../types/entityhistory.md#changedescription)
|
2021-10-12 14:28:29 +05:30
|
|
|
|
|
|
|
|
|
|
|
|
|
## Type definitions in this schema
|
2021-11-13 23:03:20 +05:30
|
|
|
|
2021-10-12 14:28:29 +05:30
|
|
|
### pipelineServiceType
|
|
|
|
|
|
2021-12-09 18:19:32 +05:30
|
|
|
- Type of pipeline service - Airflow or Prefect.
|
|
|
|
|
- Type: `string`
|
|
|
|
|
- The value is restricted to the following:
|
2021-11-13 23:03:20 +05:30
|
|
|
1. _"Airflow"_
|
|
|
|
|
2. _"Prefect"_
|
2021-11-15 21:35:54 +05:30
|
|
|
3. _"Glue"_
|
2021-11-13 23:03:20 +05:30
|
|
|
|
2021-12-14 15:26:34 +05:30
|
|
|
_This document was updated on: Tuesday, December 14, 2021_
|
