2021-10-12 14:28:29 +05:30
|
|
|
# Pipeline Service
|
|
|
|
|
|
|
|
This schema defines the Pipeline Service entity, such as Airflow and Prefect.
|
|
|
|
|
2021-11-24 10:01:35 +05:30
|
|
|
**$id: **[**https://open-metadata.org/schema/entity/services/messagingservice.json**](https://open-metadata.org/schema/entity/services/messagingservice.json)
|
2021-10-12 14:28:29 +05:30
|
|
|
|
|
|
|
Type: `object`
|
|
|
|
|
|
|
|
## Properties
|
|
|
|
|
2021-11-24 10:01:35 +05:30
|
|
|
* **id** `required`
|
|
|
|
* Unique identifier of this pipeline service instance.
|
|
|
|
* $ref: [../../type/basic.json#/definitions/uuid](../types/basic.md#uuid)
|
|
|
|
* **name** `required`
|
|
|
|
* Name that identifies this pipeline service.
|
|
|
|
* Type: `string`
|
|
|
|
* Length: between 1 and 64
|
|
|
|
* **serviceType**
|
|
|
|
* Type of pipeline service such as Airflow or Prefect...
|
|
|
|
* $ref: [#/definitions/pipelineServiceType](pipelineservice.md#pipelineservicetype)
|
|
|
|
* **description**
|
|
|
|
* Description of a pipeline service instance.
|
|
|
|
* Type: `string`
|
|
|
|
* **displayName**
|
|
|
|
* Display Name that identifies this pipeline service. It could be title or label from the source services.
|
|
|
|
* Type: `string`
|
|
|
|
* **version**
|
|
|
|
* Metadata version of the entity.
|
|
|
|
* $ref: [../../type/entityHistory.json#/definitions/entityVersion](../types/entityhistory.md#entityversion)
|
|
|
|
* **updatedAt**
|
|
|
|
* Last update time corresponding to the new version of the entity.
|
|
|
|
* $ref: [../../type/basic.json#/definitions/dateTime](../types/basic.md#datetime)
|
|
|
|
* **updatedBy**
|
|
|
|
* User who made the update.
|
|
|
|
* Type: `string`
|
|
|
|
* **pipelineUrl** `required`
|
|
|
|
* Pipeline Service Management/UI URL.
|
|
|
|
* Type: `string`
|
|
|
|
* String format must be a "uri"
|
|
|
|
* **ingestionSchedule**
|
|
|
|
* Schedule for running metadata ingestion jobs.
|
|
|
|
* $ref: [../../type/schedule.json](../types/schedule.md)
|
|
|
|
* **href**
|
|
|
|
* Link to the resource corresponding to this pipeline service.
|
|
|
|
* $ref: [../../type/basic.json#/definitions/href](../types/basic.md#href)
|
|
|
|
* **changeDescription**
|
|
|
|
* Change that lead to this version of the entity.
|
|
|
|
* $ref: [../../type/entityHistory.json#/definitions/changeDescription](../types/entityhistory.md#changedescription)
|
2021-10-12 14:28:29 +05:30
|
|
|
|
|
|
|
## Type definitions in this schema
|
2021-11-13 23:03:20 +05:30
|
|
|
|
2021-10-12 14:28:29 +05:30
|
|
|
### pipelineServiceType
|
|
|
|
|
2021-11-24 10:01:35 +05:30
|
|
|
* Type of pipeline service - Airflow or Prefect.
|
|
|
|
* Type: `string`
|
|
|
|
* The value is restricted to the following:
|
2021-11-13 23:03:20 +05:30
|
|
|
1. _"Airflow"_
|
|
|
|
2. _"Prefect"_
|
2021-11-15 21:35:54 +05:30
|
|
|
3. _"Glue"_
|
2021-11-13 23:03:20 +05:30
|
|
|
|
2021-11-24 10:01:35 +05:30
|
|
|
_This document was updated on: Monday, November 15, 2021_
|