2021-10-12 14:28:29 +05:30
|
|
|
# Pipeline Service
|
|
|
|
|
|
|
|
|
|
This schema defines the Pipeline Service entity, such as Airflow and Prefect.
|
|
|
|
|
|
2021-11-29 21:15:30 +00:00
|
|
|
**$id:** [**https://open-metadata.org/schema/entity/services/messagingservice.json**](https://open-metadata.org/schema/entity/services/messagingservice.json)
|
2021-10-12 14:28:29 +05:30
|
|
|
|
|
|
|
|
Type: `object`
|
|
|
|
|
|
2021-12-09 18:19:32 +05:30
|
|
|
This schema <u>does not</u> accept additional properties.
|
|
|
|
|
|
2021-10-12 14:28:29 +05:30
|
|
|
## Properties
|
2022-01-25 22:19:15 +05:30
|
|
|
- **id** `required`
|
|
|
|
|
- Unique identifier of this pipeline service instance.
|
|
|
|
|
- $ref: [../../type/basic.json#/definitions/uuid](../types/basic.md#uuid)
|
|
|
|
|
- **name** `required`
|
|
|
|
|
- Name that identifies this pipeline service.
|
|
|
|
|
- Type: `string`
|
2022-03-08 09:23:53 +05:30
|
|
|
- The value must match this pattern: `^[^.]*$`
|
2022-01-25 22:19:15 +05:30
|
|
|
- Length: between 1 and 128
|
|
|
|
|
- **serviceType**
|
|
|
|
|
- Type of pipeline service such as Airflow or Prefect...
|
|
|
|
|
- $ref: [#/definitions/pipelineServiceType](#pipelineservicetype)
|
|
|
|
|
- **description**
|
|
|
|
|
- Description of a pipeline service instance.
|
|
|
|
|
- Type: `string`
|
|
|
|
|
- **displayName**
|
|
|
|
|
- Display Name that identifies this pipeline service. It could be title or label from the source services.
|
|
|
|
|
- Type: `string`
|
|
|
|
|
- **version**
|
|
|
|
|
- Metadata version of the entity.
|
|
|
|
|
- $ref: [../../type/entityHistory.json#/definitions/entityVersion](../types/entityhistory.md#entityversion)
|
|
|
|
|
- **updatedAt**
|
|
|
|
|
- Last update time corresponding to the new version of the entity in Unix epoch time milliseconds.
|
|
|
|
|
- $ref: [../../type/basic.json#/definitions/timestamp](../types/basic.md#timestamp)
|
|
|
|
|
- **updatedBy**
|
|
|
|
|
- User who made the update.
|
|
|
|
|
- Type: `string`
|
|
|
|
|
- **pipelineUrl** `required`
|
|
|
|
|
- Pipeline Service Management/UI URL.
|
|
|
|
|
- Type: `string`
|
|
|
|
|
- String format must be a "uri"
|
|
|
|
|
- **ingestionSchedule**
|
|
|
|
|
- Schedule for running metadata ingestion jobs.
|
|
|
|
|
- $ref: [../../type/schedule.json](../types/schedule.md)
|
2022-03-08 09:23:53 +05:30
|
|
|
- **owner**
|
|
|
|
|
- Owner of this pipeline service.
|
|
|
|
|
- $ref: [../../type/entityReference.json](../types/entityreference.md)
|
2022-01-25 22:19:15 +05:30
|
|
|
- **href**
|
|
|
|
|
- Link to the resource corresponding to this pipeline service.
|
|
|
|
|
- $ref: [../../type/basic.json#/definitions/href](../types/basic.md#href)
|
|
|
|
|
- **changeDescription**
|
|
|
|
|
- Change that lead to this version of the entity.
|
|
|
|
|
- $ref: [../../type/entityHistory.json#/definitions/changeDescription](../types/entityhistory.md#changedescription)
|
|
|
|
|
- **deleted**
|
|
|
|
|
- When `true` indicates the entity has been soft deleted.
|
|
|
|
|
- Type: `boolean`
|
|
|
|
|
- Default: _false_
|
2021-10-12 14:28:29 +05:30
|
|
|
|
|
|
|
|
|
|
|
|
|
## Type definitions in this schema
|
|
|
|
|
### pipelineServiceType
|
|
|
|
|
|
2022-01-25 22:19:15 +05:30
|
|
|
- Type of pipeline service - Airflow or Prefect.
|
|
|
|
|
- Type: `string`
|
|
|
|
|
- The value is restricted to the following:
|
|
|
|
|
1. _"Airflow"_
|
|
|
|
|
2. _"Prefect"_
|
|
|
|
|
3. _"Glue"_
|
2022-03-08 09:23:53 +05:30
|
|
|
4. _"Generic"_
|
2022-01-25 22:19:15 +05:30
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2021-11-13 23:03:20 +05:30
|
|
|
|
2022-03-10 12:55:35 +05:30
|
|
|
_This document was updated on: Wednesday, March 9, 2022_
|
