parthp2107 edd43f30ab
updated the json schema doc and metadata-ingestion doc (#768)
Co-authored-by: Parth Panchal <parthpanchal@Parths-MacBook-Air.local>
2021-10-14 16:19:34 +05:30

2.2 KiB

Task

This schema defines the Task entity. A task is a unit of computation in a Pipeline.

id: https://open-metadata.org/schema/entity/data/task.json

Type: object

Properties

  • id required
  • name required
    • Name that identifies this task instance uniquely.
    • Type: string
    • Length: between 1 and 64
  • displayName
    • Display Name that identifies this Task. It could be title or label from the pipeline services.
    • Type: string
  • fullyQualifiedName
    • A unique name that identifies a pipeline in the format 'ServiceName.PipelineName.TaskName'.
    • Type: string
    • Length: between 1 and 64
  • description
    • Description of this Task.
    • Type: string
  • taskUrl
    • Task URL to visit/manage. This URL points to respective pipeline service UI.
    • Type: string
    • String format must be a "uri"
  • downstreamTasks
    • All the tasks that are downstream of this task.
    • Type: array
      • Items
      • Type: string
      • Length: between 1 and 64
  • taskType
    • Type of the Task. Usually refers to the class it implements.
    • Type: string
  • taskSQL
    • SQL used in the task. Can be used to determine the lineage.
    • Type: string
  • startDate
  • endDate
  • tags
  • href
  • owner
  • service required

This document was updated on: Thursday, October 14, 2021