Tamas Nemeth 6eb5f80a9a
Openlineage endpoint and Spark Lineage Beta Plugin (#9870)
Co-authored-by: David Leifker <david.leifker@acryl.io>
2024-03-01 09:31:21 -06:00
..

Openlineage Converter

Overview

It converts arbitary Openlineage events to a DataHub Aspects.

Known Issues

  • Currently, it was tested only with Spark and Airflow events.
  • Due to Openlineage's stateless nature, it is possible not all the inputs or outputs captured.