yujunjun/datahub
2
0
Fork 0
mirror of https://github.com/datahub-project/datahub.git synced 2025-10-31 18:59:23 +00:00
Code Issues Packages Projects Releases Wiki Activity
datahub/metadata-integration/java/openlineage-converter
History
Tamas Nemeth d08f36f14b
feat(spark/openlineage): Use Openlineage 1.13.1 in Spark Plugin (#10433) 
- Use Openlineage 1.13.1 in Spark Plugin
- Add retry option to datahub client and Spark Plugin
- Add OpenLineage integration doc
2024-05-07 11:15:46 +02:00
..
src
feat(spark/openlineage): Use Openlineage 1.13.1 in Spark Plugin (#10433)
2024-05-07 11:15:46 +02:00
build.gradle
Openlineage endpoint and Spark Lineage Beta Plugin (#9870)
2024-03-01 09:31:21 -06:00
README.md
Openlineage endpoint and Spark Lineage Beta Plugin (#9870)
2024-03-01 09:31:21 -06:00

README.md

Openlineage Converter

Overview

It converts arbitary Openlineage events to a DataHub Aspects.

Known Issues

  • Currently, it was tested only with Spark and Airflow events.
  • Due to Openlineage's stateless nature, it is possible not all the inputs or outputs captured.