20 Commits

Author SHA1 Message Date
danielli-ziprecruiter
a6470fc267
feat(ingestion): spark - support lineage for delta lake writes (#6834) 2022-12-22 12:13:32 +01:00
danielli-ziprecruiter
7ca21a8e7c
fix(ingest): prevent NullPointerException when non-jdbc SaveIntoDataSourceCommand (#6803) 2022-12-19 08:41:06 -08:00
Tamas Nemeth
ff3a9dd4b9
fix(spark-lineage): Rename table.platform to table.hive_platform_alias (#6311) 2022-10-28 16:59:17 -07:00
danielli-ziprecruiter
7b2a76dd4c
feat(spark-lineage): make platform for spark lineage inferred and configurable (#6251)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2022-10-27 21:59:18 +02:00
leifker
203a6ff57b
refactor(java11) - convert most modules to java 11 (#5836)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-09-25 08:39:22 -07:00
Tamas Nemeth
caec2ed235
fix(ingest): spark-lineage - Adding additional debug logs to spark lineage (#5772) 2022-09-04 22:43:03 -07:00
Mugdha Hardikar
fe0773278b
Create application setup on sqlevent start (#5657) 2022-08-17 16:02:37 +02:00
Mugdha Hardikar
d8b2350724
feat(spark-lineage, java-emitter): Support ssl cert disable verification functionality (#5488)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-07-26 18:06:03 -07:00
MugdhaHardikar-GSLab
ccf82229d5
feat(spark-lineage): coalesce spark jobs (#5077) 2022-06-03 16:32:22 +02:00
MugdhaHardikar-GSLab
1479c35bfd
fix(spark-lineage): remove need for sparksession.stop call (#4940)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-05-29 09:07:26 -07:00
MugdhaHardikar-GSLab
96ef7e55ae
feat(spark-lineage): support for persist API (#4980) 2022-05-23 20:53:57 +02:00
Tamas Nemeth
f075646048
Revert "feat(spark-lineage): add support for iceberg and cache based plans (#4882)" (#4945)
This reverts commit 46760a7f5e8a5368d20694ba570187f65d0a94af.
2022-05-19 09:40:15 +02:00
maggie-zhu
46760a7f5e
feat(spark-lineage): add support for iceberg and cache based plans (#4882)
Co-authored-by: magzhu <magzhu@cisco.com>
2022-05-16 09:29:00 -07:00
MugdhaHardikar-GSLab
a8a4d82d25
feat(spark-lineage): add support for custom env and platform_instance (#4208) 2022-03-14 10:48:27 -07:00
MugdhaHardikar-GSLab
a894424dc6
refactor(spark-lineage): enhance logging and documentation (#4113) 2022-02-18 12:54:26 -08:00
MugdhaHardikar-GSLab
05d4ef5e4d
refactor(spark-lineage): support better parsing of config for future features (#4042) 2022-02-03 09:54:11 -08:00
MugdhaHardikar-GSLab
4c33124e8f
fix(ci): spark-lineage - select mock server port dynamically for unit test (#4018) 2022-01-31 09:26:26 -08:00
Swaroop Jagadish
d23a5bb725
feat(spark-lineage): simplified jars, config, auto publish to maven (#3924) 2022-01-20 00:48:09 -08:00
Swaroop Jagadish
adce0dea39
fix(datahub-client): fix shadow jar build, correct spark-lineage url parsing (#3871) 2022-01-11 14:55:21 -08:00
Swaroop Jagadish
3e234a992c
feat(java-emitter): improvements to builder API-s, moving spark-lineage under metadata-integration/java (#3819) 2022-01-04 01:41:09 -08:00