53 Commits

Author SHA1 Message Date
RyanHolstien
0728656fbf
feat(patch): initial support of json patch style semantics in MCPs (#5901)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-09-22 23:52:18 -07:00
Shirshanka Das
8e8fb51ce3
feat(cli): extend put command to support platform creation (#5990) 2022-09-20 11:52:22 -07:00
Shirshanka Das
41746690fd
feat(protobuf): support for custom platform, subtypes, misc improvements (#5973) 2022-09-18 18:04:47 -07:00
Shirshanka Das
083ab9bc0e
feat(jars): better jar versioning for datahub-client, spark-lineage and protobuf (#5883) 2022-09-08 23:36:15 -07:00
Shirshanka Das
fe30f54689
feat(datahub-protobuf): add support for shadow jar, publish (#5882) 2022-09-08 22:10:36 -07:00
Tamas Nemeth
caec2ed235
fix(ingest): spark-lineage - Adding additional debug logs to spark lineage (#5772) 2022-09-04 22:43:03 -07:00
Harshal Sheth
762bcbb168
chore(docker): make curl/wget commands quiet in docker (#5819) 2022-09-04 22:39:08 -07:00
Mugdha Hardikar
fe0773278b
Create application setup on sqlevent start (#5657) 2022-08-17 16:02:37 +02:00
Mugdha Hardikar
c7f477813c
feat(datahub-client): add java file emitter (#5578)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-08-07 07:21:44 -07:00
Mugdha Hardikar
d8b2350724
feat(spark-lineage, java-emitter): Support ssl cert disable verification functionality (#5488)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-07-26 18:06:03 -07:00
Tamas Nemeth
54ff4524dd
docs: spark-lineage - configuration details for Amazon EMR (#5459) 2022-07-21 08:57:26 -07:00
leifker
e9c943f3b9
fix(protobuf) Set undeprecated ownership type & fix case sentitive urn corpGroup (#5425) 2022-07-18 15:56:43 -07:00
Harshal Sheth
fdea718e38
build: improve comprehensiveness of gradle clean (#5003) 2022-07-15 15:38:32 +05:30
Mugdha Hardikar
369c65522c
fix(datahub-client): Fix kafka config issue (#5403) 2022-07-15 15:38:00 +05:30
Mugdha Hardikar
8358ea8e3e
feat(datahub-client): add java kafka emitter (#5074) 2022-06-20 17:32:57 -07:00
RyanHolstien
3be8afd72f
chore(guava): force version of guava in client jars per #5134 (#5153) 2022-06-14 13:46:00 -07:00
MugdhaHardikar-GSLab
ccf82229d5
feat(spark-lineage): coalesce spark jobs (#5077) 2022-06-03 16:32:22 +02:00
Shirshanka Das
eca310fb05
feat(ci): datahub-client - add workflow, fix build (#5052) 2022-05-31 22:40:31 -07:00
MugdhaHardikar-GSLab
1479c35bfd
fix(spark-lineage): remove need for sparksession.stop call (#4940)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-05-29 09:07:26 -07:00
MugdhaHardikar-GSLab
96ef7e55ae
feat(spark-lineage): support for persist API (#4980) 2022-05-23 20:53:57 +02:00
MugdhaHardikar-GSLab
fc8a8030e4
fix(datahub-client): support utf8 encoding (#4878)
fixes #4700
2022-05-20 10:45:53 -07:00
Tamas Nemeth
f075646048
Revert "feat(spark-lineage): add support for iceberg and cache based plans (#4882)" (#4945)
This reverts commit 46760a7f5e8a5368d20694ba570187f65d0a94af.
2022-05-19 09:40:15 +02:00
maggie-zhu
46760a7f5e
feat(spark-lineage): add support for iceberg and cache based plans (#4882)
Co-authored-by: magzhu <magzhu@cisco.com>
2022-05-16 09:29:00 -07:00
RyanHolstien
d70df06c21
chore(jetty): upgrade jetty to 9.4.46 for CVE (#4857) 2022-05-06 14:18:20 -07:00
RyanHolstien
f1151cb478
Revert "fix(jetty): upgrade jetty dependency for CVE (#4838)" (#4844)
This reverts commit 1697bd0641bac248a72ed289bbbcf17c20b2f5a4.
2022-05-05 20:01:50 -07:00
RyanHolstien
1697bd0641
fix(jetty): upgrade jetty dependency for CVE (#4838) 2022-05-05 18:01:02 -07:00
Ravindra Lanka
b479491769
chore(deps): upgrade dependency io.netty:netty-all to address vulnerability (#4840) 2022-05-05 16:39:06 -07:00
John Joyce
957ba0b5dd
refactor(deps): upgrade Jackson Databind to avoid CVE (#4822) 2022-05-04 23:09:29 -07:00
leifker
c22d52d1bc
feat(protobuf): adding deprecation support for datasets and fields (#4634) 2022-05-04 07:53:08 -07:00
RyanHolstien
23f657ed76
feat(platform): openapi - initial post, get, and delete endpoints for entities (#4775) 2022-05-03 17:38:05 -07:00
Shirshanka Das
a518e3d13e
feat(cli): improve error reporting, make sink config optional (#4718) 2022-04-24 17:12:21 -07:00
MugdhaHardikar-GSLab
9ecb785698
fix(datahub-client): avoid parallel execution of metadat-io:test (#4685) 2022-04-18 15:51:26 -07:00
leifker
aa05faad32
fix(protobuf) Fix test instability by deterministrically selecting field (#4612) 2022-04-07 13:35:44 -07:00
leifker
179fe07393
fix(protobuf) minor bugfixes for protobuf (#4553) 2022-04-04 17:52:09 -07:00
David Haglund
df9e07fda2
fix: replace direct and indirect references to linkedin with datahub-project (#4557)
* Update links for github-related links to use datahub-project:
  - https://github.com
  - https://img.shields.io/github/...
  - https://raw.githubusercontent.com/...
* Also replace references for github repo linkedin/datahub with
  datahub-project/datahub.
2022-04-04 14:39:30 -05:00
leifker
9cc6d8af32
feat(integration): protobuf - additional annotations and features (#4493) 2022-03-30 10:50:13 -07:00
Ethan Claassen
4476356ec8
fix: java dependency vulnerabilities (#4460)
* fix: java dependency vulnerabilities

* Upgrade org.hibernate:hibernate-validator (PLT-2)
2022-03-22 14:21:55 -07:00
Kevin Neville
d8e6f890a9
fix: Replace old repository link with new link (#4446) 2022-03-18 14:12:19 -07:00
leifker
628d818816
feat(protobuf): Gradle protobuf example project (#4432) 2022-03-17 10:43:03 -07:00
MugdhaHardikar-GSLab
a8a4d82d25
feat(spark-lineage): add support for custom env and platform_instance (#4208) 2022-03-14 10:48:27 -07:00
leifker
bb8f45bd20
feat(ingestion): add java protobuf schema ingestion (#4178)
Co-authored-by: leifker <david.leifker@landsend.com>
2022-03-11 10:13:00 -08:00
leifker
8bd1db8c1f
feat(build): upgrade to gradle 6 for toolchain to support java 11 (#4340) 2022-03-09 13:31:16 -08:00
MugdhaHardikar-GSLab
ede31c4177
feat(ci): add spark smoke test (#4158) 2022-02-22 19:33:21 -08:00
MugdhaHardikar-GSLab
a894424dc6
refactor(spark-lineage): enhance logging and documentation (#4113) 2022-02-18 12:54:26 -08:00
MugdhaHardikar-GSLab
05d4ef5e4d
refactor(spark-lineage): support better parsing of config for future features (#4042) 2022-02-03 09:54:11 -08:00
MugdhaHardikar-GSLab
4c33124e8f
fix(ci): spark-lineage - select mock server port dynamically for unit test (#4018) 2022-01-31 09:26:26 -08:00
Swaroop Jagadish
8dbde4bf0d
feat(build): remove requirement for git directory for builds (#3977) 2022-01-25 21:52:47 -08:00
Swaroop Jagadish
d23a5bb725
feat(spark-lineage): simplified jars, config, auto publish to maven (#3924) 2022-01-20 00:48:09 -08:00
Swaroop Jagadish
8b1b0fdb2a
fix(build): fix shadow jar checker to allow new git.properties (#3875) 2022-01-11 17:45:31 -08:00
Swaroop Jagadish
adce0dea39
fix(datahub-client): fix shadow jar build, correct spark-lineage url parsing (#3871) 2022-01-11 14:55:21 -08:00