133 Commits

Author SHA1 Message Date
Tamas Nemeth
642fb404ec
fix(ingest/spark): Fixing Micrometer warning (#10882) 2024-07-16 11:50:15 +02:00
david-leifker
5327f80cf7
feat(system): support conditional write semantics (#10868) 2024-07-11 10:52:58 -05:00
Tamas Nemeth
d204d5654a
fix(ingestion/spark): Platform instance and column level lineage fix (#10843)
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
2024-07-09 13:54:06 +02:00
david-leifker
581dc7ffe2
fix(jar): add missing custom-plugin-jar task (#10847) 2024-07-03 16:55:59 -05:00
Chris Collins
a7f4b71410
feat(SDK) Add java SDK for structuredProperty entity PATCH + CRUD examples (#10823) 2024-07-02 12:37:17 -04:00
Chris Collins
5e4a3afd7a
feat(forms) Add java SDK for form entity PATCH + CRUD examples (#10822) 2024-07-02 10:25:50 -04:00
Fully.is(풀리)
7fb56ef717
docs: hivePlatformAlias is different (#10765)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-07-01 11:53:18 +05:30
david-leifker
7abbab9797
chore(gradle): remove httpclient 4 references (#10787) 2024-06-27 16:48:10 -05:00
david-leifker
062785300b
feat(protobuf): disable binary protoc custom properties (#10778) 2024-06-25 14:29:07 -05:00
david-leifker
e1f85d789c
chore(lint): spotless apply (#10779) 2024-06-25 14:28:55 -05:00
Tamas Nemeth
567811353d
fix(spark):Add option to disable symlink resolution (#10767) 2024-06-24 21:41:09 +02:00
Tamas Nemeth
2d167dd087
feat(spark): Adding OpenLineage symlink support to Spark lineage (#10637) 2024-06-21 23:15:59 +02:00
david-leifker
bcb40d3d71
chore(security): updates for security vulnerabilities (#10740) 2024-06-18 11:28:39 -05:00
Andrew Sikowitz
46dbb10940
docs(ingest): Rename csv / s3 / file source and sink (#10675) 2024-06-11 11:44:13 -07:00
Tamas Nemeth
d78287cc57
fix(ingest/spark): Bumping OpenLineage version to 0.14.0 (#10559) 2024-05-29 22:58:55 +02:00
david-leifker
94af249251
build(jar): enable custom plugin lib (#10552) 2024-05-23 07:32:22 -05:00
david-leifker
6ed21bd1bc
feat(plugins): spring custom plugins (#10389)
Co-authored-by: Kevin Chun <kevinchun@netflix.com>
Co-authored-by: Kevin Chun <kevin1chun@gmail.com>
2024-05-09 14:56:03 -05:00
david-leifker
21e3f5416c
fix(patch): update json patch library (#10449) 2024-05-08 20:39:31 -05:00
Tamas Nemeth
d08f36f14b
feat(spark/openlineage): Use Openlineage 1.13.1 in Spark Plugin (#10433)
- Use Openlineage 1.13.1 in Spark Plugin
- Add retry option to datahub client and Spark Plugin
- Add OpenLineage integration doc
2024-05-07 11:15:46 +02:00
david-leifker
f9e64d03cc
feat(auth): view authorization (#10066) 2024-03-23 06:15:36 -05:00
david-leifker
03a677af93
chore(java): bump java dependency versions (#10009) 2024-03-07 14:15:22 -06:00
Tamas Nemeth
6eb5f80a9a
Openlineage endpoint and Spark Lineage Beta Plugin (#9870)
Co-authored-by: David Leifker <david.leifker@acryl.io>
2024-03-01 09:31:21 -06:00
RyanHolstien
ddf0b7d2cd
feat(patch): refactor cll patch (#9922)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-02-27 12:00:44 -06:00
david-leifker
ff0818bad7
fix(aspects): fix default aspect generation for non-restli locations (#9746) 2024-01-31 18:28:35 -06:00
david-leifker
d292b35f23
test(spark-lineage): minor tweaks (#9717) 2024-01-25 12:41:51 -06:00
david-leifker
264278861b
feat(build): support jdk8 spark lineage (#9697) 2024-01-23 17:49:23 -06:00
david-leifker
943bb57cbc
feat(backend): structured properties and forms (#9626)
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
Co-authored-by: RyanHolstien <RyanHolstien@users.noreply.github.com>
2024-01-22 11:46:04 -06:00
juhyun seo
6cb3dc839c
fix(protobuf): fix reseved field error in fields in nested messages (#9318) 2024-01-18 15:45:00 -06:00
RyanHolstien
7a788240c1
feat(spring): update spring to version 6 and spring boot to version 3 (#9567) 2024-01-11 13:44:06 -06:00
RyanHolstien
822d0eb014
feat(patch): add dashboardInfo and chartInfo support for patch (#9536) 2024-01-03 15:11:07 -06:00
Ellie O'Neil
92c9940bbd
Allow message_name field for protobuf ingestion (#9480) 2023-12-19 09:24:03 -08:00
david-leifker
824df5a6a3
feat(build): gradle 8, jdk17, neo4j 5 (#9458) 2023-12-15 13:28:33 -06:00
RyanHolstien
8a1122049c
feat(patch): support fine grained lineage patches (#9408)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-12-11 16:25:43 -06:00
Aseem Bansal
e14474176f
feat(lint): add spotless for java lint (#9373) 2023-12-06 11:02:42 +05:30
Hendrik Richert
966cb175f7
feat(dev): Make repositories configurable for enterprise developers (#9230)
Co-authored-by: Hendrik Richert <hendrik.richert@swisscom.com>
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-11-28 14:52:11 -06:00
sachinsaju
d6cb106fab
doc(java-sdk-example):example to create tag via java-sdk (#9151) 2023-11-09 12:40:55 -08:00
sachinsaju
5911a7b45e
docs(java-sdk-dataset): add dataset via java sdk example (#9136)
Co-authored-by: Hyejin Yoon <0327jane@gmail.com>
2023-11-09 12:24:53 -08:00
Jia (Jason) Teoh
7a31950f79
fix(datahub-client): Include relocation for snakeyaml dependency. (#8911)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-10-31 20:41:16 -05:00
Younghoon YUN
1c77bca0c6
fix(datahub-protobuf): add check if nested field is reserved (#9058) 2023-10-25 15:01:47 -05:00
Ellie O'Neil
75b36c41ee
docs(protobuf) Update messaging around nesting messages (#9048) 2023-10-19 10:32:24 -05:00
RyanHolstien
1b737243b2
feat(avro): upgrade avro to 1.11 (#9031) 2023-10-18 13:45:46 -05:00
david-leifker
21eb4dfc12
feat(search): update to support OpenSearch 2.x (#8852) 2023-09-21 13:01:55 -05:00
david-leifker
68ae3bfc26
fix(spark-test): upgrade gradle and fix spark smoke test (#8777) 2023-09-07 20:17:50 -05:00
david-leifker
56c00f5586
feat(openapi): entity endpoints & analytics raw (#8537) 2023-09-07 17:09:52 -05:00
John Joyce
94fa514700
feat(systemMetadata): Adding a lastRunId field system metadata (#8672)
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
Co-authored-by: Indy Prentice <iprentic@users.noreply.github.com>
2023-09-06 14:51:03 -03:00
david-leifker
7dd6e09ac5
refactor(build): upgrade to gradle 7 & guava update (#8745) 2023-09-01 19:36:01 +05:30
Aseem Bansal
9472636d08
fix(cleanup): cleanup of 1 sub-module (#8678) 2023-08-24 13:09:57 +05:30
Andrew Sikowitz
9cb62f30fd
docs(databricks/spark-lineage): Fix incorrect statement (#8423) 2023-07-17 14:14:39 +05:30
RyanHolstien
f78f7f9609
feat(patch): support datajob input output (#8190)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-06-14 22:21:16 -07:00
Jinlin Yang
166dc90896
Upgrade kafka and its dependencies to 3.4 in docker compose (#8161)
Co-authored-by: Pedro Silva <pedro@acryl.io>
2023-06-13 13:57:54 +01:00