67 Commits

Author SHA1 Message Date
david-leifker
db49067111
build(misc): misc build, config, version updates (#11527) 2024-10-03 21:10:26 -05:00
Raj Tekal
090e760d2d
fix(emitter): fix typo in get method of java kafka emitter (#11007) 2024-08-06 12:50:00 -07:00
Tamas Nemeth
f4fb89e799
feat(ingest/spark): Promote beta plugin (#10881)
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
2024-07-25 14:46:32 +02:00
deepgarg-visa
aa97cba3e8
fix(spark-lineage): default timeout for future responses (#10947) 2024-07-22 10:07:37 +02:00
david-leifker
5327f80cf7
feat(system): support conditional write semantics (#10868) 2024-07-11 10:52:58 -05:00
Chris Collins
a7f4b71410
feat(SDK) Add java SDK for structuredProperty entity PATCH + CRUD examples (#10823) 2024-07-02 12:37:17 -04:00
Chris Collins
5e4a3afd7a
feat(forms) Add java SDK for form entity PATCH + CRUD examples (#10822) 2024-07-02 10:25:50 -04:00
Tamas Nemeth
2d167dd087
feat(spark): Adding OpenLineage symlink support to Spark lineage (#10637) 2024-06-21 23:15:59 +02:00
david-leifker
bcb40d3d71
chore(security): updates for security vulnerabilities (#10740) 2024-06-18 11:28:39 -05:00
david-leifker
21e3f5416c
fix(patch): update json patch library (#10449) 2024-05-08 20:39:31 -05:00
Tamas Nemeth
d08f36f14b
feat(spark/openlineage): Use Openlineage 1.13.1 in Spark Plugin (#10433)
- Use Openlineage 1.13.1 in Spark Plugin
- Add retry option to datahub client and Spark Plugin
- Add OpenLineage integration doc
2024-05-07 11:15:46 +02:00
david-leifker
f9e64d03cc
feat(auth): view authorization (#10066) 2024-03-23 06:15:36 -05:00
Tamas Nemeth
6eb5f80a9a
Openlineage endpoint and Spark Lineage Beta Plugin (#9870)
Co-authored-by: David Leifker <david.leifker@acryl.io>
2024-03-01 09:31:21 -06:00
RyanHolstien
ddf0b7d2cd
feat(patch): refactor cll patch (#9922)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-02-27 12:00:44 -06:00
david-leifker
264278861b
feat(build): support jdk8 spark lineage (#9697) 2024-01-23 17:49:23 -06:00
david-leifker
943bb57cbc
feat(backend): structured properties and forms (#9626)
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
Co-authored-by: RyanHolstien <RyanHolstien@users.noreply.github.com>
2024-01-22 11:46:04 -06:00
RyanHolstien
7a788240c1
feat(spring): update spring to version 6 and spring boot to version 3 (#9567) 2024-01-11 13:44:06 -06:00
RyanHolstien
822d0eb014
feat(patch): add dashboardInfo and chartInfo support for patch (#9536) 2024-01-03 15:11:07 -06:00
david-leifker
824df5a6a3
feat(build): gradle 8, jdk17, neo4j 5 (#9458) 2023-12-15 13:28:33 -06:00
RyanHolstien
8a1122049c
feat(patch): support fine grained lineage patches (#9408)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-12-11 16:25:43 -06:00
Aseem Bansal
e14474176f
feat(lint): add spotless for java lint (#9373) 2023-12-06 11:02:42 +05:30
Jia (Jason) Teoh
7a31950f79
fix(datahub-client): Include relocation for snakeyaml dependency. (#8911)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-10-31 20:41:16 -05:00
RyanHolstien
1b737243b2
feat(avro): upgrade avro to 1.11 (#9031) 2023-10-18 13:45:46 -05:00
david-leifker
21eb4dfc12
feat(search): update to support OpenSearch 2.x (#8852) 2023-09-21 13:01:55 -05:00
david-leifker
56c00f5586
feat(openapi): entity endpoints & analytics raw (#8537) 2023-09-07 17:09:52 -05:00
John Joyce
94fa514700
feat(systemMetadata): Adding a lastRunId field system metadata (#8672)
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
Co-authored-by: Indy Prentice <iprentic@users.noreply.github.com>
2023-09-06 14:51:03 -03:00
david-leifker
7dd6e09ac5
refactor(build): upgrade to gradle 7 & guava update (#8745) 2023-09-01 19:36:01 +05:30
Aseem Bansal
9472636d08
fix(cleanup): cleanup of 1 sub-module (#8678) 2023-08-24 13:09:57 +05:30
RyanHolstien
f78f7f9609
feat(patch): support datajob input output (#8190)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-06-14 22:21:16 -07:00
Jinlin Yang
166dc90896
Upgrade kafka and its dependencies to 3.4 in docker compose (#8161)
Co-authored-by: Pedro Silva <pedro@acryl.io>
2023-06-13 13:57:54 +01:00
david-leifker
43d37ff442
chore(cp-schema-registry): bump minor version (#8192) 2023-06-09 11:53:18 +01:00
RyanHolstien
530b9a6540
fix(jackson): increase max serialized string length default (#8053) 2023-05-23 11:38:58 -05:00
david-leifker
cd05f5b174
feat(schema-registry): replace confluent schema registry (#7930)
Co-authored-by: Pedro Silva <pedro@acryl.io>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: Ryan Holstien <ryan@acryl.io>
2023-05-01 13:18:41 -05:00
david-leifker
2ffa39f009
Logging and test models fixes (#7884) 2023-04-21 15:45:20 -05:00
RyanHolstien
0d5873db2a
feat(patch): patch support for flow info and job info and refactor patchbuilders for java sdk (#7495)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
Co-authored-by: David Leifker <david.leifker@acryl.io>
2023-04-13 15:46:35 -05:00
RyanHolstien
cbf0809c4c
chore(snakeyaml): upgrade to snakeyaml 2 (#7786)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-04-13 12:01:51 -05:00
david-leifker
697e8e2647
fix(misc): misc fixes (#7633) 2023-03-21 19:42:50 +05:30
david-leifker
2de9d3d5bf
fix(logging): Remove lombok as source of slf4j-api, convert to compileOnly where possible (#6616) 2022-12-04 19:57:47 -08:00
david-leifker
ef9a280ba4
fix(verions): Update opentelemetry and updates from pr-5239 (#6563) 2022-11-29 10:59:38 -06:00
david-leifker
33fd876421
feat(elasticsearch): Updates to elasticsearch configuration, dao, and tests (#6269) 2022-11-15 18:03:11 -08:00
david-leifker
3dc25c14e0
test(KafkaEmitter): Enable ability to run test locally (#6123) 2022-10-06 13:34:11 -07:00
david-leifker
928f29438a
build: Update JNA for M1 Mac (#6116) 2022-10-05 14:53:38 -07:00
leifker
203a6ff57b
refactor(java11) - convert most modules to java 11 (#5836)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-09-25 08:39:22 -07:00
RyanHolstien
0728656fbf
feat(patch): initial support of json patch style semantics in MCPs (#5901)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-09-22 23:52:18 -07:00
Shirshanka Das
41746690fd
feat(protobuf): support for custom platform, subtypes, misc improvements (#5973) 2022-09-18 18:04:47 -07:00
Shirshanka Das
083ab9bc0e
feat(jars): better jar versioning for datahub-client, spark-lineage and protobuf (#5883) 2022-09-08 23:36:15 -07:00
Mugdha Hardikar
c7f477813c
feat(datahub-client): add java file emitter (#5578)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-08-07 07:21:44 -07:00
Mugdha Hardikar
d8b2350724
feat(spark-lineage, java-emitter): Support ssl cert disable verification functionality (#5488)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-07-26 18:06:03 -07:00
Harshal Sheth
fdea718e38
build: improve comprehensiveness of gradle clean (#5003) 2022-07-15 15:38:32 +05:30
Mugdha Hardikar
369c65522c
fix(datahub-client): Fix kafka config issue (#5403) 2022-07-15 15:38:00 +05:30