106 Commits

Author SHA1 Message Date
juhyun seo
6cb3dc839c
fix(protobuf): fix reseved field error in fields in nested messages (#9318) 2024-01-18 15:45:00 -06:00
RyanHolstien
7a788240c1
feat(spring): update spring to version 6 and spring boot to version 3 (#9567) 2024-01-11 13:44:06 -06:00
RyanHolstien
822d0eb014
feat(patch): add dashboardInfo and chartInfo support for patch (#9536) 2024-01-03 15:11:07 -06:00
Ellie O'Neil
92c9940bbd
Allow message_name field for protobuf ingestion (#9480) 2023-12-19 09:24:03 -08:00
david-leifker
824df5a6a3
feat(build): gradle 8, jdk17, neo4j 5 (#9458) 2023-12-15 13:28:33 -06:00
RyanHolstien
8a1122049c
feat(patch): support fine grained lineage patches (#9408)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-12-11 16:25:43 -06:00
Aseem Bansal
e14474176f
feat(lint): add spotless for java lint (#9373) 2023-12-06 11:02:42 +05:30
Hendrik Richert
966cb175f7
feat(dev): Make repositories configurable for enterprise developers (#9230)
Co-authored-by: Hendrik Richert <hendrik.richert@swisscom.com>
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-11-28 14:52:11 -06:00
sachinsaju
d6cb106fab
doc(java-sdk-example):example to create tag via java-sdk (#9151) 2023-11-09 12:40:55 -08:00
sachinsaju
5911a7b45e
docs(java-sdk-dataset): add dataset via java sdk example (#9136)
Co-authored-by: Hyejin Yoon <0327jane@gmail.com>
2023-11-09 12:24:53 -08:00
Jia (Jason) Teoh
7a31950f79
fix(datahub-client): Include relocation for snakeyaml dependency. (#8911)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-10-31 20:41:16 -05:00
Younghoon YUN
1c77bca0c6
fix(datahub-protobuf): add check if nested field is reserved (#9058) 2023-10-25 15:01:47 -05:00
Ellie O'Neil
75b36c41ee
docs(protobuf) Update messaging around nesting messages (#9048) 2023-10-19 10:32:24 -05:00
RyanHolstien
1b737243b2
feat(avro): upgrade avro to 1.11 (#9031) 2023-10-18 13:45:46 -05:00
david-leifker
21eb4dfc12
feat(search): update to support OpenSearch 2.x (#8852) 2023-09-21 13:01:55 -05:00
david-leifker
68ae3bfc26
fix(spark-test): upgrade gradle and fix spark smoke test (#8777) 2023-09-07 20:17:50 -05:00
david-leifker
56c00f5586
feat(openapi): entity endpoints & analytics raw (#8537) 2023-09-07 17:09:52 -05:00
John Joyce
94fa514700
feat(systemMetadata): Adding a lastRunId field system metadata (#8672)
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
Co-authored-by: Indy Prentice <iprentic@users.noreply.github.com>
2023-09-06 14:51:03 -03:00
david-leifker
7dd6e09ac5
refactor(build): upgrade to gradle 7 & guava update (#8745) 2023-09-01 19:36:01 +05:30
Aseem Bansal
9472636d08
fix(cleanup): cleanup of 1 sub-module (#8678) 2023-08-24 13:09:57 +05:30
Andrew Sikowitz
9cb62f30fd
docs(databricks/spark-lineage): Fix incorrect statement (#8423) 2023-07-17 14:14:39 +05:30
RyanHolstien
f78f7f9609
feat(patch): support datajob input output (#8190)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-06-14 22:21:16 -07:00
Jinlin Yang
166dc90896
Upgrade kafka and its dependencies to 3.4 in docker compose (#8161)
Co-authored-by: Pedro Silva <pedro@acryl.io>
2023-06-13 13:57:54 +01:00
david-leifker
43d37ff442
chore(cp-schema-registry): bump minor version (#8192) 2023-06-09 11:53:18 +01:00
RyanHolstien
530b9a6540
fix(jackson): increase max serialized string length default (#8053) 2023-05-23 11:38:58 -05:00
Hyejin Yoon
b04d59e13d
docs: add tips on language switchable tap on docs (#7984) 2023-05-08 18:05:22 -07:00
david-leifker
cd05f5b174
feat(schema-registry): replace confluent schema registry (#7930)
Co-authored-by: Pedro Silva <pedro@acryl.io>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: Ryan Holstien <ryan@acryl.io>
2023-05-01 13:18:41 -05:00
david-leifker
2ffa39f009
Logging and test models fixes (#7884) 2023-04-21 15:45:20 -05:00
RyanHolstien
0d5873db2a
feat(patch): patch support for flow info and job info and refactor patchbuilders for java sdk (#7495)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
Co-authored-by: David Leifker <david.leifker@acryl.io>
2023-04-13 15:46:35 -05:00
RyanHolstien
cbf0809c4c
chore(snakeyaml): upgrade to snakeyaml 2 (#7786)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-04-13 12:01:51 -05:00
david-leifker
697e8e2647
fix(misc): misc fixes (#7633) 2023-03-21 19:42:50 +05:30
david-leifker
4a641fb9d3
chore(ci): update command to run smoke tests (#7284) 2023-02-09 21:26:29 +05:30
mohdsiddique
90a1da3b25
fix(test): spark-lineage # build task as dependency of integrationTest (#7189)
Co-authored-by: MohdSiddique Bagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: Pedro Silva <pedro@acryl.io>
2023-01-31 19:50:00 -08:00
(((((Al)))))
48080b2d29
fix(ingest): add message proto check (#7130)
Co-authored-by: Tino Lyu <tinol@ziprecruiter.com>
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-01-25 20:37:45 -06:00
Fully
a6a597cc81
feat(ingest/spark): add removing partition pattern in spark lineage (#6605)
Co-authored-by: John Joyce <john@acryl.io>
2023-01-24 09:32:11 +01:00
seoju
65c275979b
fix(ingest): fix logic error of google protobuf wrapper type. (#7076)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-01-20 07:33:00 -06:00
seoju
aba3881903
feat(ingest): add import descriptions of two or more nested messages (#6959)
Co-authored-by: 서주현[G플레이스데이터개발] <juhyun.seo@navercorp.com>
2023-01-09 16:22:37 -08:00
danielli-ziprecruiter
a6470fc267
feat(ingestion): spark - support lineage for delta lake writes (#6834) 2022-12-22 12:13:32 +01:00
danielli-ziprecruiter
ca6c3b949b
fix(ingest): exclude ztsd from uber jar to prevent jni conflicts with spark (#6787)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2022-12-20 21:54:56 -06:00
danielli-ziprecruiter
7ca21a8e7c
fix(ingest): prevent NullPointerException when non-jdbc SaveIntoDataSourceCommand (#6803) 2022-12-19 08:41:06 -08:00
david-leifker
3758bcbe34
fix(docs): update examples for protobuf (#6681) 2022-12-07 16:48:01 -06:00
Shirshanka Das
8e05fdf516
fix(datahub-protobuf): fix missing httpclient dependency (#6672) 2022-12-07 07:28:17 -06:00
david-leifker
2de9d3d5bf
fix(logging): Remove lombok as source of slf4j-api, convert to compileOnly where possible (#6616) 2022-12-04 19:57:47 -08:00
david-leifker
ef9a280ba4
fix(verions): Update opentelemetry and updates from pr-5239 (#6563) 2022-11-29 10:59:38 -06:00
david-leifker
a2dc229c62
fix(tests): Misc updates for tests, auth log level, and quickstart (#6491) 2022-11-29 08:44:55 -08:00
david-leifker
33fd876421
feat(elasticsearch): Updates to elasticsearch configuration, dao, and tests (#6269) 2022-11-15 18:03:11 -08:00
Tamas Nemeth
8cfcefb19c
fix(spark-lineage): smoke test fixes, M1 support (#6372) 2022-11-05 11:37:50 -07:00
Tamas Nemeth
ff3a9dd4b9
fix(spark-lineage): Rename table.platform to table.hive_platform_alias (#6311) 2022-10-28 16:59:17 -07:00
danielli-ziprecruiter
7b2a76dd4c
feat(spark-lineage): make platform for spark lineage inferred and configurable (#6251)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2022-10-27 21:59:18 +02:00
Mayuri Nehate
38a2b211af
docs(spark): add configuration instructions for databricks (#6206) 2022-10-14 16:55:07 -07:00