Abe
0a0fcef047
fix(protobuf): skip MESSAGE-type options in PropertyVisitor ( #14957 )
...
DataHub protobuf metadata type annotations only apply to primitive extension types, not MESSAGE types (see https://docs.datahub.com/docs/metadata-integration/java/datahub-protobuf ). Previously, PropertyVisitor incorrectly attempted to process MESSAGE-type options, causing issues with user test cases.
This change removes MESSAGE-type handling from PropertyVisitor. Additionally refactored ProtobufExtensionUtil.filterByDataHubType() for readability by replacing nested stream chains with explicit loops and extracting a matchesDataHubType() helper method.
🤖 Generated with Claude Code
Co-Authored-By: Claude noreply@anthropic.com
2025-10-08 23:19:30 +00:00
Abe
0f5d5fd358
fix(protobuf): use DynamicMessage for MESSAGE-type extension defaults ( #14900 )
...
Co-authored-by: Claude <noreply@anthropic.com>
2025-10-01 12:41:18 -07:00
david-leifker
6f42a796f8
test(protobuf): bump protobuf and additional tests ( #14650 )
2025-09-05 10:06:43 -05:00
Chakru
91000841ae
fix(publish): fix jar publishing tasks ( #14616 )
2025-09-03 12:25:54 +05:30
Chakru
505655a4ba
fix(spark-smoke-test): debian13 deprecated software-properties-common ( #14619 )
2025-09-02 09:28:02 -05:00
rahul MALAWADKAR
88064ba163
chore(deps): fix CVE-2025-48924 (commons-lang:commons-lang) ( #14480 )
2025-08-23 09:48:29 -05:00
John Joyce
8ad96399dc
feat(): Add support for generating default venvs in datahub-actions (based on recent version of CLI) ( #14491 )
...
Co-authored-by: John Joyce <john@ip-192-168-1-63.us-west-2.compute.internal>
2025-08-19 10:12:55 -07:00
kyungryun choi
3b071ea3ce
feat(spark-lineage): add column-level lineage capture control ( #14300 )
2025-08-13 11:07:10 +02:00
Chakru
c6b14aaaf4
fix(publish): use new ossrh endpoint in maven publish ( #14416 )
2025-08-11 21:09:41 +05:30
Chakru
38cd4d02d0
fix(schematron): handle custom props for non-primitive types ( #14326 )
2025-08-05 20:15:15 +05:30
Tamas Nemeth
dc86e4da43
feat(ingest/spark): Bump openlineage version to 1.33.0 + Spark Streaming support ( #13347 )
...
Co-authored-by: Jonny Dixon <jonny.dixon@acryl.io>
Co-authored-by: Jonny Dixon <45681293+acrylJonny@users.noreply.github.com>
2025-08-01 15:16:45 +02:00
RyanHolstien
841f6e693f
feat(audit): increase auditability with new system metadata tracking ( #14162 )
2025-07-23 10:50:46 -05:00
Chakru
fe56b0f41e
fix(tests): disable auth for spark test via env var instead of env file ( #14148 )
2025-07-19 21:50:03 +05:30
Vinayak Hulawale
1df3da5d7f
test(datahub-schematron): update golden diff to fix schema translation test ( #14132 )
2025-07-18 16:25:18 +09:00
david-leifker
cbd97186e2
feat(kafka): bump confluent kafka ( #13767 )
2025-06-15 10:52:16 -05:00
mihai103
c39e150e29
Handle Cyclic References in AVRO Schema Conversion ( #13608 )
...
Co-authored-by: Mihai Ciocirdel <mihai.ciocirdel@swisscom.com>
2025-06-13 11:21:23 -05:00
leaderofrogue
5404ee9b39
Update README.md ( #13668 )
2025-06-13 11:20:01 -05:00
david-leifker
1194f910bd
bump(): upgrade Kafka 7.9.1 ( #13667 )
2025-05-30 21:51:36 -05:00
david-leifker
4145ff3d36
chore(): bump beanutils version ( #13656 )
...
Co-authored-by: Esteban Gutierrez <esteban.gutierrez@acryl.io>
2025-05-30 11:00:41 -05:00
david-leifker
4c6672213c
config(gradle): pin jackson via bom ( #13617 )
2025-05-24 13:42:10 -05:00
Esteban Gutierrez
52e01bd599
fix(smoke-test): use full quickstart image instead of slim for spark tests ( #13543 )
2025-05-19 11:04:53 -05:00
Kevin Karch
18d1a3c2e3
fix(docs): broken link in spark docs ( #13516 )
2025-05-14 16:11:44 -04:00
Hyejin Yoon
f986315582
doc: Acryl to DataHub, datahubproject.io to datahub.com ( #13252 )
...
Co-authored-by: Jay <159848059+jayacryl@users.noreply.github.com>
2025-04-28 10:34:33 -04:00
Andrew Sikowitz
d138a64a6a
ci(graphql,workflows): Format .md, .graphql, and workflow .yml files via prettier ( #13220 )
2025-04-16 16:55:51 -07:00
david-leifker
5ee0b66920
feat(spring): upgrade to SpringBoot 3.4 ( #13186 )
2025-04-12 15:34:17 -05:00
david-leifker
dd14507d7d
fix(openapi): required fields w/ defaults ( #13095 )
2025-04-07 10:51:03 -05:00
Chakru
40106be208
build: optimizations for incremental builds and faster CI ( #13033 )
...
Co-authored-by: Andrew Sikowitz <andrew.sikowitz@acryl.io>
2025-04-02 11:51:10 +05:30
Chakru
7c1ed744f4
fix(build): build improvements to help with incremental builds ( #12823 )
2025-03-10 22:43:31 +05:30
Sergio Gómez Villamor
64aaaf126f
fix(model): fixes DashboardContainsDashboard relationship in DashboardInfo aspect ( #12433 )
2025-02-03 11:33:25 +01:00
david-leifker
462de489d8
refactor(GMS): migrate GMS to Spring boot ( #12389 )
2025-01-23 10:45:40 -06:00
Tamas Nemeth
3316d407f7
fix(spark): Finegrained lineage is emitted on the DataJob and not on the emitted Datasets. ( #11956 )
2025-01-06 18:21:24 +01:00
Sergio Gómez Villamor
d2ffeb00a5
tests(datahub-client): new tests for the AvroSchemaConverter ( #12087 )
2024-12-16 11:26:57 +00:00
Dejan Stojadinović
2291c71c29
build(gradle): version change (Gradle and shadow plugin) ( #11999 )
2024-12-14 10:04:48 -06:00
Sergio Gómez Villamor
613b433d18
fix(datahub-client): adds missing archiveAppendix to artifactid when publishing ( #12112 )
2024-12-12 18:11:54 +00:00
Sergio Gómez Villamor
edca8eae99
feat(datahub-client): additionally generates java8 artefacts ( #12106 )
2024-12-12 14:03:30 +00:00
david-leifker
cb7d687794
fix(datahub-client): prevent unneeded classes in datahub-client jar ( #12037 )
2024-12-05 11:45:04 -06:00
david-leifker
a004c9293d
fix(ci): fix datahub-client validatePythonEnv ( #12023 )
2024-12-03 15:47:08 -06:00
Shirshanka Das
7429075ebd
feat(java-sdk): add utils classes to give equivalence with python uti… ( #12002 )
2024-12-02 23:23:22 -08:00
Chakru
85b42e3ea5
build(coverage): enable code coverage for java and python ( #11992 )
...
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2024-12-02 19:27:43 -06:00
Jonny Dixon
2f20c529f4
fix(docs): Add spark.datahub.stage_metadata_coalescing to recommended configuration for databricks ( #11800 )
2024-12-02 10:08:20 -08:00
david-leifker
0ee758c52d
fix(schematron): fix for jdk8 ( #11975 )
2024-11-27 12:10:23 -06:00
david-leifker
3b00fd7646
fix(shadowJar): fix shadowJar ( #11968 )
2024-11-26 21:02:28 -06:00
Shirshanka Das
f9cc67dd31
feat(schematron): add java capabilities for schema translation ( #11963 )
2024-11-26 16:03:22 -06:00
Tamas Nemeth
1f396e87c1
feat(spark): OpenLineage 1.24.2 upgrade ( #11830 )
2024-11-19 15:13:24 -08:00
skrydal
becda8fd34
docs(ingest): transformer docs and java example ( #11859 )
2024-11-15 20:19:45 +05:30
ronybony1990
edb87ff2ea
feat(spark-plugin): user should be able to pass custom mcp kafka topic ( #11767 )
...
Co-authored-by: Neelab Chaudhuri <nchaudhuri@fanatics.com>
2024-11-05 11:18:15 +01:00
Steffen Grohsschmiedt
4634bbcae0
docs(spark): fix incorrect config option ( #11119 )
2024-10-31 16:01:25 -07:00
david-leifker
413331933a
fix(spark-lineage-legacy): fix check jar script ( #11608 )
2024-10-11 19:08:25 -05:00
Aseem Bansal
867007f209
chore: remove obsolete attribute from docker ( #11573 )
2024-10-09 20:52:50 +05:30
david-leifker
db49067111
build(misc): misc build, config, version updates ( #11527 )
2024-10-03 21:10:26 -05:00
