54 Commits

Author SHA1 Message Date
david-leifker
1194f910bd
bump(): upgrade Kafka 7.9.1 (#13667) 2025-05-30 21:51:36 -05:00
david-leifker
4145ff3d36
chore(): bump beanutils version (#13656)
Co-authored-by: Esteban Gutierrez <esteban.gutierrez@acryl.io>
2025-05-30 11:00:41 -05:00
david-leifker
4c6672213c
config(gradle): pin jackson via bom (#13617) 2025-05-24 13:42:10 -05:00
jmacryl
8f52bdc5e4
feat(search): PFP-1275/look-into-0-doc-indices (#13296)
Co-authored-by: David Leifker <david.leifker@acryl.io>
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2025-05-16 12:59:46 -05:00
Rafael Francisco Luque Cerezo
a97af36e93
Adding KafkaClients dependency to the datahub-upgrade module (#13488)
Co-authored-by: Jonny Dixon <45681293+acrylJonny@users.noreply.github.com>
2025-05-12 09:37:57 -05:00
Esteban Gutierrez
9b6960ac8e
feat(azure): include azure-identity-extensions for Microsoft Entra Workload Identity connections (#13395) 2025-05-01 20:22:47 -05:00
david-leifker
5ee0b66920
feat(spring): upgrade to SpringBoot 3.4 (#13186) 2025-04-12 15:34:17 -05:00
Chakru
cf40116680
CI speedup (#13057) 2025-04-07 10:13:07 +05:30
Rafael Sousa
c1f6bd171e
fix(opentelemetry): Resolve type mismatch in metrics exporter (#13053)
Co-authored-by: Pedro Silva <pedro@acryl.io>
2025-04-04 15:51:10 +01:00
Chakru
40106be208
build: optimizations for incremental builds and faster CI (#13033)
Co-authored-by: Andrew Sikowitz <andrew.sikowitz@acryl.io>
2025-04-02 11:51:10 +05:30
david-leifker
9a9cd384f1
fix(open-telemetry): include missing dependency (#12882) 2025-03-14 17:09:26 -05:00
david-leifker
463803e2d1
feat(restore-indices): createDefaultAspects argument (#12859) 2025-03-13 10:17:14 -05:00
david-leifker
a35bfddba2
fix(nocode): fix no-code upgrade (#12494) 2025-01-29 15:16:49 -06:00
Chakru
cc81dc45a6
chore(version): bump kafka version (#12136) 2024-12-16 15:58:48 +00:00
Chakru
85b42e3ea5
build(coverage): enable code coverage for java and python (#11992)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2024-12-02 19:27:43 -06:00
david-leifker
04349cb9cd
feat(bootstrap): bootstrap template mcps (#11518) 2024-10-04 11:57:42 -05:00
david-leifker
f6dde2bf03
fix(restoreIndices): fix bug in urn paginated restoreIndices exit code (#11443) 2024-09-20 10:33:37 -05:00
david-leifker
ede9520b87
feat(schemaField): populate schemaFields with side effects (#10928) 2024-09-04 15:36:12 -05:00
david-leifker
f85e9551e8
chore(bump): bump hadoop and dnsjava versions (#11227) 2024-08-23 10:26:42 -05:00
david-leifker
09acd5b989
chore(kafka): kafka version bump (#11211) 2024-08-20 13:42:45 -05:00
david-leifker
bcb40d3d71
chore(security): updates for security vulnerabilities (#10740) 2024-06-18 11:28:39 -05:00
david-leifker
333799c338
feat(strucutred-properties): structured properties delete and schema change support (#10711) 2024-06-17 19:53:54 -05:00
david-leifker
f9e64d03cc
feat(auth): view authorization (#10066) 2024-03-23 06:15:36 -05:00
Davi Arnaut
ecfab6b03b
chore(aws-msk-iam-auth): bump dependency version (#10063) 2024-03-15 15:02:54 -07:00
david-leifker
03a677af93
chore(java): bump java dependency versions (#10009) 2024-03-07 14:15:22 -06:00
Hendrik Richert
966cb175f7
feat(dev): Make repositories configurable for enterprise developers (#9230)
Co-authored-by: Hendrik Richert <hendrik.richert@swisscom.com>
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-11-28 14:52:11 -06:00
david-leifker
f70d8a45b5
chore(security): version adjustments for security vulns (#9243) 2023-11-14 19:00:22 -06:00
david-leifker
ff90fb633d
fix(datahub-ingestion): prevent transitive deps, bump addtional pyspa… (#9233) 2023-11-13 16:26:53 -06:00
david-leifker
1b79142d9e
feat(EntityService): batched transactions and ebean updates (#8456) 2023-09-02 19:25:44 -05:00
david-leifker
7dd6e09ac5
refactor(build): upgrade to gradle 7 & guava update (#8745) 2023-09-01 19:36:01 +05:30
david-leifker
40caf35812
feat(datahub-ingestion): refactor datahub ingestion slim images (#8515) 2023-08-17 10:40:17 +05:30
RyanHolstien
93fde6bf93
feat(io): refactor metadata-io module (#8306) 2023-07-20 06:39:14 +05:30
david-leifker
81fdf9df55
fix(vulnerabilities)/vulnerabilities_fixes_datahub (#8075) (#8189)
Co-authored-by: Sejal-NucleusTeq <109514187+Sejal-NucleusTeq@users.noreply.github.com>
2023-06-07 18:42:19 -05:00
david-leifker
b97e7a03e8
feat(system-update): remove datahub-update requirement on schema reg (#7999) 2023-05-17 10:32:23 -05:00
david-leifker
2ffa39f009
Logging and test models fixes (#7884) 2023-04-21 15:45:20 -05:00
RyanHolstien
cbf0809c4c
chore(snakeyaml): upgrade to snakeyaml 2 (#7786)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-04-13 12:01:51 -05:00
david-leifker
eea95be4fc
chore(bump): bump hadoop client and fix exclusion name (#7386) 2023-02-20 19:53:59 -06:00
david-leifker
bd11575d5f
chore(version): additional version bumps & suppressions (#7382) 2023-02-20 14:39:27 -06:00
david-leifker
1df806d177
chore(versions): bump versions (#7358) 2023-02-20 11:32:05 +05:30
david-leifker
267472ccbb
gradle(development): add additional commands for development (#7321) 2023-02-16 10:41:42 -06:00
david-leifker
2e339fe008
fix(datahub-upgrade): allow registry override (#7258) 2023-02-10 21:09:09 +05:30
david-leifker
39920bb00f
feat(elasticsearch): Elasticsearch improvements (#6894) 2023-01-31 18:44:37 -06:00
david-leifker
122c024bab
refactor(gradle): move the local docker registry to common location (#6881) 2022-12-29 15:08:36 +05:30
david-leifker
a5b5abf270
fix(kafka): datahub-upgrade job (#6864) 2022-12-27 12:35:48 -06:00
david-leifker
ecc01b9a46
refactor(restli-mce-consumer) (#6744)
* fix(security): commons-text in frontend

* refactor(restli): set threads based on cpu cores
feat(mce-consumers): hit local restli endpoint

* testing docker build

* Add retry configuration options for entity client

* Kafka debugging

* fix(kafka-setup): parallelize topic creation

* Adjust docker build

* Docker build updates

* WIP

* fix(lint): metadata-ingestion lint

* fix(gradle-docker): fix docker frontend dep

* fix(elastic): fix race condition between gms and mae for index creation

* Revert "fix(elastic): fix race condition between gms and mae for index creation"

This reverts commit 9629d12c3bdb3c0dab87604d409ca4c642c9c6d3.

* fix(test): fix datahub frontend test for clean/test cycle

* fix(test): datahub-frontend missing assets in test

* fix(security): set protobuf lib datahub-upgrade & mce/mae-consumer

* gitingore update

* fix(docker): remove platform on docker base image, set by buildx

* refactor(kafka-producer): update kafka producer tracking/logging

* updates per PR feedback

* Add documentation around mce standalone consumer
Kafka consumer concurrency to follow thread count for restli & sql connection pool

Co-authored-by: leifker <dleifker@gmail.com>
Co-authored-by: Pedro Silva <pedro@acryl.io>
2022-12-26 16:09:08 +00:00
david-leifker
1e5d434501
fix(security): commons-text in frontend, hadoop-commons in datahub-upgrade (#6723) 2022-12-09 14:11:12 -06:00
david-leifker
2de9d3d5bf
fix(logging): Remove lombok as source of slf4j-api, convert to compileOnly where possible (#6616) 2022-12-04 19:57:47 -08:00
Parham Ghazanfari
497c5eee74
feat(datahub-upgrade): Added msk IAM auth as a build dependency. (#6439) 2022-11-22 15:36:53 -06:00
John Joyce
f49666a230
feat(auth): Metadata Service Authentication! (#3598) 2021-11-22 16:33:14 -08:00
John Joyce
2c5edd88ab
feat(graphql): migrating GraphQL API to metadata-service (nee GMS) (#3131) 2021-08-20 10:58:07 -07:00