54 Commits

Author SHA1 Message Date
Esteban Gutierrez
8a17ba14d6
fix(): Fixes multiple minor security vulnerabilities (#13222)
bug(snappy): Make sure right snappy version is installed
fix(docker): update Dockerize to version v0.9.3
fix(gms): fixes dgraph4j netty deps
fix(docker): remove SGID on /home/datahub and /home/datahub-integration
fix(datahub-actions): bump setuptools and wheel version
fix(docker): update c-ares version
fix(docker): datahub-actions addendum
2025-04-21 16:39:26 -05:00
Rafael Sousa
d72361ddb3
feat(deps): update OpenTelemetry version to 2.15.0 (#13237) 2025-04-18 10:57:01 -05:00
Andrew Sikowitz
d138a64a6a
ci(graphql,workflows): Format .md, .graphql, and workflow .yml files via prettier (#13220) 2025-04-16 16:55:51 -07:00
Rafael Sousa
c1f6bd171e
fix(opentelemetry): Resolve type mismatch in metrics exporter (#13053)
Co-authored-by: Pedro Silva <pedro@acryl.io>
2025-04-04 15:51:10 +01:00
david-leifker
9a9cd384f1
fix(open-telemetry): include missing dependency (#12882) 2025-03-14 17:09:26 -05:00
david-leifker
ec0eb069db
chore(bump): bump jmx version (#12524) 2025-01-31 11:59:21 -06:00
david-leifker
210e2c1fa2
chore(alpine): bump alpine images 3.21 (#12302) 2025-01-09 14:32:18 -06:00
david-leifker
327c6f911a
chore(bump): bump alpine and dockerize (#12184) 2024-12-20 15:59:07 -06:00
david-leifker
edb9a87b84
fix(elasticsearch): refactor idHashAlgo setting (#11193) 2024-08-16 14:41:44 -05:00
Aseem Bansal
082ef5b351
build: fix docker warnings (#11163) 2024-08-14 14:23:11 +05:30
Pinaki Bhattacharjee
a5a33f074b
feat(config): support alternate hashing algorithm for doc id (#10423)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
Co-authored-by: John Joyce <john@acryl.io>
2024-08-06 13:50:38 -05:00
david-leifker
033114d522
chore(alpine): update alpine base image (#10754) 2024-06-20 11:12:36 -05:00
david-leifker
bcb40d3d71
chore(security): updates for security vulnerabilities (#10740) 2024-06-18 11:28:39 -05:00
Davi Arnaut
1b0ed540c1
fix(consumer): wait for internal schema registry (#9699) 2024-01-23 14:49:39 -08:00
david-leifker
824df5a6a3
feat(build): gradle 8, jdk17, neo4j 5 (#9458) 2023-12-15 13:28:33 -06:00
noggi
3e79a1325c
Pin alpine base image version to 3.18 (#9421) 2023-12-08 15:37:12 -06:00
Hendrik Richert
966cb175f7
feat(dev): Make repositories configurable for enterprise developers (#9230)
Co-authored-by: Hendrik Richert <hendrik.richert@swisscom.com>
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-11-28 14:52:11 -06:00
david-leifker
4201e541ca
chore(security): jre to headless, removes x11 dependency (#9245) 2023-11-15 06:28:40 -06:00
david-leifker
3f4ab44a91
feat(kafka): increase kafka message size and enable compression (#9038)
Co-authored-by: Pedro Silva <pedro@acryl.io>
2023-10-29 16:26:05 -05:00
RyanHolstien
6f466b0e50
chore(docker): update base images to alpine 3.18 (#8967) 2023-10-17 15:40:38 -05:00
Yang Jiandan
5588a04bc5
feat(docker):Add the jattach tool to the docker container(#7538) (#8040)
Co-authored-by: yangjd33 <yangjd33@chinaunicom.cn>
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-06-07 12:23:38 -05:00
Kevin Meyer
34f8f17a55
fix(PFP-260): Upgrading sqlite to fix SQLITE-449762 (#8032) 2023-05-12 13:03:43 -04:00
david-leifker
cd05f5b174
feat(schema-registry): replace confluent schema registry (#7930)
Co-authored-by: Pedro Silva <pedro@acryl.io>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: Ryan Holstien <ryan@acryl.io>
2023-05-01 13:18:41 -05:00
Kevin Meyer
97027fecce
fix(snakeyaml): cve-2022-1471 upgrade (#7795) 2023-04-11 15:17:21 -05:00
david-leifker
571970cf62
Dockerize updates (#7387) 2023-02-22 15:43:11 +05:30
david-leifker
bd11575d5f
chore(version): additional version bumps & suppressions (#7382) 2023-02-20 14:39:27 -06:00
david-leifker
39920bb00f
feat(elasticsearch): Elasticsearch improvements (#6894) 2023-01-31 18:44:37 -06:00
Pedro Silva
bef59b0928
feat(quickstart): Remove kafka-setup as a hard deployment requirement (#7073) 2023-01-24 16:12:57 +00:00
david-leifker
ecc01b9a46
refactor(restli-mce-consumer) (#6744)
* fix(security): commons-text in frontend

* refactor(restli): set threads based on cpu cores
feat(mce-consumers): hit local restli endpoint

* testing docker build

* Add retry configuration options for entity client

* Kafka debugging

* fix(kafka-setup): parallelize topic creation

* Adjust docker build

* Docker build updates

* WIP

* fix(lint): metadata-ingestion lint

* fix(gradle-docker): fix docker frontend dep

* fix(elastic): fix race condition between gms and mae for index creation

* Revert "fix(elastic): fix race condition between gms and mae for index creation"

This reverts commit 9629d12c3bdb3c0dab87604d409ca4c642c9c6d3.

* fix(test): fix datahub frontend test for clean/test cycle

* fix(test): datahub-frontend missing assets in test

* fix(security): set protobuf lib datahub-upgrade & mce/mae-consumer

* gitingore update

* fix(docker): remove platform on docker base image, set by buildx

* refactor(kafka-producer): update kafka producer tracking/logging

* updates per PR feedback

* Add documentation around mce standalone consumer
Kafka consumer concurrency to follow thread count for restli & sql connection pool

Co-authored-by: leifker <dleifker@gmail.com>
Co-authored-by: Pedro Silva <pedro@acryl.io>
2022-12-26 16:09:08 +00:00
Pedro Silva
c93bdc5e39
fix(setup): Bump setup images to alpine 3.14 with arch based on machine OS. (#6612)
* fix(setup): Bump setup images to alpine 3.14 with arch based on machine OS.
2022-12-09 09:49:24 -06:00
david-leifker
ef9a280ba4
fix(verions): Update opentelemetry and updates from pr-5239 (#6563) 2022-11-29 10:59:38 -06:00
leifker
203a6ff57b
refactor(java11) - convert most modules to java 11 (#5836)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-09-25 08:39:22 -07:00
Pedro Silva
12f462e82b
fix(docker): Bumps JRE 11 to latest (#5875) 2022-09-08 12:44:28 -05:00
Pedro Silva
7d0f5435c8
feat(docker): Update Dockerfiles to use java 11 runtime (#5853) 2022-09-08 17:39:23 +05:30
Pedro Silva
20138a32e5
fix(standalone-consumers): Exclude Solr from spring boot application config & make them run on M1 (#5827)
* fix(standalone-consumers) Removes Solr from spring boot application config

* Adds standalone consumer option to datahub quickstart cli

* Rename files

* Make dockerize platform agnostic & change docker compose utility to work with M1

* Fix MAE/MCE dockerfiles for arm & make smoke tests use standalone consumers

* Fix identation

* Use master code

* Adds ARM image publishing for consumers

* Fix linter

* Fix lint
2022-09-06 13:55:31 -05:00
Harshal Sheth
762bcbb168
chore(docker): make curl/wget commands quiet in docker (#5819) 2022-09-04 22:39:08 -07:00
Aseem Bansal
acb9879eb4
feat(cli,build): remove deprecated variables GMS_HOST/_PORT (#5451) 2022-07-20 20:54:43 +05:30
Aseem Bansal
1adcc994f3
feat(ingest): remove need for sink block in UI based ingestion (#5208) 2022-06-23 15:22:40 +05:30
John Joyce
e2f1da00ff
refactor(configs): Simplify Kafka Topic name configurations + docs (#5198) 2022-06-17 12:15:51 -07:00
Kevin Neville
d8e6f890a9
fix: Replace old repository link with new link (#4446) 2022-03-18 14:12:19 -07:00
Fabiano V. Santos
c95715448c
fix(docker): use exec form to start container main process (#4245) 2022-03-01 21:49:43 -08:00
Arun Vasudevan
6990cc5af6
feat(docker): add Snappy Lib and JKS File to mae, gms, mce images (#3898) 2022-01-21 07:57:54 -08:00
Dexter Lee
0576b76eb3
fix(elasticsearch): Use auth tokens to authorize curl requests in dockerize (#3596) 2021-12-07 17:50:08 -08:00
Dexter Lee
8747fbe43c
feat(perf): Add perf testing and monitoring framework (#3195) 2021-09-07 23:06:15 -07:00
Dexter Lee
e640f5ed03
fix(docker): modernize docker images and fix vulnerabilities (#2746) 2021-06-23 13:55:14 -07:00
John Joyce
cc95916201
feat(gms): Merge MAE, MCE consumers into GMS (#2690) 2021-06-15 08:44:15 -07:00
G-nther
634dde5cfb
fix(analytics): use seperate env variable for tracking topic in MAE-Consumer (#2545) 2021-05-12 17:53:40 -07:00
bernardino
9a947948f0
feat(Kubernetes): Add JMX exporter containers to all DataHub components (#2251)
Co-authored-by: Ricardo Bernardino <ricardo.bernardino@definedcrowd.com>
2021-03-30 22:03:27 -07:00
Dexter Lee
0f035782fd
feat(docker): Add healthchecks to datahub docker images (#2288) 2021-03-23 15:15:16 -07:00
Dexter Lee
8d731b577e
fix(docker): start issue when there are multiple kafka brokers in bootstrap config (#2231) 2021-03-12 11:26:49 -08:00