68 Commits

Author SHA1 Message Date
Esteban Gutierrez
8a17ba14d6
fix(): Fixes multiple minor security vulnerabilities (#13222)
bug(snappy): Make sure right snappy version is installed
fix(docker): update Dockerize to version v0.9.3
fix(gms): fixes dgraph4j netty deps
fix(docker): remove SGID on /home/datahub and /home/datahub-integration
fix(datahub-actions): bump setuptools and wheel version
fix(docker): update c-ares version
fix(docker): datahub-actions addendum
2025-04-21 16:39:26 -05:00
Rafael Sousa
d72361ddb3
feat(deps): update OpenTelemetry version to 2.15.0 (#13237) 2025-04-18 10:57:01 -05:00
Andrew Sikowitz
d138a64a6a
ci(graphql,workflows): Format .md, .graphql, and workflow .yml files via prettier (#13220) 2025-04-16 16:55:51 -07:00
Rafael Sousa
c1f6bd171e
fix(opentelemetry): Resolve type mismatch in metrics exporter (#13053)
Co-authored-by: Pedro Silva <pedro@acryl.io>
2025-04-04 15:51:10 +01:00
david-leifker
9a9cd384f1
fix(open-telemetry): include missing dependency (#12882) 2025-03-14 17:09:26 -05:00
david-leifker
ec0eb069db
chore(bump): bump jmx version (#12524) 2025-01-31 11:59:21 -06:00
david-leifker
210e2c1fa2
chore(alpine): bump alpine images 3.21 (#12302) 2025-01-09 14:32:18 -06:00
david-leifker
327c6f911a
chore(bump): bump alpine and dockerize (#12184) 2024-12-20 15:59:07 -06:00
david-leifker
edb9a87b84
fix(elasticsearch): refactor idHashAlgo setting (#11193) 2024-08-16 14:41:44 -05:00
Aseem Bansal
082ef5b351
build: fix docker warnings (#11163) 2024-08-14 14:23:11 +05:30
Pinaki Bhattacharjee
a5a33f074b
feat(config): support alternate hashing algorithm for doc id (#10423)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
Co-authored-by: John Joyce <john@acryl.io>
2024-08-06 13:50:38 -05:00
david-leifker
033114d522
chore(alpine): update alpine base image (#10754) 2024-06-20 11:12:36 -05:00
david-leifker
bcb40d3d71
chore(security): updates for security vulnerabilities (#10740) 2024-06-18 11:28:39 -05:00
Davi Arnaut
1b0ed540c1
fix(consumer): wait for internal schema registry (#9699) 2024-01-23 14:49:39 -08:00
david-leifker
824df5a6a3
feat(build): gradle 8, jdk17, neo4j 5 (#9458) 2023-12-15 13:28:33 -06:00
noggi
3e79a1325c
Pin alpine base image version to 3.18 (#9421) 2023-12-08 15:37:12 -06:00
Hendrik Richert
966cb175f7
feat(dev): Make repositories configurable for enterprise developers (#9230)
Co-authored-by: Hendrik Richert <hendrik.richert@swisscom.com>
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-11-28 14:52:11 -06:00
david-leifker
4201e541ca
chore(security): jre to headless, removes x11 dependency (#9245) 2023-11-15 06:28:40 -06:00
david-leifker
3f4ab44a91
feat(kafka): increase kafka message size and enable compression (#9038)
Co-authored-by: Pedro Silva <pedro@acryl.io>
2023-10-29 16:26:05 -05:00
RyanHolstien
6f466b0e50
chore(docker): update base images to alpine 3.18 (#8967) 2023-10-17 15:40:38 -05:00
Yang Jiandan
5588a04bc5
feat(docker):Add the jattach tool to the docker container(#7538) (#8040)
Co-authored-by: yangjd33 <yangjd33@chinaunicom.cn>
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-06-07 12:23:38 -05:00
Kevin Meyer
34f8f17a55
fix(PFP-260): Upgrading sqlite to fix SQLITE-449762 (#8032) 2023-05-12 13:03:43 -04:00
david-leifker
cd05f5b174
feat(schema-registry): replace confluent schema registry (#7930)
Co-authored-by: Pedro Silva <pedro@acryl.io>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: Ryan Holstien <ryan@acryl.io>
2023-05-01 13:18:41 -05:00
Kevin Meyer
97027fecce
fix(snakeyaml): cve-2022-1471 upgrade (#7795) 2023-04-11 15:17:21 -05:00
david-leifker
571970cf62
Dockerize updates (#7387) 2023-02-22 15:43:11 +05:30
david-leifker
bd11575d5f
chore(version): additional version bumps & suppressions (#7382) 2023-02-20 14:39:27 -06:00
david-leifker
39920bb00f
feat(elasticsearch): Elasticsearch improvements (#6894) 2023-01-31 18:44:37 -06:00
david-leifker
ecc01b9a46
refactor(restli-mce-consumer) (#6744)
* fix(security): commons-text in frontend

* refactor(restli): set threads based on cpu cores
feat(mce-consumers): hit local restli endpoint

* testing docker build

* Add retry configuration options for entity client

* Kafka debugging

* fix(kafka-setup): parallelize topic creation

* Adjust docker build

* Docker build updates

* WIP

* fix(lint): metadata-ingestion lint

* fix(gradle-docker): fix docker frontend dep

* fix(elastic): fix race condition between gms and mae for index creation

* Revert "fix(elastic): fix race condition between gms and mae for index creation"

This reverts commit 9629d12c3bdb3c0dab87604d409ca4c642c9c6d3.

* fix(test): fix datahub frontend test for clean/test cycle

* fix(test): datahub-frontend missing assets in test

* fix(security): set protobuf lib datahub-upgrade & mce/mae-consumer

* gitingore update

* fix(docker): remove platform on docker base image, set by buildx

* refactor(kafka-producer): update kafka producer tracking/logging

* updates per PR feedback

* Add documentation around mce standalone consumer
Kafka consumer concurrency to follow thread count for restli & sql connection pool

Co-authored-by: leifker <dleifker@gmail.com>
Co-authored-by: Pedro Silva <pedro@acryl.io>
2022-12-26 16:09:08 +00:00
Pedro Silva
c93bdc5e39
fix(setup): Bump setup images to alpine 3.14 with arch based on machine OS. (#6612)
* fix(setup): Bump setup images to alpine 3.14 with arch based on machine OS.
2022-12-09 09:49:24 -06:00
david-leifker
ef9a280ba4
fix(verions): Update opentelemetry and updates from pr-5239 (#6563) 2022-11-29 10:59:38 -06:00
david-leifker
a2dc229c62
fix(tests): Misc updates for tests, auth log level, and quickstart (#6491) 2022-11-29 08:44:55 -08:00
skrydal
a274406126
fix(docker): Set proper variable expansion for JMX_OPTS and JAVA_OPTS in MAE docker (#6378)
image
2022-11-15 10:03:33 -08:00
Peter Szalai
396fd31ddc
fix(mae-consumer): use JAVA_TOOL_OPTIONS instead of JDK_JAVA_OPTIONS (#6114) 2022-10-04 09:07:44 -07:00
Patrick Marx
9e7bd1a84f
fix(mae-consumer): fix regression on base64 encoding (#6061)
Pull request #5827 introduced a regression by removing coreutils
from the mae-consumer Dockerfile (coreutils was added in #3723).
This broke the base64 call in the startup script s.th. the Elasticsearch
auth header will not be correctly set when username and password are
provided.

To make sure that the startup script fails on these errors in the
future, set "-euo pipefail" which lets the bash script fail on errors
and unset variables.
Also refactor the startup script to make it more stable and readable.

Co-authored-by: Pedro Silva <pedro@acryl.io>
2022-09-29 12:13:45 +01:00
leifker
203a6ff57b
refactor(java11) - convert most modules to java 11 (#5836)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-09-25 08:39:22 -07:00
Pedro Silva
12f462e82b
fix(docker): Bumps JRE 11 to latest (#5875) 2022-09-08 12:44:28 -05:00
Pedro Silva
7d0f5435c8
feat(docker): Update Dockerfiles to use java 11 runtime (#5853) 2022-09-08 17:39:23 +05:30
Pedro Silva
20138a32e5
fix(standalone-consumers): Exclude Solr from spring boot application config & make them run on M1 (#5827)
* fix(standalone-consumers) Removes Solr from spring boot application config

* Adds standalone consumer option to datahub quickstart cli

* Rename files

* Make dockerize platform agnostic & change docker compose utility to work with M1

* Fix MAE/MCE dockerfiles for arm & make smoke tests use standalone consumers

* Fix identation

* Use master code

* Adds ARM image publishing for consumers

* Fix linter

* Fix lint
2022-09-06 13:55:31 -05:00
Harshal Sheth
762bcbb168
chore(docker): make curl/wget commands quiet in docker (#5819) 2022-09-04 22:39:08 -07:00
Aseem Bansal
acb9879eb4
feat(cli,build): remove deprecated variables GMS_HOST/_PORT (#5451) 2022-07-20 20:54:43 +05:30
Aseem Bansal
1adcc994f3
feat(ingest): remove need for sink block in UI based ingestion (#5208) 2022-06-23 15:22:40 +05:30
John Joyce
e2f1da00ff
refactor(configs): Simplify Kafka Topic name configurations + docs (#5198) 2022-06-17 12:15:51 -07:00
John Joyce
c69310522b
feat(metadata service): Introducing Platform Events (#4477) 2022-03-29 18:32:04 -07:00
Kevin Neville
d8e6f890a9
fix: Replace old repository link with new link (#4446) 2022-03-18 14:12:19 -07:00
Fabiano V. Santos
c95715448c
fix(docker): use exec form to start container main process (#4245) 2022-03-01 21:49:43 -08:00
Dexter Lee
0e5811fd68
fix(mae-consumer-docker): Fix condition for skipping elasticsearch check (#4052) 2022-02-03 18:58:04 -08:00
Arun Vasudevan
6990cc5af6
feat(docker): add Snappy Lib and JKS File to mae, gms, mce images (#3898) 2022-01-21 07:57:54 -08:00
Gabe Lyons
3fd3313544
Revert "feat(graph): Make Dgraph a proper Neo4j alternative (#3578)" (#3740) 2021-12-14 10:49:03 -08:00
Enrico Minack
a6deaabfcf
feat(graph): Make Dgraph a proper Neo4j alternative (#3578) 2021-12-13 12:37:59 -08:00
Dexter Lee
d4d621800b
fix(docker): fix issues with base64 not working on some platforms (#3723) 2021-12-13 09:39:48 -08:00