Esteban Gutierrez
c37eee18e6
chore(aws-msk-iam-auth): bump dependency version ( #12600 )
...
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2025-04-25 11:20:50 -05:00
Esteban Gutierrez
8a17ba14d6
fix(): Fixes multiple minor security vulnerabilities ( #13222 )
...
bug(snappy): Make sure right snappy version is installed
fix(docker): update Dockerize to version v0.9.3
fix(gms): fixes dgraph4j netty deps
fix(docker): remove SGID on /home/datahub and /home/datahub-integration
fix(datahub-actions): bump setuptools and wheel version
fix(docker): update c-ares version
fix(docker): datahub-actions addendum
2025-04-21 16:39:26 -05:00
Andrew Sikowitz
d138a64a6a
ci(graphql,workflows): Format .md, .graphql, and workflow .yml files via prettier ( #13220 )
2025-04-16 16:55:51 -07:00
Chakru
cf40116680
CI speedup ( #13057 )
2025-04-07 10:13:07 +05:30
Chakru
40106be208
build: optimizations for incremental builds and faster CI ( #13033 )
...
Co-authored-by: Andrew Sikowitz <andrew.sikowitz@acryl.io>
2025-04-02 11:51:10 +05:30
david-leifker
79178e50b0
chore(bump): Bump kafka-setup base ( #12743 )
2025-02-27 15:27:36 -06:00
david-leifker
10a7e01f4f
chore(bump): bump kafka base image ( #12626 )
2025-02-13 15:39:26 -06:00
Chakru
cc81dc45a6
chore(version): bump kafka version ( #12136 )
2024-12-16 15:58:48 +00:00
david-leifker
cdb23ac5d6
chore(version): confluent base image ( #11689 )
2024-10-22 10:14:25 -05:00
david-leifker
da958b7d0f
feat(kafka-setup): allow override KAFKA_HEAP_OPTS ( #11400 )
2024-09-17 13:00:24 -05:00
david-leifker
b98d7b543e
chore(bump): bump kafka base image ( #11236 )
2024-08-23 16:04:43 -05:00
david-leifker
09acd5b989
chore(kafka): kafka version bump ( #11211 )
2024-08-20 13:42:45 -05:00
david-leifker
0e045432bb
fix(kafka-setup): add missing script to image ( #11190 )
2024-08-15 17:20:45 -05:00
Aseem Bansal
082ef5b351
build: fix docker warnings ( #11163 )
2024-08-14 14:23:11 +05:30
jaegwon.seo
fc7b6853b9
change generate kafka connect properties from env ( #10545 )
...
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2024-07-31 15:05:55 -05:00
david-leifker
95c4515507
chore(kafka-setup): bump kafka version ( #10329 )
2024-04-18 15:34:41 -05:00
david-leifker
30523e9117
chore(docker): bump kafka docker base image ( #10313 )
2024-04-17 09:58:57 -05:00
Davi Arnaut
ecfab6b03b
chore(aws-msk-iam-auth): bump dependency version ( #10063 )
2024-03-15 15:02:54 -07:00
david-leifker
3284235850
bump(kafka-setup): client version bump ( #9962 )
2024-02-29 17:42:07 -06:00
david-leifker
824df5a6a3
feat(build): gradle 8, jdk17, neo4j 5 ( #9458 )
2023-12-15 13:28:33 -06:00
Hendrik Richert
966cb175f7
feat(dev): Make repositories configurable for enterprise developers ( #9230 )
...
Co-authored-by: Hendrik Richert <hendrik.richert@swisscom.com>
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-11-28 14:52:11 -06:00
david-leifker
4201e541ca
chore(security): jre to headless, removes x11 dependency ( #9245 )
2023-11-15 06:28:40 -06:00
david-leifker
ff90fb633d
fix(datahub-ingestion): prevent transitive deps, bump addtional pyspa… ( #9233 )
2023-11-13 16:26:53 -06:00
david-leifker
3f4ab44a91
feat(kafka): increase kafka message size and enable compression ( #9038 )
...
Co-authored-by: Pedro Silva <pedro@acryl.io>
2023-10-29 16:26:05 -05:00
Mert Tunç
ce6f833be4
fix(kafka-setup): Don't set truststore pass for PEM files ( #8656 )
...
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-10-26 17:06:37 -05:00
Xuelei Li
15f7a12c5a
fix(kafka-setup): remove dependency confluent docker utils ( #8715 )
2023-08-25 11:27:26 -05:00
david-leifker
655914841b
fix(docker): misc docker fixes ( #8677 )
2023-08-22 10:38:08 +05:30
david-leifker
40caf35812
feat(datahub-ingestion): refactor datahub ingestion slim images ( #8515 )
2023-08-17 10:40:17 +05:30
Harshal Sheth
2a3f6c42d4
ci: workarounds for pyyaml installation ( #8435 )
2023-07-17 15:26:43 -07:00
david-leifker
8f9a23fb2e
fix(kafka-setup): bump kafka version ( #8245 )
2023-06-15 12:30:04 -05:00
david-leifker
cd05f5b174
feat(schema-registry): replace confluent schema registry ( #7930 )
...
Co-authored-by: Pedro Silva <pedro@acryl.io>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: Ryan Holstien <ryan@acryl.io>
2023-05-01 13:18:41 -05:00
Jinlin Yang
a3a8107b92
bug(7882): run kafka-configs.sh on DataHubUpgradeHistory_v1 to make sure the retention.ms is set to infinite ( #7883 )
2023-04-21 18:31:51 -05:00
Kevin Meyer
97027fecce
fix(snakeyaml): cve-2022-1471 upgrade ( #7795 )
2023-04-11 15:17:21 -05:00
Kirill Popov
10d389f895
fix(kafka-setup): configure sasl.mechanism in case SASL_PLAINTEXT ( #7447 )
2023-02-28 16:07:27 -08:00
david-leifker
1df806d177
chore(versions): bump versions ( #7358 )
2023-02-20 11:32:05 +05:30
david-leifker
267472ccbb
gradle(development): add additional commands for development ( #7321 )
2023-02-16 10:41:42 -06:00
david-leifker
b4b3a39829
fix(system-update): fixes system-update with more than 1 partition ( #7302 )
2023-02-09 18:54:20 -06:00
david-leifker
d557fd65ff
fix(elasticsearch): fix orphan index clean up pattern, consistent top… ( #7242 )
2023-02-03 07:09:19 -06:00
david-leifker
39920bb00f
feat(elasticsearch): Elasticsearch improvements ( #6894 )
2023-01-31 18:44:37 -06:00
Peter Szalai
8a2230aea4
fix(quickstart): adding back kafka-setup ( #7181 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2023-01-31 00:34:36 +01:00
Pedro Silva
5db3a1f1f8
fix(kafka-setup): Make topic name consistent with other images ( #7103 )
2023-01-24 10:48:23 -08:00
Pedro Silva
ae2d781359
fix(kafka-setup): Remove reference to non-existing topic ( #7019 )
2023-01-12 07:25:17 -08:00
Pedro Silva
2fe9e8d962
fix(kafka-setup): Make kafka-setup run with multiple threads ( #6970 )
2023-01-09 12:27:00 +00:00
david-leifker
122c024bab
refactor(gradle): move the local docker registry to common location ( #6881 )
2022-12-29 15:08:36 +05:30
david-leifker
a5b5abf270
fix(kafka): datahub-upgrade job ( #6864 )
2022-12-27 12:35:48 -06:00
david-leifker
ecc01b9a46
refactor(restli-mce-consumer) ( #6744 )
...
* fix(security): commons-text in frontend
* refactor(restli): set threads based on cpu cores
feat(mce-consumers): hit local restli endpoint
* testing docker build
* Add retry configuration options for entity client
* Kafka debugging
* fix(kafka-setup): parallelize topic creation
* Adjust docker build
* Docker build updates
* WIP
* fix(lint): metadata-ingestion lint
* fix(gradle-docker): fix docker frontend dep
* fix(elastic): fix race condition between gms and mae for index creation
* Revert "fix(elastic): fix race condition between gms and mae for index creation"
This reverts commit 9629d12c3bdb3c0dab87604d409ca4c642c9c6d3.
* fix(test): fix datahub frontend test for clean/test cycle
* fix(test): datahub-frontend missing assets in test
* fix(security): set protobuf lib datahub-upgrade & mce/mae-consumer
* gitingore update
* fix(docker): remove platform on docker base image, set by buildx
* refactor(kafka-producer): update kafka producer tracking/logging
* updates per PR feedback
* Add documentation around mce standalone consumer
Kafka consumer concurrency to follow thread count for restli & sql connection pool
Co-authored-by: leifker <dleifker@gmail.com>
Co-authored-by: Pedro Silva <pedro@acryl.io>
2022-12-26 16:09:08 +00:00
david-leifker
637b540fa6
fix(kafka-setup): fix return code check ( #6782 )
...
* fix(kafka-setup): parallelize topic creation
* Remove -setup from docker compose (not services)
2022-12-16 13:39:18 -06:00
david-leifker
cca3639848
Optimize kafka setup ( #6778 )
...
* fix(kafka-setup): parallelize topic creation
2022-12-15 20:09:29 -06:00
Pedro Silva
c93bdc5e39
fix(setup): Bump setup images to alpine 3.14 with arch based on machine OS. ( #6612 )
...
* fix(setup): Bump setup images to alpine 3.14 with arch based on machine OS.
2022-12-09 09:49:24 -06:00
Parham Ghazanfari
269342bec0
feat(kafka-setup): Added support for MSK IAM authentication. ( #6435 )
2022-11-22 15:37:24 -06:00
