david-leifker
824df5a6a3
feat(build): gradle 8, jdk17, neo4j 5 ( #9458 )
2023-12-15 13:28:33 -06:00
Hendrik Richert
966cb175f7
feat(dev): Make repositories configurable for enterprise developers ( #9230 )
...
Co-authored-by: Hendrik Richert <hendrik.richert@swisscom.com>
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-11-28 14:52:11 -06:00
david-leifker
4201e541ca
chore(security): jre to headless, removes x11 dependency ( #9245 )
2023-11-15 06:28:40 -06:00
david-leifker
ff90fb633d
fix(datahub-ingestion): prevent transitive deps, bump addtional pyspa… ( #9233 )
2023-11-13 16:26:53 -06:00
david-leifker
3f4ab44a91
feat(kafka): increase kafka message size and enable compression ( #9038 )
...
Co-authored-by: Pedro Silva <pedro@acryl.io>
2023-10-29 16:26:05 -05:00
Mert Tunç
ce6f833be4
fix(kafka-setup): Don't set truststore pass for PEM files ( #8656 )
...
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-10-26 17:06:37 -05:00
Xuelei Li
15f7a12c5a
fix(kafka-setup): remove dependency confluent docker utils ( #8715 )
2023-08-25 11:27:26 -05:00
david-leifker
655914841b
fix(docker): misc docker fixes ( #8677 )
2023-08-22 10:38:08 +05:30
david-leifker
40caf35812
feat(datahub-ingestion): refactor datahub ingestion slim images ( #8515 )
2023-08-17 10:40:17 +05:30
Harshal Sheth
2a3f6c42d4
ci: workarounds for pyyaml installation ( #8435 )
2023-07-17 15:26:43 -07:00
david-leifker
8f9a23fb2e
fix(kafka-setup): bump kafka version ( #8245 )
2023-06-15 12:30:04 -05:00
david-leifker
cd05f5b174
feat(schema-registry): replace confluent schema registry ( #7930 )
...
Co-authored-by: Pedro Silva <pedro@acryl.io>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: Ryan Holstien <ryan@acryl.io>
2023-05-01 13:18:41 -05:00
Jinlin Yang
a3a8107b92
bug(7882): run kafka-configs.sh on DataHubUpgradeHistory_v1 to make sure the retention.ms is set to infinite ( #7883 )
2023-04-21 18:31:51 -05:00
Kevin Meyer
97027fecce
fix(snakeyaml): cve-2022-1471 upgrade ( #7795 )
2023-04-11 15:17:21 -05:00
Kirill Popov
10d389f895
fix(kafka-setup): configure sasl.mechanism in case SASL_PLAINTEXT ( #7447 )
2023-02-28 16:07:27 -08:00
david-leifker
1df806d177
chore(versions): bump versions ( #7358 )
2023-02-20 11:32:05 +05:30
david-leifker
267472ccbb
gradle(development): add additional commands for development ( #7321 )
2023-02-16 10:41:42 -06:00
david-leifker
b4b3a39829
fix(system-update): fixes system-update with more than 1 partition ( #7302 )
2023-02-09 18:54:20 -06:00
david-leifker
d557fd65ff
fix(elasticsearch): fix orphan index clean up pattern, consistent top… ( #7242 )
2023-02-03 07:09:19 -06:00
david-leifker
39920bb00f
feat(elasticsearch): Elasticsearch improvements ( #6894 )
2023-01-31 18:44:37 -06:00
Peter Szalai
8a2230aea4
fix(quickstart): adding back kafka-setup ( #7181 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2023-01-31 00:34:36 +01:00
Pedro Silva
5db3a1f1f8
fix(kafka-setup): Make topic name consistent with other images ( #7103 )
2023-01-24 10:48:23 -08:00
Pedro Silva
ae2d781359
fix(kafka-setup): Remove reference to non-existing topic ( #7019 )
2023-01-12 07:25:17 -08:00
Pedro Silva
2fe9e8d962
fix(kafka-setup): Make kafka-setup run with multiple threads ( #6970 )
2023-01-09 12:27:00 +00:00
david-leifker
122c024bab
refactor(gradle): move the local docker registry to common location ( #6881 )
2022-12-29 15:08:36 +05:30
david-leifker
a5b5abf270
fix(kafka): datahub-upgrade job ( #6864 )
2022-12-27 12:35:48 -06:00
david-leifker
ecc01b9a46
refactor(restli-mce-consumer) ( #6744 )
...
* fix(security): commons-text in frontend
* refactor(restli): set threads based on cpu cores
feat(mce-consumers): hit local restli endpoint
* testing docker build
* Add retry configuration options for entity client
* Kafka debugging
* fix(kafka-setup): parallelize topic creation
* Adjust docker build
* Docker build updates
* WIP
* fix(lint): metadata-ingestion lint
* fix(gradle-docker): fix docker frontend dep
* fix(elastic): fix race condition between gms and mae for index creation
* Revert "fix(elastic): fix race condition between gms and mae for index creation"
This reverts commit 9629d12c3bdb3c0dab87604d409ca4c642c9c6d3.
* fix(test): fix datahub frontend test for clean/test cycle
* fix(test): datahub-frontend missing assets in test
* fix(security): set protobuf lib datahub-upgrade & mce/mae-consumer
* gitingore update
* fix(docker): remove platform on docker base image, set by buildx
* refactor(kafka-producer): update kafka producer tracking/logging
* updates per PR feedback
* Add documentation around mce standalone consumer
Kafka consumer concurrency to follow thread count for restli & sql connection pool
Co-authored-by: leifker <dleifker@gmail.com>
Co-authored-by: Pedro Silva <pedro@acryl.io>
2022-12-26 16:09:08 +00:00
david-leifker
637b540fa6
fix(kafka-setup): fix return code check ( #6782 )
...
* fix(kafka-setup): parallelize topic creation
* Remove -setup from docker compose (not services)
2022-12-16 13:39:18 -06:00
david-leifker
cca3639848
Optimize kafka setup ( #6778 )
...
* fix(kafka-setup): parallelize topic creation
2022-12-15 20:09:29 -06:00
Pedro Silva
c93bdc5e39
fix(setup): Bump setup images to alpine 3.14 with arch based on machine OS. ( #6612 )
...
* fix(setup): Bump setup images to alpine 3.14 with arch based on machine OS.
2022-12-09 09:49:24 -06:00
Parham Ghazanfari
269342bec0
feat(kafka-setup): Added support for MSK IAM authentication. ( #6435 )
2022-11-22 15:37:24 -06:00
Pedro Silva
164bc1aa53
Revert "chore(setup): change defaults for partitions ( #6074 )" ( #6086 )
2022-09-29 15:44:32 +05:30
Aseem Bansal
4cf635e16e
chore(setup): change defaults for partitions ( #6074 )
2022-09-28 15:04:35 +05:30
Pedro Silva
6232447ecf
fix(kafka-setup) Bump kafka version to existing version ( #5995 )
2022-09-20 14:14:17 +01:00
Pedro Silva
12f462e82b
fix(docker): Bumps JRE 11 to latest ( #5875 )
2022-09-08 12:44:28 -05:00
Pedro Silva
7d0f5435c8
feat(docker): Update Dockerfiles to use java 11 runtime ( #5853 )
2022-09-08 17:39:23 +05:30
Pedro Silva
12eb2c6240
feat(kafka) Adds SASL SSL support in kafka setup docker image ( #5697 )
2022-08-22 16:01:10 -07:00
Shirshanka Das
9d79fd3767
fix(docker): fix kafka-setup command to support same capabilities as previous ( #5428 )
2022-07-18 13:25:17 -07:00
Shirshanka Das
024797df0d
feat(quickstart): moving to official confluent images for m1 ( #5416 )
2022-07-17 18:59:09 -07:00
abiwill
7bbac5ef4d
feat(kafka-setup): add options for sasl_plaintext ( #5385 )
...
allow sasl_plaintext options using environment variables
2022-07-13 13:47:23 -07:00
Dexter Lee
93145d1591
fix(Kafka-setup): Make sure it doesn't fail when the new envs are not set ( #5168 )
2022-06-14 10:29:24 -07:00
chen4119
3c32ac7916
fix(kafka-setup): Check if keystore/truststore location env variables are set ( #4924 )
...
* OIDC discovery URL will not have none as auth method
* Fix code style
* fix compilation error
* add keystore/truststore type env variables
* check keystore/truststore location is set
Co-authored-by: Dexter Lee <dexter@acryl.io>
2022-05-16 13:51:19 -07:00
chen4119
a0e7262b00
fix(kafka-setup): Add ssl.keystore.type and ssl.truststore.type ( #4923 )
2022-05-16 10:22:55 -07:00
John Joyce
87c5ad385c
Fix iss #4683 ( #4697 )
2022-04-19 15:22:49 -07:00
John Joyce
c69310522b
feat(metadata service): Introducing Platform Events ( #4477 )
2022-03-29 18:32:04 -07:00
Tamas Nemeth
111d6d3520
fix(docker): alpine based multi-platform docker build for kafka-setup ( #3991 )
2022-01-28 16:25:57 -08:00
Tamas Nemeth
d41c5eba35
feat(docker): add multiplatform docker support for arm64 (m1) ( #3537 )
2021-11-09 11:50:06 -08:00
Dexter Lee
65d6c474f6
fix(docker): upgrade base image version ( #3072 )
2021-08-10 22:22:36 -07:00
John Joyce
352a0abf8d
Introducing TimeSeries Aspects + Dataset Profile (Stats) Aspect ( #2983 )
...
Co-authored-by: Dexter Lee <dexter@acryl.io>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2021-07-30 17:41:03 -07:00
G-nther
634dde5cfb
fix(analytics): use seperate env variable for tracking topic in MAE-Consumer ( #2545 )
2021-05-12 17:53:40 -07:00
