85 Commits

Author SHA1 Message Date
david-leifker
cd05f5b174
feat(schema-registry): replace confluent schema registry (#7930)
Co-authored-by: Pedro Silva <pedro@acryl.io>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: Ryan Holstien <ryan@acryl.io>
2023-05-01 13:18:41 -05:00
Kevin Meyer
97027fecce
fix(snakeyaml): cve-2022-1471 upgrade (#7795) 2023-04-11 15:17:21 -05:00
david-leifker
571970cf62
Dockerize updates (#7387) 2023-02-22 15:43:11 +05:30
david-leifker
bd11575d5f
chore(version): additional version bumps & suppressions (#7382) 2023-02-20 14:39:27 -06:00
david-leifker
39920bb00f
feat(elasticsearch): Elasticsearch improvements (#6894) 2023-01-31 18:44:37 -06:00
david-leifker
9277101a5f
config(quickstart): enable auto-reindex for quickstart (#6983) 2023-01-09 17:58:29 -06:00
david-leifker
ecc01b9a46
refactor(restli-mce-consumer) (#6744)
* fix(security): commons-text in frontend

* refactor(restli): set threads based on cpu cores
feat(mce-consumers): hit local restli endpoint

* testing docker build

* Add retry configuration options for entity client

* Kafka debugging

* fix(kafka-setup): parallelize topic creation

* Adjust docker build

* Docker build updates

* WIP

* fix(lint): metadata-ingestion lint

* fix(gradle-docker): fix docker frontend dep

* fix(elastic): fix race condition between gms and mae for index creation

* Revert "fix(elastic): fix race condition between gms and mae for index creation"

This reverts commit 9629d12c3bdb3c0dab87604d409ca4c642c9c6d3.

* fix(test): fix datahub frontend test for clean/test cycle

* fix(test): datahub-frontend missing assets in test

* fix(security): set protobuf lib datahub-upgrade & mce/mae-consumer

* gitingore update

* fix(docker): remove platform on docker base image, set by buildx

* refactor(kafka-producer): update kafka producer tracking/logging

* updates per PR feedback

* Add documentation around mce standalone consumer
Kafka consumer concurrency to follow thread count for restli & sql connection pool

Co-authored-by: leifker <dleifker@gmail.com>
Co-authored-by: Pedro Silva <pedro@acryl.io>
2022-12-26 16:09:08 +00:00
Pedro Silva
c93bdc5e39
fix(setup): Bump setup images to alpine 3.14 with arch based on machine OS. (#6612)
* fix(setup): Bump setup images to alpine 3.14 with arch based on machine OS.
2022-12-09 09:49:24 -06:00
mohdsiddique
f2a83f3074
feat(gms): Pluggable Authentication & Authorization Framework (#6634) 2022-12-06 10:22:41 -08:00
syedzoherer
ffea9302d9
Add AWS Postgres Iam Auth jar to GMS (#6371)
* Add AWS Postgres Iam Auth jar to GMS

* Added IAM support for Postgres

* Setting IAM support for Postgres as false by default

* format fix

Co-authored-by: syed.javed <syed.javed@precisely.com>
2022-12-05 13:07:26 -06:00
Tim Costa
6e31754594
fix: remove set -x from start script (#6589)
Co-authored-by: Tim Costa <timcosta@amazon.com>
2022-12-01 20:33:54 -08:00
david-leifker
ef9a280ba4
fix(verions): Update opentelemetry and updates from pr-5239 (#6563) 2022-11-29 10:59:38 -06:00
david-leifker
a2dc229c62
fix(tests): Misc updates for tests, auth log level, and quickstart (#6491) 2022-11-29 08:44:55 -08:00
Peter Szalai
f77117a9e0
fix(envs): remove DATASET_ENABLE_SCSI stale env var (#6546) 2022-11-24 21:34:53 +05:30
syedzoherer
5010e0cf69
Added I AM auth for Opensearch (#6370)
* Added I AM auth for Opensearch

* Code refactor and removed default Region for AWS cred.

* Added missing opensearch region exception

* Update RestHighLevelClientFactory.java

* Fixed stylecheck

* Update RestHighLevelClientFactory.java

* Update RestHighLevelClientFactory.java

Co-authored-by: syed.javed <syed.javed@precisely.com>
2022-11-22 10:49:28 -06:00
david-leifker
33fd876421
feat(elasticsearch): Updates to elasticsearch configuration, dao, and tests (#6269) 2022-11-15 18:03:11 -08:00
Shirshanka Das
48b46971b8
feat(ingest): remove hardcoded env variable default for cli version (#6075) 2022-10-02 16:46:34 -07:00
leifker
203a6ff57b
refactor(java11) - convert most modules to java 11 (#5836)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-09-25 08:39:22 -07:00
Pedro Silva
12f462e82b
fix(docker): Bumps JRE 11 to latest (#5875) 2022-09-08 12:44:28 -05:00
Pedro Silva
7d0f5435c8
feat(docker): Update Dockerfiles to use java 11 runtime (#5853) 2022-09-08 17:39:23 +05:30
John Joyce
d15518f0d9
fix(browse): Fixing browse path to remove requirement for simple name suffix (#5634) 2022-09-07 13:32:38 -07:00
Harshal Sheth
762bcbb168
chore(docker): make curl/wget commands quiet in docker (#5819) 2022-09-04 22:39:08 -07:00
mohdsiddique
2b4f9400ca
fix(GMS): fix no such classes directory file:///etc/datahub/plugins/auth/resources (#5743) 2022-08-29 12:08:18 -07:00
Chris Collins
d64cca5c6b
feat(retention) Enable retention and set max versions for executionRequests (#5704) 2022-08-23 16:25:18 -07:00
Aseem Bansal
4f35a6c43d
fix(gms): missing directory for gms (#5570) 2022-08-04 22:09:30 +05:30
Aseem Bansal
f984585990
fix(gms): ensure directory is present (#5568) 2022-08-04 18:58:06 +05:30
Gabe Lyons
f06b8eb4e8
(chore): upgrading ingestion to 0.8.42 (#5562) 2022-08-04 17:06:16 +05:30
John Joyce
4e0da5de29
fix(docker): Fixing dev docker and quickstart (#5550) 2022-08-02 15:02:01 -07:00
Salih Can
0ded02544c
fix(analytics-tab) - fix analytics tab config variable for gms (#5529) 2022-08-02 17:05:04 +05:30
mohdsiddique
c31e380489
feat(apache-ranger): Apache Ranger Authorizer support in datahub-gms (#4999) 2022-08-01 09:47:08 -07:00
Aseem Bansal
36f3ab3fa3
feat(quickstart,docs): updates for v0.8.41 (#5409) 2022-07-15 21:32:32 +05:30
Aseem Bansal
40452b3cc1
fix(docs,quickstart): release related changes for 0.8.40 (#5299) 2022-06-30 17:21:12 +05:30
Aseem Bansal
1adcc994f3
feat(ingest): remove need for sink block in UI based ingestion (#5208) 2022-06-23 15:22:40 +05:30
John Joyce
e2f1da00ff
refactor(configs): Simplify Kafka Topic name configurations + docs (#5198) 2022-06-17 12:15:51 -07:00
John Joyce
c4650356fa
Chore: Bump Default UI Ingestion Version (#5145) 2022-06-10 09:05:24 +05:30
RyanHolstien
cbda3f5f29
feat(release): update CLI version (#4962)
* feat(release): update CLI version

* add typscript
2022-05-19 18:13:13 -07:00
RyanHolstien
8fbc61577c
feat: updates for 0.8.35 (#4960) 2022-05-19 22:55:56 +05:30
RyanHolstien
d70df06c21
chore(jetty): upgrade jetty to 9.4.46 for CVE (#4857) 2022-05-06 14:18:20 -07:00
RyanHolstien
f1151cb478
Revert "fix(jetty): upgrade jetty dependency for CVE (#4838)" (#4844)
This reverts commit 1697bd0641bac248a72ed289bbbcf17c20b2f5a4.
2022-05-05 20:01:50 -07:00
RyanHolstien
1697bd0641
fix(jetty): upgrade jetty dependency for CVE (#4838) 2022-05-05 18:01:02 -07:00
Aseem Bansal
58fbf9fc89
feat: updates for 0.8.34 (#4829) 2022-05-05 12:57:06 +02:00
Eddie (Xiao Di) Li
01a5b13a7a
feat(Cassandra): Add Cassandra implementation of EntityService (#3286) 2022-04-25 17:29:24 -07:00
Aseem Bansal
32349bf405
chore: update default cli for managed ingestion (#4581) 2022-04-05 15:33:13 -07:00
John Joyce
95d6bcd1a0
exposing kafka consumer concurrency (#4536) 2022-04-04 14:57:34 -07:00
zhoxie-cisco
14df3cf165
perf(docker): datahub-gms - add jetty configuration xml (#4435)
* Add jetty cofig xml to change requestHeaderSize.

* Add jetty config in docker-compose.dev.yml

Co-authored-by: zhoxie-cisco <xiezhongjie1109@gmail.com>
2022-03-30 10:10:47 -07:00
John Joyce
c69310522b
feat(metadata service): Introducing Platform Events (#4477) 2022-03-29 18:32:04 -07:00
Kevin Neville
d8e6f890a9
fix: Replace old repository link with new link (#4446) 2022-03-18 14:12:19 -07:00
Fabiano V. Santos
c95715448c
fix(docker): use exec form to start container main process (#4245) 2022-03-01 21:49:43 -08:00
Aseem Bansal
ec86e71edc
chore(managed ingestion): add variables for default val, update vals (#4186) 2022-02-25 16:33:59 -08:00
HuYueeer
3a0fe44344
feat(search): supporting chinese glossaryterm full text retrieval(#3914) (#3956)
* feat(search): supporting chinese glossaryterm full text retrieval(#3914)

* refactor(search): modify mainTokenizer to appropriate position(#3914)

Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-02-24 17:11:43 -08:00