david-leifker
cd05f5b174
feat(schema-registry): replace confluent schema registry ( #7930 )
...
Co-authored-by: Pedro Silva <pedro@acryl.io>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: Ryan Holstien <ryan@acryl.io>
2023-05-01 13:18:41 -05:00
Kevin Meyer
97027fecce
fix(snakeyaml): cve-2022-1471 upgrade ( #7795 )
2023-04-11 15:17:21 -05:00
david-leifker
571970cf62
Dockerize updates ( #7387 )
2023-02-22 15:43:11 +05:30
david-leifker
bd11575d5f
chore(version): additional version bumps & suppressions ( #7382 )
2023-02-20 14:39:27 -06:00
david-leifker
39920bb00f
feat(elasticsearch): Elasticsearch improvements ( #6894 )
2023-01-31 18:44:37 -06:00
david-leifker
9277101a5f
config(quickstart): enable auto-reindex for quickstart ( #6983 )
2023-01-09 17:58:29 -06:00
david-leifker
ecc01b9a46
refactor(restli-mce-consumer) ( #6744 )
...
* fix(security): commons-text in frontend
* refactor(restli): set threads based on cpu cores
feat(mce-consumers): hit local restli endpoint
* testing docker build
* Add retry configuration options for entity client
* Kafka debugging
* fix(kafka-setup): parallelize topic creation
* Adjust docker build
* Docker build updates
* WIP
* fix(lint): metadata-ingestion lint
* fix(gradle-docker): fix docker frontend dep
* fix(elastic): fix race condition between gms and mae for index creation
* Revert "fix(elastic): fix race condition between gms and mae for index creation"
This reverts commit 9629d12c3bdb3c0dab87604d409ca4c642c9c6d3.
* fix(test): fix datahub frontend test for clean/test cycle
* fix(test): datahub-frontend missing assets in test
* fix(security): set protobuf lib datahub-upgrade & mce/mae-consumer
* gitingore update
* fix(docker): remove platform on docker base image, set by buildx
* refactor(kafka-producer): update kafka producer tracking/logging
* updates per PR feedback
* Add documentation around mce standalone consumer
Kafka consumer concurrency to follow thread count for restli & sql connection pool
Co-authored-by: leifker <dleifker@gmail.com>
Co-authored-by: Pedro Silva <pedro@acryl.io>
2022-12-26 16:09:08 +00:00
Pedro Silva
c93bdc5e39
fix(setup): Bump setup images to alpine 3.14 with arch based on machine OS. ( #6612 )
...
* fix(setup): Bump setup images to alpine 3.14 with arch based on machine OS.
2022-12-09 09:49:24 -06:00
mohdsiddique
f2a83f3074
feat(gms): Pluggable Authentication & Authorization Framework ( #6634 )
2022-12-06 10:22:41 -08:00
syedzoherer
ffea9302d9
Add AWS Postgres Iam Auth jar to GMS ( #6371 )
...
* Add AWS Postgres Iam Auth jar to GMS
* Added IAM support for Postgres
* Setting IAM support for Postgres as false by default
* format fix
Co-authored-by: syed.javed <syed.javed@precisely.com>
2022-12-05 13:07:26 -06:00
Tim Costa
6e31754594
fix: remove set -x from start script ( #6589 )
...
Co-authored-by: Tim Costa <timcosta@amazon.com>
2022-12-01 20:33:54 -08:00
david-leifker
ef9a280ba4
fix(verions): Update opentelemetry and updates from pr-5239 ( #6563 )
2022-11-29 10:59:38 -06:00
david-leifker
a2dc229c62
fix(tests): Misc updates for tests, auth log level, and quickstart ( #6491 )
2022-11-29 08:44:55 -08:00
Peter Szalai
f77117a9e0
fix(envs): remove DATASET_ENABLE_SCSI stale env var ( #6546 )
2022-11-24 21:34:53 +05:30
syedzoherer
5010e0cf69
Added I AM auth for Opensearch ( #6370 )
...
* Added I AM auth for Opensearch
* Code refactor and removed default Region for AWS cred.
* Added missing opensearch region exception
* Update RestHighLevelClientFactory.java
* Fixed stylecheck
* Update RestHighLevelClientFactory.java
* Update RestHighLevelClientFactory.java
Co-authored-by: syed.javed <syed.javed@precisely.com>
2022-11-22 10:49:28 -06:00
david-leifker
33fd876421
feat(elasticsearch): Updates to elasticsearch configuration, dao, and tests ( #6269 )
2022-11-15 18:03:11 -08:00
Shirshanka Das
48b46971b8
feat(ingest): remove hardcoded env variable default for cli version ( #6075 )
2022-10-02 16:46:34 -07:00
leifker
203a6ff57b
refactor(java11) - convert most modules to java 11 ( #5836 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-09-25 08:39:22 -07:00
Pedro Silva
12f462e82b
fix(docker): Bumps JRE 11 to latest ( #5875 )
2022-09-08 12:44:28 -05:00
Pedro Silva
7d0f5435c8
feat(docker): Update Dockerfiles to use java 11 runtime ( #5853 )
2022-09-08 17:39:23 +05:30
John Joyce
d15518f0d9
fix(browse): Fixing browse path to remove requirement for simple name suffix ( #5634 )
2022-09-07 13:32:38 -07:00
Harshal Sheth
762bcbb168
chore(docker): make curl/wget commands quiet in docker ( #5819 )
2022-09-04 22:39:08 -07:00
mohdsiddique
2b4f9400ca
fix(GMS): fix no such classes directory file:///etc/datahub/plugins/auth/resources ( #5743 )
2022-08-29 12:08:18 -07:00
Chris Collins
d64cca5c6b
feat(retention) Enable retention and set max versions for executionRequests ( #5704 )
2022-08-23 16:25:18 -07:00
Aseem Bansal
4f35a6c43d
fix(gms): missing directory for gms ( #5570 )
2022-08-04 22:09:30 +05:30
Aseem Bansal
f984585990
fix(gms): ensure directory is present ( #5568 )
2022-08-04 18:58:06 +05:30
Gabe Lyons
f06b8eb4e8
(chore): upgrading ingestion to 0.8.42 ( #5562 )
2022-08-04 17:06:16 +05:30
John Joyce
4e0da5de29
fix(docker): Fixing dev docker and quickstart ( #5550 )
2022-08-02 15:02:01 -07:00
Salih Can
0ded02544c
fix(analytics-tab) - fix analytics tab config variable for gms ( #5529 )
2022-08-02 17:05:04 +05:30
mohdsiddique
c31e380489
feat(apache-ranger): Apache Ranger Authorizer support in datahub-gms ( #4999 )
2022-08-01 09:47:08 -07:00
Aseem Bansal
36f3ab3fa3
feat(quickstart,docs): updates for v0.8.41 ( #5409 )
2022-07-15 21:32:32 +05:30
Aseem Bansal
40452b3cc1
fix(docs,quickstart): release related changes for 0.8.40 ( #5299 )
2022-06-30 17:21:12 +05:30
Aseem Bansal
1adcc994f3
feat(ingest): remove need for sink block in UI based ingestion ( #5208 )
2022-06-23 15:22:40 +05:30
John Joyce
e2f1da00ff
refactor(configs): Simplify Kafka Topic name configurations + docs ( #5198 )
2022-06-17 12:15:51 -07:00
John Joyce
c4650356fa
Chore: Bump Default UI Ingestion Version ( #5145 )
2022-06-10 09:05:24 +05:30
RyanHolstien
cbda3f5f29
feat(release): update CLI version ( #4962 )
...
* feat(release): update CLI version
* add typscript
2022-05-19 18:13:13 -07:00
RyanHolstien
8fbc61577c
feat: updates for 0.8.35 ( #4960 )
2022-05-19 22:55:56 +05:30
RyanHolstien
d70df06c21
chore(jetty): upgrade jetty to 9.4.46 for CVE ( #4857 )
2022-05-06 14:18:20 -07:00
RyanHolstien
f1151cb478
Revert "fix(jetty): upgrade jetty dependency for CVE ( #4838 )" ( #4844 )
...
This reverts commit 1697bd0641bac248a72ed289bbbcf17c20b2f5a4.
2022-05-05 20:01:50 -07:00
RyanHolstien
1697bd0641
fix(jetty): upgrade jetty dependency for CVE ( #4838 )
2022-05-05 18:01:02 -07:00
Aseem Bansal
58fbf9fc89
feat: updates for 0.8.34 ( #4829 )
2022-05-05 12:57:06 +02:00
Eddie (Xiao Di) Li
01a5b13a7a
feat(Cassandra): Add Cassandra implementation of EntityService ( #3286 )
2022-04-25 17:29:24 -07:00
Aseem Bansal
32349bf405
chore: update default cli for managed ingestion ( #4581 )
2022-04-05 15:33:13 -07:00
John Joyce
95d6bcd1a0
exposing kafka consumer concurrency ( #4536 )
2022-04-04 14:57:34 -07:00
zhoxie-cisco
14df3cf165
perf(docker): datahub-gms - add jetty configuration xml ( #4435 )
...
* Add jetty cofig xml to change requestHeaderSize.
* Add jetty config in docker-compose.dev.yml
Co-authored-by: zhoxie-cisco <xiezhongjie1109@gmail.com>
2022-03-30 10:10:47 -07:00
John Joyce
c69310522b
feat(metadata service): Introducing Platform Events ( #4477 )
2022-03-29 18:32:04 -07:00
Kevin Neville
d8e6f890a9
fix: Replace old repository link with new link ( #4446 )
2022-03-18 14:12:19 -07:00
Fabiano V. Santos
c95715448c
fix(docker): use exec form to start container main process ( #4245 )
2022-03-01 21:49:43 -08:00
Aseem Bansal
ec86e71edc
chore(managed ingestion): add variables for default val, update vals ( #4186 )
2022-02-25 16:33:59 -08:00
HuYueeer
3a0fe44344
feat(search): supporting chinese glossaryterm full text retrieval( #3914 ) ( #3956 )
...
* feat(search): supporting chinese glossaryterm full text retrieval(#3914 )
* refactor(search): modify mainTokenizer to appropriate position(#3914 )
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-02-24 17:11:43 -08:00