david-leifker
637b540fa6
fix(kafka-setup): fix return code check ( #6782 )
...
* fix(kafka-setup): parallelize topic creation
* Remove -setup from docker compose (not services)
2022-12-16 13:39:18 -06:00
david-leifker
cca3639848
Optimize kafka setup ( #6778 )
...
* fix(kafka-setup): parallelize topic creation
2022-12-15 20:09:29 -06:00
Aseem Bansal
1350bb010c
docs(docker): add section for adding community images ( #6770 )
2022-12-15 15:26:31 -08:00
Harshal Sheth
8c14dfc617
ci: fix ingestion gradle retry ( #6752 )
2022-12-13 20:16:59 -05:00
Pedro Silva
c93bdc5e39
fix(setup): Bump setup images to alpine 3.14 with arch based on machine OS. ( #6612 )
...
* fix(setup): Bump setup images to alpine 3.14 with arch based on machine OS.
2022-12-09 09:49:24 -06:00
Harshal Sheth
ab24379def
build: add retries to gradle wrapper download in ingestion docker ( #6704 )
2022-12-08 22:37:29 -05:00
david-leifker
691f802a13
fix(security): version bump to latest minor python image ( #6694 )
2022-12-08 13:54:21 -05:00
Aseem Bansal
96150cfb10
fix(ci): revert confluent kafka in base image ( #6690 )
2022-12-08 13:54:13 -05:00
Aseem Bansal
a087a9fbb9
chore(ci): update base ingestion image requirements file ( #6687 )
2022-12-08 09:59:19 +05:30
John Joyce
15e9475efb
fix(docker): Fix datahub-frontend dockerfile ( #6670 )
2022-12-06 23:11:54 -08:00
mohdsiddique
b46d52dc0f
feat(gms): Enable auth-api publishing to maven ( #6671 )
2022-12-06 21:56:36 -08:00
mohdsiddique
f2a83f3074
feat(gms): Pluggable Authentication & Authorization Framework ( #6634 )
2022-12-06 10:22:41 -08:00
syedzoherer
ffea9302d9
Add AWS Postgres Iam Auth jar to GMS ( #6371 )
...
* Add AWS Postgres Iam Auth jar to GMS
* Added IAM support for Postgres
* Setting IAM support for Postgres as false by default
* format fix
Co-authored-by: syed.javed <syed.javed@precisely.com>
2022-12-05 13:07:26 -06:00
Shirshanka Das
155a68386a
docs(actions): slack, teams ( #6632 )
2022-12-04 13:27:52 -08:00
Shirshanka Das
4876fdd084
feat(quickstart): add support for env vars for Slack, Teams actions ( #6591 )
2022-12-03 23:00:50 -08:00
Pedro Silva
4f7b5ac5e6
feat(sql): Add SQL index on createdon field ( #6522 )
2022-12-02 09:13:47 +00:00
Tim Costa
6e31754594
fix: remove set -x from start script ( #6589 )
...
Co-authored-by: Tim Costa <timcosta@amazon.com>
2022-12-01 20:33:54 -08:00
Shirshanka Das
5937b35447
fix(actions): add missing datahub-gms-protocol env var ( #6593 )
2022-12-01 00:25:43 -08:00
david-leifker
ef9a280ba4
fix(verions): Update opentelemetry and updates from pr-5239 ( #6563 )
2022-11-29 10:59:38 -06:00
david-leifker
a2dc229c62
fix(tests): Misc updates for tests, auth log level, and quickstart ( #6491 )
2022-11-29 08:44:55 -08:00
Peter Szalai
f77117a9e0
fix(envs): remove DATASET_ENABLE_SCSI stale env var ( #6546 )
2022-11-24 21:34:53 +05:30
Parham Ghazanfari
269342bec0
feat(kafka-setup): Added support for MSK IAM authentication. ( #6435 )
2022-11-22 15:37:24 -06:00
Harshal Sheth
2cb1e6576d
fix(ingest): add alias for bigquery-beta ( #6521 )
2022-11-22 14:15:20 -05:00
syedzoherer
5010e0cf69
Added I AM auth for Opensearch ( #6370 )
...
* Added I AM auth for Opensearch
* Code refactor and removed default Region for AWS cred.
* Added missing opensearch region exception
* Update RestHighLevelClientFactory.java
* Fixed stylecheck
* Update RestHighLevelClientFactory.java
* Update RestHighLevelClientFactory.java
Co-authored-by: syed.javed <syed.javed@precisely.com>
2022-11-22 10:49:28 -06:00
Aseem Bansal
317f0b135b
fix(build): do not use neo4j on local ( #6501 )
2022-11-21 22:19:13 +05:30
david-leifker
33fd876421
feat(elasticsearch): Updates to elasticsearch configuration, dao, and tests ( #6269 )
2022-11-15 18:03:11 -08:00
skrydal
a274406126
fix(docker): Set proper variable expansion for JMX_OPTS and JAVA_OPTS in MAE docker ( #6378 )
...
image
2022-11-15 10:03:33 -08:00
Harshal Sheth
9c04c63813
docs(ingest): airflow - clarify docs around 1.x compat ( #6436 )
2022-11-14 21:30:42 -08:00
Fredrik Sannholm
9e86c6f953
fix(docker): install openjdk 11 in base ingest image ( #6365 )
2022-11-04 20:43:18 +05:30
djordje-mijatovic
9e6489f603
refactor(elastic-setup): Elasticsearch setup analytics ( #6291 )
2022-10-31 13:50:54 -07:00
Aseem Bansal
98eba90edc
fix(build): allow image tag via env, fix requirements ( #6237 )
2022-10-19 12:26:22 +05:30
Alexey Kravtsov
961efe9c33
feat(frontend): add custom ssl truststore settings ( #6090 )
2022-10-14 16:53:20 -07:00
Peter Szalai
396fd31ddc
fix(mae-consumer): use JAVA_TOOL_OPTIONS instead of JDK_JAVA_OPTIONS ( #6114 )
2022-10-04 09:07:44 -07:00
Shirshanka Das
e688dd554a
chore(deps): upgrade neo4j to 4.4.x ( #6101 )
2022-10-02 23:16:45 -07:00
Shirshanka Das
48b46971b8
feat(ingest): remove hardcoded env variable default for cli version ( #6075 )
2022-10-02 16:46:34 -07:00
Tomáš Kubín
596d48448e
fix(elasticsearch) Analytics indices creation on AWS ES ( #5502 )
...
* refactor(elasticsearch-setup-job): create-indices.sh readability
The script contains many copy-pasting and is not easy to follow.
Add comments, extract commonly used operations into functions, unify approaches.
* fix(elasticsearch-setup-job): AWS indices creation
Fix the issue where Amazon OpenSearch (AWS ES) indices are incorrectly initialised
and the Analytics screen shows errors only.
* feat(elasticsearch-setup-job): configuration hint
mention USE_AWS_ELASTICSEARCH env value if it seems it's set the wrong way
* fix(elasticsearch-setup-job): silent curl
* fix(elasticsearch-setup-job): better USE_AWS_ELASTICSEARCH hint
* docs(elasticsearch-setup-job): index dropping explained
- more comments
- more defensive approach
- index file renamed
* fix(elasticsearch-setup-job): script fixes
* merge(elasticsearch-setup-job): merging in PR #5937
* merge(elasticsearch-setup-job): merging in PR #5963
* merge(elasticsearch-setup-job): merging in PR #5975
Co-authored-by: Pedro Silva <pedro@acryl.io>
2022-09-29 14:10:51 +01:00
Patrick Marx
9e7bd1a84f
fix(mae-consumer): fix regression on base64 encoding ( #6061 )
...
Pull request #5827 introduced a regression by removing coreutils
from the mae-consumer Dockerfile (coreutils was added in #3723 ).
This broke the base64 call in the startup script s.th. the Elasticsearch
auth header will not be correctly set when username and password are
provided.
To make sure that the startup script fails on these errors in the
future, set "-euo pipefail" which lets the bash script fail on errors
and unset variables.
Also refactor the startup script to make it more stable and readable.
Co-authored-by: Pedro Silva <pedro@acryl.io>
2022-09-29 12:13:45 +01:00
Pedro Silva
164bc1aa53
Revert "chore(setup): change defaults for partitions ( #6074 )" ( #6086 )
2022-09-29 15:44:32 +05:30
Pedro Silva
f83eb6f759
fix(elastic-setup) Fixing env var logic ( #6079 )
2022-09-29 10:53:45 +05:30
Aseem Bansal
4cf635e16e
chore(setup): change defaults for partitions ( #6074 )
2022-09-28 15:04:35 +05:30
GYUHOON KIM
b45d5eb56a
fix(elasticsearch_index): create datahub_usage_event index where datahub_analytics_enabled set to false ( #5974 )
2022-09-27 10:20:31 -07:00
leifker
203a6ff57b
refactor(java11) - convert most modules to java 11 ( #5836 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-09-25 08:39:22 -07:00
Pedro Silva
6232447ecf
fix(kafka-setup) Bump kafka version to existing version ( #5995 )
2022-09-20 14:14:17 +01:00
Shirshanka Das
6f4835688e
fix(quickstart): elasticsearch-setup script fails on curl ( #5975 )
2022-09-18 17:05:13 -07:00
Bogdan Antoniu
a86c966c91
feat(elasticsearch-setup): Add insecure option for curl
...
Co-authored-by: EXTERNAL Antoniu Bogdan (Fortech, EB-DB/ENG-Ku) <external.Bogdan.Antoniu@ro.bosch.com>
Co-authored-by: RyanHolstien <RyanHolstien@users.noreply.github.com>
2022-09-16 11:22:50 -05:00
Aseem Bansal
a4720f8e2e
feat(elastic-setup): add better error handling ( #5963 )
2022-09-16 17:34:06 +05:30
firas omrane
c606abdb40
fix(docker) Add platform to docker-compose command ( #5683 )
2022-09-14 17:56:42 +05:30
Aseem Bansal
f669ba6f14
feat(elastic-setup): more verbose logging ( #5937 )
2022-09-14 17:35:26 +05:30
Harshal Sheth
aa93a34678
fix(docker): skip zoneinfo backport on newer python versions ( #5912 )
2022-09-13 11:37:55 -07:00
Peter Szalai
980e1819b3
fix(dev-docker): set right context for frontend dev build ( #5885 )
2022-09-09 09:57:39 -05:00
