Shirshanka Das
5937b35447
fix(actions): add missing datahub-gms-protocol env var ( #6593 )
2022-12-01 00:25:43 -08:00
david-leifker
ef9a280ba4
fix(verions): Update opentelemetry and updates from pr-5239 ( #6563 )
2022-11-29 10:59:38 -06:00
david-leifker
a2dc229c62
fix(tests): Misc updates for tests, auth log level, and quickstart ( #6491 )
2022-11-29 08:44:55 -08:00
Peter Szalai
f77117a9e0
fix(envs): remove DATASET_ENABLE_SCSI stale env var ( #6546 )
2022-11-24 21:34:53 +05:30
Parham Ghazanfari
269342bec0
feat(kafka-setup): Added support for MSK IAM authentication. ( #6435 )
2022-11-22 15:37:24 -06:00
Harshal Sheth
2cb1e6576d
fix(ingest): add alias for bigquery-beta ( #6521 )
2022-11-22 14:15:20 -05:00
syedzoherer
5010e0cf69
Added I AM auth for Opensearch ( #6370 )
...
* Added I AM auth for Opensearch
* Code refactor and removed default Region for AWS cred.
* Added missing opensearch region exception
* Update RestHighLevelClientFactory.java
* Fixed stylecheck
* Update RestHighLevelClientFactory.java
* Update RestHighLevelClientFactory.java
Co-authored-by: syed.javed <syed.javed@precisely.com>
2022-11-22 10:49:28 -06:00
Aseem Bansal
317f0b135b
fix(build): do not use neo4j on local ( #6501 )
2022-11-21 22:19:13 +05:30
david-leifker
33fd876421
feat(elasticsearch): Updates to elasticsearch configuration, dao, and tests ( #6269 )
2022-11-15 18:03:11 -08:00
skrydal
a274406126
fix(docker): Set proper variable expansion for JMX_OPTS and JAVA_OPTS in MAE docker ( #6378 )
...
image
2022-11-15 10:03:33 -08:00
Harshal Sheth
9c04c63813
docs(ingest): airflow - clarify docs around 1.x compat ( #6436 )
2022-11-14 21:30:42 -08:00
Fredrik Sannholm
9e86c6f953
fix(docker): install openjdk 11 in base ingest image ( #6365 )
2022-11-04 20:43:18 +05:30
djordje-mijatovic
9e6489f603
refactor(elastic-setup): Elasticsearch setup analytics ( #6291 )
2022-10-31 13:50:54 -07:00
Aseem Bansal
98eba90edc
fix(build): allow image tag via env, fix requirements ( #6237 )
2022-10-19 12:26:22 +05:30
Alexey Kravtsov
961efe9c33
feat(frontend): add custom ssl truststore settings ( #6090 )
2022-10-14 16:53:20 -07:00
Peter Szalai
396fd31ddc
fix(mae-consumer): use JAVA_TOOL_OPTIONS instead of JDK_JAVA_OPTIONS ( #6114 )
2022-10-04 09:07:44 -07:00
Shirshanka Das
e688dd554a
chore(deps): upgrade neo4j to 4.4.x ( #6101 )
2022-10-02 23:16:45 -07:00
Shirshanka Das
48b46971b8
feat(ingest): remove hardcoded env variable default for cli version ( #6075 )
2022-10-02 16:46:34 -07:00
Tomáš Kubín
596d48448e
fix(elasticsearch) Analytics indices creation on AWS ES ( #5502 )
...
* refactor(elasticsearch-setup-job): create-indices.sh readability
The script contains many copy-pasting and is not easy to follow.
Add comments, extract commonly used operations into functions, unify approaches.
* fix(elasticsearch-setup-job): AWS indices creation
Fix the issue where Amazon OpenSearch (AWS ES) indices are incorrectly initialised
and the Analytics screen shows errors only.
* feat(elasticsearch-setup-job): configuration hint
mention USE_AWS_ELASTICSEARCH env value if it seems it's set the wrong way
* fix(elasticsearch-setup-job): silent curl
* fix(elasticsearch-setup-job): better USE_AWS_ELASTICSEARCH hint
* docs(elasticsearch-setup-job): index dropping explained
- more comments
- more defensive approach
- index file renamed
* fix(elasticsearch-setup-job): script fixes
* merge(elasticsearch-setup-job): merging in PR #5937
* merge(elasticsearch-setup-job): merging in PR #5963
* merge(elasticsearch-setup-job): merging in PR #5975
Co-authored-by: Pedro Silva <pedro@acryl.io>
2022-09-29 14:10:51 +01:00
Patrick Marx
9e7bd1a84f
fix(mae-consumer): fix regression on base64 encoding ( #6061 )
...
Pull request #5827 introduced a regression by removing coreutils
from the mae-consumer Dockerfile (coreutils was added in #3723 ).
This broke the base64 call in the startup script s.th. the Elasticsearch
auth header will not be correctly set when username and password are
provided.
To make sure that the startup script fails on these errors in the
future, set "-euo pipefail" which lets the bash script fail on errors
and unset variables.
Also refactor the startup script to make it more stable and readable.
Co-authored-by: Pedro Silva <pedro@acryl.io>
2022-09-29 12:13:45 +01:00
Pedro Silva
164bc1aa53
Revert "chore(setup): change defaults for partitions ( #6074 )" ( #6086 )
2022-09-29 15:44:32 +05:30
Pedro Silva
f83eb6f759
fix(elastic-setup) Fixing env var logic ( #6079 )
2022-09-29 10:53:45 +05:30
Aseem Bansal
4cf635e16e
chore(setup): change defaults for partitions ( #6074 )
2022-09-28 15:04:35 +05:30
GYUHOON KIM
b45d5eb56a
fix(elasticsearch_index): create datahub_usage_event index where datahub_analytics_enabled set to false ( #5974 )
2022-09-27 10:20:31 -07:00
leifker
203a6ff57b
refactor(java11) - convert most modules to java 11 ( #5836 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-09-25 08:39:22 -07:00
Pedro Silva
6232447ecf
fix(kafka-setup) Bump kafka version to existing version ( #5995 )
2022-09-20 14:14:17 +01:00
Shirshanka Das
6f4835688e
fix(quickstart): elasticsearch-setup script fails on curl ( #5975 )
2022-09-18 17:05:13 -07:00
Bogdan Antoniu
a86c966c91
feat(elasticsearch-setup): Add insecure option for curl
...
Co-authored-by: EXTERNAL Antoniu Bogdan (Fortech, EB-DB/ENG-Ku) <external.Bogdan.Antoniu@ro.bosch.com>
Co-authored-by: RyanHolstien <RyanHolstien@users.noreply.github.com>
2022-09-16 11:22:50 -05:00
Aseem Bansal
a4720f8e2e
feat(elastic-setup): add better error handling ( #5963 )
2022-09-16 17:34:06 +05:30
firas omrane
c606abdb40
fix(docker) Add platform to docker-compose command ( #5683 )
2022-09-14 17:56:42 +05:30
Aseem Bansal
f669ba6f14
feat(elastic-setup): more verbose logging ( #5937 )
2022-09-14 17:35:26 +05:30
Harshal Sheth
aa93a34678
fix(docker): skip zoneinfo backport on newer python versions ( #5912 )
2022-09-13 11:37:55 -07:00
Peter Szalai
980e1819b3
fix(dev-docker): set right context for frontend dev build ( #5885 )
2022-09-09 09:57:39 -05:00
Pedro Silva
12f462e82b
fix(docker): Bumps JRE 11 to latest ( #5875 )
2022-09-08 12:44:28 -05:00
Pedro Silva
7d0f5435c8
feat(docker): Update Dockerfiles to use java 11 runtime ( #5853 )
2022-09-08 17:39:23 +05:30
Harshal Sheth
6f09f1025e
ci(ingest): test with python 3.10 ( #5863 )
2022-09-07 17:08:49 -07:00
John Joyce
d15518f0d9
fix(browse): Fixing browse path to remove requirement for simple name suffix ( #5634 )
2022-09-07 13:32:38 -07:00
Pedro Silva
42a847c8d1
feat(docker) Adds Sasl support to base ingestion image ( #5855 )
...
* feat(docker) Adds Sasl support to base ingestion image
* Add oracle changes
2022-09-07 22:21:06 +05:30
Pedro Silva
20138a32e5
fix(standalone-consumers): Exclude Solr from spring boot application config & make them run on M1 ( #5827 )
...
* fix(standalone-consumers) Removes Solr from spring boot application config
* Adds standalone consumer option to datahub quickstart cli
* Rename files
* Make dockerize platform agnostic & change docker compose utility to work with M1
* Fix MAE/MCE dockerfiles for arm & make smoke tests use standalone consumers
* Fix identation
* Use master code
* Adds ARM image publishing for consumers
* Fix linter
* Fix lint
2022-09-06 13:55:31 -05:00
Peter Szalai
aa146db611
feat(monitoring): enable JMX and OTEL for frontend pods ( #5834 )
2022-09-06 17:14:53 +05:30
Harshal Sheth
13f20ad2c3
fix(docker): add missing port mappings for non-neo4j quickstart ( #5799 )
...
* fix(docker): add missing port mappings for non-neo4j quickstart
* undo cassandra
2022-09-05 15:32:19 +05:30
Harshal Sheth
c44fd626d8
chore: cleanup references to the old ember app ( #5797 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-09-04 22:42:09 -07:00
Harshal Sheth
762bcbb168
chore(docker): make curl/wget commands quiet in docker ( #5819 )
2022-09-04 22:39:08 -07:00
David Haglund
3cd1feb3a6
doc: Make Airflow link clickable ( #5803 )
...
* style: Cleanup windows line endings
* doc: make url to local Airflow instance clickable in the docs
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-09-03 17:15:59 -04:00
mohdsiddique
2b4f9400ca
fix(GMS): fix no such classes directory file:///etc/datahub/plugins/auth/resources ( #5743 )
2022-08-29 12:08:18 -07:00
mohdsiddique
cfaf7a0c20
fix(quickstart): fix for No such classes directory file:///etc/datahub/plugins/auth/resources ( #5720 )
...
Co-authored-by: MohdSiddique Bagwan <mohdsiddique.bagwan@gslab.com>
2022-08-24 09:26:13 -07:00
dependabot[bot]
12a1bd20de
build(deps): bump nbconvert in /docker/datahub-ingestion ( #5716 )
...
Bumps [nbconvert](https://github.com/jupyter/nbconvert ) from 6.5.0 to 6.5.1.
- [Release notes](https://github.com/jupyter/nbconvert/releases )
- [Commits](https://github.com/jupyter/nbconvert/compare/6.5...6.5.1 )
---
updated-dependencies:
- dependency-name: nbconvert
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-08-23 21:46:45 -07:00
Chris Collins
d64cca5c6b
feat(retention) Enable retention and set max versions for executionRequests ( #5704 )
2022-08-23 16:25:18 -07:00
Pedro Silva
12eb2c6240
feat(kafka) Adds SASL SSL support in kafka setup docker image ( #5697 )
2022-08-22 16:01:10 -07:00
Aseem Bansal
d20071ad91
fix(ci): smoke test less flaky, add src, dev dep in smoke image ( #5594 )
2022-08-09 19:07:12 +05:30
