Shirshanka Das
e688dd554a
chore(deps): upgrade neo4j to 4.4.x ( #6101 )
2022-10-02 23:16:45 -07:00
Shirshanka Das
48b46971b8
feat(ingest): remove hardcoded env variable default for cli version ( #6075 )
2022-10-02 16:46:34 -07:00
Tomáš Kubín
596d48448e
fix(elasticsearch) Analytics indices creation on AWS ES ( #5502 )
...
* refactor(elasticsearch-setup-job): create-indices.sh readability
The script contains many copy-pasting and is not easy to follow.
Add comments, extract commonly used operations into functions, unify approaches.
* fix(elasticsearch-setup-job): AWS indices creation
Fix the issue where Amazon OpenSearch (AWS ES) indices are incorrectly initialised
and the Analytics screen shows errors only.
* feat(elasticsearch-setup-job): configuration hint
mention USE_AWS_ELASTICSEARCH env value if it seems it's set the wrong way
* fix(elasticsearch-setup-job): silent curl
* fix(elasticsearch-setup-job): better USE_AWS_ELASTICSEARCH hint
* docs(elasticsearch-setup-job): index dropping explained
- more comments
- more defensive approach
- index file renamed
* fix(elasticsearch-setup-job): script fixes
* merge(elasticsearch-setup-job): merging in PR #5937
* merge(elasticsearch-setup-job): merging in PR #5963
* merge(elasticsearch-setup-job): merging in PR #5975
Co-authored-by: Pedro Silva <pedro@acryl.io>
2022-09-29 14:10:51 +01:00
Patrick Marx
9e7bd1a84f
fix(mae-consumer): fix regression on base64 encoding ( #6061 )
...
Pull request #5827 introduced a regression by removing coreutils
from the mae-consumer Dockerfile (coreutils was added in #3723 ).
This broke the base64 call in the startup script s.th. the Elasticsearch
auth header will not be correctly set when username and password are
provided.
To make sure that the startup script fails on these errors in the
future, set "-euo pipefail" which lets the bash script fail on errors
and unset variables.
Also refactor the startup script to make it more stable and readable.
Co-authored-by: Pedro Silva <pedro@acryl.io>
2022-09-29 12:13:45 +01:00
Pedro Silva
164bc1aa53
Revert "chore(setup): change defaults for partitions ( #6074 )" ( #6086 )
2022-09-29 15:44:32 +05:30
Pedro Silva
f83eb6f759
fix(elastic-setup) Fixing env var logic ( #6079 )
2022-09-29 10:53:45 +05:30
Aseem Bansal
4cf635e16e
chore(setup): change defaults for partitions ( #6074 )
2022-09-28 15:04:35 +05:30
GYUHOON KIM
b45d5eb56a
fix(elasticsearch_index): create datahub_usage_event index where datahub_analytics_enabled set to false ( #5974 )
2022-09-27 10:20:31 -07:00
leifker
203a6ff57b
refactor(java11) - convert most modules to java 11 ( #5836 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-09-25 08:39:22 -07:00
Pedro Silva
6232447ecf
fix(kafka-setup) Bump kafka version to existing version ( #5995 )
2022-09-20 14:14:17 +01:00
Shirshanka Das
6f4835688e
fix(quickstart): elasticsearch-setup script fails on curl ( #5975 )
2022-09-18 17:05:13 -07:00
Bogdan Antoniu
a86c966c91
feat(elasticsearch-setup): Add insecure option for curl
...
Co-authored-by: EXTERNAL Antoniu Bogdan (Fortech, EB-DB/ENG-Ku) <external.Bogdan.Antoniu@ro.bosch.com>
Co-authored-by: RyanHolstien <RyanHolstien@users.noreply.github.com>
2022-09-16 11:22:50 -05:00
Aseem Bansal
a4720f8e2e
feat(elastic-setup): add better error handling ( #5963 )
2022-09-16 17:34:06 +05:30
firas omrane
c606abdb40
fix(docker) Add platform to docker-compose command ( #5683 )
2022-09-14 17:56:42 +05:30
Aseem Bansal
f669ba6f14
feat(elastic-setup): more verbose logging ( #5937 )
2022-09-14 17:35:26 +05:30
Harshal Sheth
aa93a34678
fix(docker): skip zoneinfo backport on newer python versions ( #5912 )
2022-09-13 11:37:55 -07:00
Peter Szalai
980e1819b3
fix(dev-docker): set right context for frontend dev build ( #5885 )
2022-09-09 09:57:39 -05:00
Pedro Silva
12f462e82b
fix(docker): Bumps JRE 11 to latest ( #5875 )
2022-09-08 12:44:28 -05:00
Pedro Silva
7d0f5435c8
feat(docker): Update Dockerfiles to use java 11 runtime ( #5853 )
2022-09-08 17:39:23 +05:30
Harshal Sheth
6f09f1025e
ci(ingest): test with python 3.10 ( #5863 )
2022-09-07 17:08:49 -07:00
John Joyce
d15518f0d9
fix(browse): Fixing browse path to remove requirement for simple name suffix ( #5634 )
2022-09-07 13:32:38 -07:00
Pedro Silva
42a847c8d1
feat(docker) Adds Sasl support to base ingestion image ( #5855 )
...
* feat(docker) Adds Sasl support to base ingestion image
* Add oracle changes
2022-09-07 22:21:06 +05:30
Pedro Silva
20138a32e5
fix(standalone-consumers): Exclude Solr from spring boot application config & make them run on M1 ( #5827 )
...
* fix(standalone-consumers) Removes Solr from spring boot application config
* Adds standalone consumer option to datahub quickstart cli
* Rename files
* Make dockerize platform agnostic & change docker compose utility to work with M1
* Fix MAE/MCE dockerfiles for arm & make smoke tests use standalone consumers
* Fix identation
* Use master code
* Adds ARM image publishing for consumers
* Fix linter
* Fix lint
2022-09-06 13:55:31 -05:00
Peter Szalai
aa146db611
feat(monitoring): enable JMX and OTEL for frontend pods ( #5834 )
2022-09-06 17:14:53 +05:30
Harshal Sheth
13f20ad2c3
fix(docker): add missing port mappings for non-neo4j quickstart ( #5799 )
...
* fix(docker): add missing port mappings for non-neo4j quickstart
* undo cassandra
2022-09-05 15:32:19 +05:30
Harshal Sheth
c44fd626d8
chore: cleanup references to the old ember app ( #5797 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-09-04 22:42:09 -07:00
Harshal Sheth
762bcbb168
chore(docker): make curl/wget commands quiet in docker ( #5819 )
2022-09-04 22:39:08 -07:00
David Haglund
3cd1feb3a6
doc: Make Airflow link clickable ( #5803 )
...
* style: Cleanup windows line endings
* doc: make url to local Airflow instance clickable in the docs
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-09-03 17:15:59 -04:00
mohdsiddique
2b4f9400ca
fix(GMS): fix no such classes directory file:///etc/datahub/plugins/auth/resources ( #5743 )
2022-08-29 12:08:18 -07:00
mohdsiddique
cfaf7a0c20
fix(quickstart): fix for No such classes directory file:///etc/datahub/plugins/auth/resources ( #5720 )
...
Co-authored-by: MohdSiddique Bagwan <mohdsiddique.bagwan@gslab.com>
2022-08-24 09:26:13 -07:00
dependabot[bot]
12a1bd20de
build(deps): bump nbconvert in /docker/datahub-ingestion ( #5716 )
...
Bumps [nbconvert](https://github.com/jupyter/nbconvert ) from 6.5.0 to 6.5.1.
- [Release notes](https://github.com/jupyter/nbconvert/releases )
- [Commits](https://github.com/jupyter/nbconvert/compare/6.5...6.5.1 )
---
updated-dependencies:
- dependency-name: nbconvert
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-08-23 21:46:45 -07:00
Chris Collins
d64cca5c6b
feat(retention) Enable retention and set max versions for executionRequests ( #5704 )
2022-08-23 16:25:18 -07:00
Pedro Silva
12eb2c6240
feat(kafka) Adds SASL SSL support in kafka setup docker image ( #5697 )
2022-08-22 16:01:10 -07:00
Aseem Bansal
d20071ad91
fix(ci): smoke test less flaky, add src, dev dep in smoke image ( #5594 )
2022-08-09 19:07:12 +05:30
Aseem Bansal
4f35a6c43d
fix(gms): missing directory for gms ( #5570 )
2022-08-04 22:09:30 +05:30
Aseem Bansal
f984585990
fix(gms): ensure directory is present ( #5568 )
2022-08-04 18:58:06 +05:30
Gabe Lyons
f06b8eb4e8
(chore): upgrading ingestion to 0.8.42 ( #5562 )
2022-08-04 17:06:16 +05:30
John Joyce
4e0da5de29
fix(docker): Fixing dev docker and quickstart ( #5550 )
2022-08-02 15:02:01 -07:00
Salih Can
0ded02544c
fix(analytics-tab) - fix analytics tab config variable for gms ( #5529 )
2022-08-02 17:05:04 +05:30
mohdsiddique
c31e380489
feat(apache-ranger): Apache Ranger Authorizer support in datahub-gms ( #4999 )
2022-08-01 09:47:08 -07:00
Aseem Bansal
252992f15e
fix(ci): intermittent failure in github actions ( #5452 )
2022-07-25 23:02:02 -07:00
Shirshanka Das
941770f3bc
feat(cli): quickstart - experimental support for backup restore ( #5418 )
2022-07-24 23:52:25 -07:00
Shirshanka Das
86012fd40c
feat(ci): datahub-upgrade - support multiplatform image ( #5477 )
2022-07-24 18:25:39 -07:00
Aseem Bansal
935b423452
fix(docs,build): remove base image not needed, cleanup docs ( #5469 )
2022-07-22 19:43:48 +05:30
Aseem Bansal
e21efbe9d2
fix(build): add base image with gradle wrapper cached ( #5467 )
2022-07-22 17:44:37 +05:30
Aseem Bansal
acb9879eb4
feat(cli,build): remove deprecated variables GMS_HOST/_PORT ( #5451 )
2022-07-20 20:54:43 +05:30
Shirshanka Das
9d79fd3767
fix(docker): fix kafka-setup command to support same capabilities as previous ( #5428 )
2022-07-18 13:25:17 -07:00
Shirshanka Das
024797df0d
feat(quickstart): moving to official confluent images for m1 ( #5416 )
2022-07-17 18:59:09 -07:00
Aseem Bansal
36f3ab3fa3
feat(quickstart,docs): updates for v0.8.41 ( #5409 )
2022-07-15 21:32:32 +05:30
Navin Sharma
ee7c5f75a2
Add Changes to support smoke test on Datahub deployed on kubernetes Cluster ( #5334 )
...
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
2022-07-14 22:04:06 +05:30
