28 Commits

Author SHA1 Message Date
Davi Arnaut
927775d2fa
feat(opensearch): support for updating ISM policy used for usage events (#10018) 2024-03-08 10:28:45 -08:00
david-leifker
c66619ccc7
fix(elasticsearch): set datahub usage events shard & replica count (#9388) 2023-12-05 14:03:24 -06:00
david-leifker
efd73a5f57
fix(elasticsearch): fix elasticsearch-setup for dropped 000001 index (#9074) 2023-11-03 16:19:39 -05:00
david-leifker
39920bb00f
feat(elasticsearch): Elasticsearch improvements (#6894) 2023-01-31 18:44:37 -06:00
Peter Szalai
a164bdabe2
fix(es-setup): create data stream on non-aws (#6926) 2023-01-03 09:52:45 +01:00
djordje-mijatovic
9e6489f603
refactor(elastic-setup): Elasticsearch setup analytics (#6291) 2022-10-31 13:50:54 -07:00
Tomáš Kubín
596d48448e
fix(elasticsearch) Analytics indices creation on AWS ES (#5502)
* refactor(elasticsearch-setup-job): create-indices.sh readability

The script contains many copy-pasting and is not easy to follow.
Add comments, extract commonly used operations into functions, unify approaches.

* fix(elasticsearch-setup-job): AWS indices creation

Fix the issue where Amazon OpenSearch (AWS ES) indices are incorrectly initialised
and the Analytics screen shows errors only.

* feat(elasticsearch-setup-job): configuration hint

mention USE_AWS_ELASTICSEARCH env value if it seems it's set the wrong way

* fix(elasticsearch-setup-job): silent curl

* fix(elasticsearch-setup-job): better USE_AWS_ELASTICSEARCH hint

* docs(elasticsearch-setup-job): index dropping explained

- more comments
- more defensive approach
- index file renamed

* fix(elasticsearch-setup-job): script fixes

* merge(elasticsearch-setup-job): merging in PR #5937

* merge(elasticsearch-setup-job): merging in PR #5963

* merge(elasticsearch-setup-job): merging in PR #5975

Co-authored-by: Pedro Silva <pedro@acryl.io>
2022-09-29 14:10:51 +01:00
Pedro Silva
f83eb6f759
fix(elastic-setup) Fixing env var logic (#6079) 2022-09-29 10:53:45 +05:30
GYUHOON KIM
b45d5eb56a
fix(elasticsearch_index): create datahub_usage_event index where datahub_analytics_enabled set to false (#5974) 2022-09-27 10:20:31 -07:00
Shirshanka Das
6f4835688e
fix(quickstart): elasticsearch-setup script fails on curl (#5975) 2022-09-18 17:05:13 -07:00
Bogdan Antoniu
a86c966c91
feat(elasticsearch-setup): Add insecure option for curl
Co-authored-by: EXTERNAL Antoniu Bogdan (Fortech, EB-DB/ENG-Ku) <external.Bogdan.Antoniu@ro.bosch.com>
Co-authored-by: RyanHolstien <RyanHolstien@users.noreply.github.com>
2022-09-16 11:22:50 -05:00
Aseem Bansal
a4720f8e2e
feat(elastic-setup): add better error handling (#5963) 2022-09-16 17:34:06 +05:30
Aseem Bansal
f669ba6f14
feat(elastic-setup): more verbose logging (#5937) 2022-09-14 17:35:26 +05:30
Navin Sharma
ee7c5f75a2
Add Changes to support smoke test on Datahub deployed on kubernetes Cluster (#5334)
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
2022-07-14 22:04:06 +05:30
Dexter Lee
0576b76eb3
fix(elasticsearch): Use auth tokens to authorize curl requests in dockerize (#3596) 2021-12-07 17:50:08 -08:00
Dexter Lee
acb638cb65
fix(analytics): Fix SSL issue with analytics on frontend (#2840) 2021-07-08 15:11:40 -07:00
Dexter Lee
b4cf74bcb4
fix(analytics): add support for AWS ES (#2539) 2021-05-12 10:54:18 -07:00
John Joyce
29832e5385
feat(Product Analytics): Introducing In-App Analytics Beta (#2499)
Co-authored-by: Harshal Sheth <harshal@acryl.io>
Co-authored-by: Dexter Lee <dexter@acryl.io>
Co-authored-by: Gabe Lyons <itsgabelyons@gmail.com>
2021-05-11 15:41:42 -07:00
shakti-garg
8ed14a62e2
feat(business_glossary): add new entity business term and its relationship with dataset and its fields (#2228)
Co-authored-by: shubham.garg <shubham.garg@thoughtworks.com>
2021-05-10 13:20:23 -07:00
Dexter Lee
1fc532d831
feat(index): Add index naming convention for elasticsearch (#2386) 2021-04-13 07:56:31 -07:00
shakti-garg
3fb71acf71
feat(es-setup): add logic in elasticsearch setup to compare-and-update index if already exists (#2312)
* 2310 | add logic in es-setup script to compare-and-update index if already exists
2021-04-03 11:17:16 -07:00
Fredrik Sannholm
4591667e05
feat(elasticsearch): Elasticsearch simple auth over https support (#2303) 2021-03-27 20:21:10 -07:00
John Plaisted
5e91014e00
feat(search) BREAKING Support ElasticSearch 7, drop ES5 (#2263)
Merges in changes from our ES7 branch, and drops support for ES5.

This is a breaking change due to the upgrade, we have a ES5 branch at the commit before this.
2021-03-18 19:16:44 -07:00
Fredrik Sannholm
da6b3d111d
feat(datajob): Backend implementation (#2197) 2021-03-13 08:00:44 -08:00
Gabe Lyons
11e0cd66d4
feat(tag): adding search for tags in gms layer (#2203) 2021-03-10 00:02:58 -08:00
Dexter Lee
e7c3fd867b
refactor(docker-dev): set up elasticsearch using local mapping on docker-compose.dev (#2137)
Co-authored-by: Dexter Lee <dexter@acryl.io>
2021-02-24 16:00:16 -08:00
RyanHolstien
ea86ade29b
feat: ML Model Backend Implementation (#1896)
Co-authored-by: RyanHolstien <rholstien@expediagroup.com>
2021-02-17 13:28:13 -08:00
John Plaisted
838f964114
feat: add elasticsearch sanity integration tests (#2028)
These tests verify that, given an index settings and mappings, data can be written to the index, and read from it with a query_all query. These are very simple sanity tests.

We can, and should, write more complex tests that specific to each index in the future.
2020-12-02 20:49:34 -08:00