Tamas Nemeth
a6930562fd
fix(ingest): presto-on-hive - Setting display name properly ( #6065 )
2022-09-29 16:20:17 +02:00
Harshal Sheth
71f5ec7f19
fix(ingest): mssql - alias for mssql-odbc source ( #6080 )
2022-09-29 15:33:49 +02:00
Harshal Sheth
05b9d4ef2f
fix(doc): note that Athena doesn't support lineage ( #6081 )
2022-09-29 15:30:09 +02:00
Tomáš Kubín
596d48448e
fix(elasticsearch) Analytics indices creation on AWS ES ( #5502 )
...
* refactor(elasticsearch-setup-job): create-indices.sh readability
The script contains many copy-pasting and is not easy to follow.
Add comments, extract commonly used operations into functions, unify approaches.
* fix(elasticsearch-setup-job): AWS indices creation
Fix the issue where Amazon OpenSearch (AWS ES) indices are incorrectly initialised
and the Analytics screen shows errors only.
* feat(elasticsearch-setup-job): configuration hint
mention USE_AWS_ELASTICSEARCH env value if it seems it's set the wrong way
* fix(elasticsearch-setup-job): silent curl
* fix(elasticsearch-setup-job): better USE_AWS_ELASTICSEARCH hint
* docs(elasticsearch-setup-job): index dropping explained
- more comments
- more defensive approach
- index file renamed
* fix(elasticsearch-setup-job): script fixes
* merge(elasticsearch-setup-job): merging in PR #5937
* merge(elasticsearch-setup-job): merging in PR #5963
* merge(elasticsearch-setup-job): merging in PR #5975
Co-authored-by: Pedro Silva <pedro@acryl.io>
2022-09-29 14:10:51 +01:00
Patrick Marx
9e7bd1a84f
fix(mae-consumer): fix regression on base64 encoding ( #6061 )
...
Pull request #5827 introduced a regression by removing coreutils
from the mae-consumer Dockerfile (coreutils was added in #3723 ).
This broke the base64 call in the startup script s.th. the Elasticsearch
auth header will not be correctly set when username and password are
provided.
To make sure that the startup script fails on these errors in the
future, set "-euo pipefail" which lets the bash script fail on errors
and unset variables.
Also refactor the startup script to make it more stable and readable.
Co-authored-by: Pedro Silva <pedro@acryl.io>
2022-09-29 12:13:45 +01:00
Pedro Silva
164bc1aa53
Revert "chore(setup): change defaults for partitions ( #6074 )" ( #6086 )
2022-09-29 15:44:32 +05:30
Pedro Silva
f83eb6f759
fix(elastic-setup) Fixing env var logic ( #6079 )
2022-09-29 10:53:45 +05:30
Shirshanka Das
74d9fa25a6
feat(ingest): looker - add support for simple column level lineage ( #6084 )
2022-09-28 20:41:30 -07:00
Mayuri Nehate
21a8718b10
feat(ingest): add column-level lineage support for snowflake ( #6034 )
2022-09-28 16:30:05 -07:00
John Joyce
09dec1acec
fix(): Attempting to test paypal optimizations ( #6073 )
2022-09-28 09:40:19 -07:00
Aseem Bansal
4cf635e16e
chore(setup): change defaults for partitions ( #6074 )
2022-09-28 15:04:35 +05:30
Harshal Sheth
7e08a05a22
docs(ingest): clarify bigquery-beta multiproject setup ( #6071 )
2022-09-27 23:52:55 -07:00
Gabe Lyons
129a27abef
fix(ui): show soft deleted status of containers ( #6072 )
2022-09-27 22:26:33 -07:00
Paul Logan
eae86a6880
docs: create SECURITY.md ( #6069 )
...
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-09-27 20:16:07 -07:00
Tamas Nemeth
3b9e9793a7
fix(ingest): bigquery-beta - handling complex types properly ( #6062 )
2022-09-27 21:31:24 +02:00
Harshal Sheth
59a2228d13
fix(ingest): correct tableau browse paths ( #6064 )
2022-09-27 12:30:52 -07:00
Aseem Bansal
1c4e127ff9
feat(retention): disable applying retention on bootstrap ( #6066 )
2022-09-27 12:24:37 -07:00
Gabe Lyons
63007cf86f
docs(approval workflows): adding approval workflow docs ( #5896 )
...
* updated approval docs
* further updating proposals doc
* adding approval docs
* delete old file
* clarified the purpose of approval flows
* addressing comments
* updating sidebars
* update iframe
* update index
2022-09-27 11:31:19 -07:00
GYUHOON KIM
b45d5eb56a
fix(elasticsearch_index): create datahub_usage_event index where datahub_analytics_enabled set to false ( #5974 )
2022-09-27 10:20:31 -07:00
Harshal Sheth
7da2e9852f
fix(ingest): compat with mypy 0.981 ( #6056 )
2022-09-27 17:34:57 +02:00
Harshal Sheth
3f1d47c069
feat(ingest): list referenced env variables in recipe ( #6043 )
2022-09-26 23:16:18 -07:00
mohdsiddique
c062bf2201
fix(ingestion): Tableau test case execution fix ( #6005 )
2022-09-26 18:14:42 -07:00
Shirshanka Das
1d45b81748
fix(deps): metadata-io - remove parquet dependency ( #6046 )
2022-09-26 18:08:53 -07:00
Mayuri Nehate
dc8b9d3c4d
docs(ingest): add path spec examples for s3 ( #6050 )
2022-09-26 18:06:54 -07:00
Gabe Lyons
3eace6490e
feat(advanced search): adding advanced search filter component & prereqs for it ( #6055 )
...
* adding select value modal
* expanding gql model and adding advanced search filter component
* remove log
* nits
* responding to comments
2022-09-26 15:13:04 -07:00
Tamas Nemeth
32b8bef92e
fix(ingest): bigquery-beta - Additional fixes for Bigquery beta ( #6051 )
2022-09-26 14:08:09 -07:00
Gabe Lyons
60928757e0
feat(advanced-search): adding select value modal ( #6026 )
...
* adding select value modal
* responding to comments
2022-09-26 12:17:32 -07:00
Alexey Kravtsov
3c3ab64954
feat(ingest): implement compression for CheckpointState ( #6007 )
2022-09-26 10:18:42 -07:00
John Joyce
ec5aeeff39
feat(ui): Adding placeholder entity for DataPlatform ( #6045 )
2022-09-26 08:55:03 -07:00
Harshal Sheth
611c053117
refactor(ingest): use aspect map in transformers ( #6040 )
2022-09-25 23:48:58 -07:00
Harshal Sheth
036f7202dd
docs(ingest): add example of dbt column_meta_mapping ( #6038 )
2022-09-25 23:40:59 -07:00
Harshal Sheth
f227bd982b
refactor(ingest): streamline pydantic configs ( #6011 )
2022-09-25 23:37:48 -07:00
David Weddell
9d0a2dea53
docs(readme): Fix broken link ( #6042 )
2022-09-25 08:41:42 -07:00
leifker
203a6ff57b
refactor(java11) - convert most modules to java 11 ( #5836 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-09-25 08:39:22 -07:00
Aditya Radhakrishnan
325b959ea6
feat(roles): add ability to invite users into a role ( #6015 )
2022-09-23 16:48:23 -07:00
Tamas Nemeth
3b1a0c568e
fix(ingest): bigquery-beta - Getting datasets with biquery client ( #6039 )
...
* Getting datasets with biquery client instead of information schema because it did not work everywhere
Changing lists to lossylist in report
2022-09-24 00:48:15 +02:00
Shirshanka Das
af6a423f9d
feat(patch): report whether server is patch capable ( #6037 )
2022-09-23 14:42:45 -07:00
John Joyce
78454888b5
refactor(ingest): Browse Paths Upgrade Tableau ( #6008 )
2022-09-23 13:02:34 -07:00
Aditya Radhakrishnan
f57f3987e7
feat(tracking): add additional home page telemetry ( #6018 )
2022-09-23 12:14:44 -07:00
Aditya Radhakrishnan
011421dfaa
fix(frontend): fix authenticate endpoint to create new session on redirect ( #6036 )
2022-09-23 12:05:53 -07:00
Tamas Nemeth
722be5dc0c
fix(ingest): bigquery-beta - Project name quote and graceful lineage/usage failures ( #6035 )
2022-09-23 19:25:34 +02:00
RyanHolstien
0728656fbf
feat(patch): initial support of json patch style semantics in MCPs ( #5901 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-09-22 23:52:18 -07:00
atul-chegg
d53cbbb9bf
fix(platform): Add aws-secretsmanager-jdbc driver in dependencies ( #5968 )
2022-09-22 22:23:45 -07:00
Harshal Sheth
0c63178a71
fix(ingest): support snowflake-beta extra compatibility ( #6032 )
2022-09-22 22:07:44 -07:00
John Joyce
407cd6c826
refactor(gms): Improving JWT parsing logic ( #6025 )
2022-09-22 19:29:51 -07:00
Aditya Radhakrishnan
d13145e32d
fix(frontend): refactoring AuthServiceClient ( #6029 )
2022-09-22 18:26:42 -07:00
Harshal Sheth
3a6d1d2bf1
feat(ingest): aws - support extra args to role config ( #6031 )
2022-09-22 17:43:32 -07:00
Harshal Sheth
27f28019de
refactor(ingest): move common host_port validation ( #6009 )
2022-09-22 16:32:07 -07:00
Ravindra Lanka
b8941ab190
feat(ingestion): Add fail-safe stale entity removal via configurable 'fail_safe_threshold' param. ( #6027 )
2022-09-22 16:09:22 -07:00
Amanda Ng
63ef9c04f9
fix(ownership-differ): standardise ownership change event payload ( #5967 )
...
* fix(ownership-differ): standardise ownership change event payload
* fix(ownership-differ): update test case
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: John Joyce <john@acryl.io>
2022-09-22 15:06:17 -07:00
