Peter Szalai
5fb875a32b
feat(docs): Improve documentation on Search ( #5889 )
2022-10-03 09:35:46 +02:00
Shirshanka Das
e688dd554a
chore(deps): upgrade neo4j to 4.4.x ( #6101 )
2022-10-02 23:16:45 -07:00
Shirshanka Das
bab5acc5e3
chore(deps): upgrade graphql-java deps to 19.0 ( #6099 )
2022-10-02 19:35:10 -07:00
Shirshanka Das
d590ae8f2f
docs: add information about mapping ports for datahub-gms ( #6092 )
2022-10-02 16:47:21 -07:00
Shirshanka Das
48b46971b8
feat(ingest): remove hardcoded env variable default for cli version ( #6075 )
2022-10-02 16:46:34 -07:00
Tamas Nemeth
05f5c123bc
fix(ingest): bigquery-beta - Lowering a bit memory footprint of bigquery usage ( #6095 )
...
* Lowering a bit memory footprint of bigquery usage
* Filtering out not seen tables from usage generation
2022-10-01 14:39:04 +02:00
Gabe Lyons
266216311e
fix(lineage): fix missed casing in lineage registry ( #6078 )
...
* fix backwards case sensitive lineage
* update tests
* make EdgeInfo equals and hashcode case resilient
* updating lint
Co-authored-by: John Joyce <john@acryl.io>
2022-09-30 13:52:28 -07:00
Aseem Bansal
79575b2815
feat(retention): change default policy, add API to apply retention ( #6088 )
2022-09-30 16:11:39 +05:30
Shirshanka Das
3d8d8c6f8e
fix(ingest): lookml - extract column correctly ( #6093 )
2022-09-30 10:03:22 +02:00
Harshal Sheth
446b10dcc3
fix(ingest): bump lkml version ( #6091 )
2022-09-29 20:46:03 -07:00
Gabe Lyons
7359d922fc
feat(advanced search): Add component to show all advanced search filters & add new filter ( #6058 )
...
* adding select value modal
* expanding gql model and adding advanced search filter component
* adding advanced search filters component
* removing console logs
* improve readability
* responding to comments
2022-09-29 17:25:38 -07:00
Peter Szalai
4792ac56b7
feat(monitoring): track graphql errors in metrics ( #6087 )
...
* feat(monitoring): track graphql errors in metrics
* fix(statuscode): use status code
* address linting
* address linting
2022-09-29 21:36:17 +02:00
Gabe Lyons
8163e1cbe9
fix(ui): fix schema infinite rerender ( #6082 )
2022-09-29 08:38:19 -07:00
Tamas Nemeth
a6930562fd
fix(ingest): presto-on-hive - Setting display name properly ( #6065 )
2022-09-29 16:20:17 +02:00
Harshal Sheth
71f5ec7f19
fix(ingest): mssql - alias for mssql-odbc source ( #6080 )
2022-09-29 15:33:49 +02:00
Harshal Sheth
05b9d4ef2f
fix(doc): note that Athena doesn't support lineage ( #6081 )
2022-09-29 15:30:09 +02:00
Tomáš Kubín
596d48448e
fix(elasticsearch) Analytics indices creation on AWS ES ( #5502 )
...
* refactor(elasticsearch-setup-job): create-indices.sh readability
The script contains many copy-pasting and is not easy to follow.
Add comments, extract commonly used operations into functions, unify approaches.
* fix(elasticsearch-setup-job): AWS indices creation
Fix the issue where Amazon OpenSearch (AWS ES) indices are incorrectly initialised
and the Analytics screen shows errors only.
* feat(elasticsearch-setup-job): configuration hint
mention USE_AWS_ELASTICSEARCH env value if it seems it's set the wrong way
* fix(elasticsearch-setup-job): silent curl
* fix(elasticsearch-setup-job): better USE_AWS_ELASTICSEARCH hint
* docs(elasticsearch-setup-job): index dropping explained
- more comments
- more defensive approach
- index file renamed
* fix(elasticsearch-setup-job): script fixes
* merge(elasticsearch-setup-job): merging in PR #5937
* merge(elasticsearch-setup-job): merging in PR #5963
* merge(elasticsearch-setup-job): merging in PR #5975
Co-authored-by: Pedro Silva <pedro@acryl.io>
2022-09-29 14:10:51 +01:00
Patrick Marx
9e7bd1a84f
fix(mae-consumer): fix regression on base64 encoding ( #6061 )
...
Pull request #5827 introduced a regression by removing coreutils
from the mae-consumer Dockerfile (coreutils was added in #3723 ).
This broke the base64 call in the startup script s.th. the Elasticsearch
auth header will not be correctly set when username and password are
provided.
To make sure that the startup script fails on these errors in the
future, set "-euo pipefail" which lets the bash script fail on errors
and unset variables.
Also refactor the startup script to make it more stable and readable.
Co-authored-by: Pedro Silva <pedro@acryl.io>
2022-09-29 12:13:45 +01:00
Pedro Silva
164bc1aa53
Revert "chore(setup): change defaults for partitions ( #6074 )" ( #6086 )
2022-09-29 15:44:32 +05:30
Pedro Silva
f83eb6f759
fix(elastic-setup) Fixing env var logic ( #6079 )
2022-09-29 10:53:45 +05:30
Shirshanka Das
74d9fa25a6
feat(ingest): looker - add support for simple column level lineage ( #6084 )
2022-09-28 20:41:30 -07:00
Mayuri Nehate
21a8718b10
feat(ingest): add column-level lineage support for snowflake ( #6034 )
2022-09-28 16:30:05 -07:00
John Joyce
09dec1acec
fix(): Attempting to test paypal optimizations ( #6073 )
2022-09-28 09:40:19 -07:00
Aseem Bansal
4cf635e16e
chore(setup): change defaults for partitions ( #6074 )
2022-09-28 15:04:35 +05:30
Harshal Sheth
7e08a05a22
docs(ingest): clarify bigquery-beta multiproject setup ( #6071 )
2022-09-27 23:52:55 -07:00
Gabe Lyons
129a27abef
fix(ui): show soft deleted status of containers ( #6072 )
2022-09-27 22:26:33 -07:00
Paul Logan
eae86a6880
docs: create SECURITY.md ( #6069 )
...
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-09-27 20:16:07 -07:00
Tamas Nemeth
3b9e9793a7
fix(ingest): bigquery-beta - handling complex types properly ( #6062 )
2022-09-27 21:31:24 +02:00
Harshal Sheth
59a2228d13
fix(ingest): correct tableau browse paths ( #6064 )
2022-09-27 12:30:52 -07:00
Aseem Bansal
1c4e127ff9
feat(retention): disable applying retention on bootstrap ( #6066 )
2022-09-27 12:24:37 -07:00
Gabe Lyons
63007cf86f
docs(approval workflows): adding approval workflow docs ( #5896 )
...
* updated approval docs
* further updating proposals doc
* adding approval docs
* delete old file
* clarified the purpose of approval flows
* addressing comments
* updating sidebars
* update iframe
* update index
2022-09-27 11:31:19 -07:00
GYUHOON KIM
b45d5eb56a
fix(elasticsearch_index): create datahub_usage_event index where datahub_analytics_enabled set to false ( #5974 )
2022-09-27 10:20:31 -07:00
Harshal Sheth
7da2e9852f
fix(ingest): compat with mypy 0.981 ( #6056 )
2022-09-27 17:34:57 +02:00
Harshal Sheth
3f1d47c069
feat(ingest): list referenced env variables in recipe ( #6043 )
2022-09-26 23:16:18 -07:00
mohdsiddique
c062bf2201
fix(ingestion): Tableau test case execution fix ( #6005 )
2022-09-26 18:14:42 -07:00
Shirshanka Das
1d45b81748
fix(deps): metadata-io - remove parquet dependency ( #6046 )
2022-09-26 18:08:53 -07:00
Mayuri Nehate
dc8b9d3c4d
docs(ingest): add path spec examples for s3 ( #6050 )
2022-09-26 18:06:54 -07:00
Gabe Lyons
3eace6490e
feat(advanced search): adding advanced search filter component & prereqs for it ( #6055 )
...
* adding select value modal
* expanding gql model and adding advanced search filter component
* remove log
* nits
* responding to comments
2022-09-26 15:13:04 -07:00
Tamas Nemeth
32b8bef92e
fix(ingest): bigquery-beta - Additional fixes for Bigquery beta ( #6051 )
2022-09-26 14:08:09 -07:00
Gabe Lyons
60928757e0
feat(advanced-search): adding select value modal ( #6026 )
...
* adding select value modal
* responding to comments
2022-09-26 12:17:32 -07:00
Alexey Kravtsov
3c3ab64954
feat(ingest): implement compression for CheckpointState ( #6007 )
2022-09-26 10:18:42 -07:00
John Joyce
ec5aeeff39
feat(ui): Adding placeholder entity for DataPlatform ( #6045 )
2022-09-26 08:55:03 -07:00
Harshal Sheth
611c053117
refactor(ingest): use aspect map in transformers ( #6040 )
2022-09-25 23:48:58 -07:00
Harshal Sheth
036f7202dd
docs(ingest): add example of dbt column_meta_mapping ( #6038 )
2022-09-25 23:40:59 -07:00
Harshal Sheth
f227bd982b
refactor(ingest): streamline pydantic configs ( #6011 )
2022-09-25 23:37:48 -07:00
David Weddell
9d0a2dea53
docs(readme): Fix broken link ( #6042 )
2022-09-25 08:41:42 -07:00
leifker
203a6ff57b
refactor(java11) - convert most modules to java 11 ( #5836 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-09-25 08:39:22 -07:00
Aditya Radhakrishnan
325b959ea6
feat(roles): add ability to invite users into a role ( #6015 )
2022-09-23 16:48:23 -07:00
Tamas Nemeth
3b1a0c568e
fix(ingest): bigquery-beta - Getting datasets with biquery client ( #6039 )
...
* Getting datasets with biquery client instead of information schema because it did not work everywhere
Changing lists to lossylist in report
2022-09-24 00:48:15 +02:00
Shirshanka Das
af6a423f9d
feat(patch): report whether server is patch capable ( #6037 )
2022-09-23 14:42:45 -07:00
