Harshal Sheth
feb9d59b4d
fix(ingest): remove unused mysql golden file ( #6106 )
2022-10-04 20:26:51 -07:00
Aditya Radhakrishnan
ee1a1ef45b
feat(posts): add posts feature to DataHub ( #6110 )
2022-10-04 15:37:28 -07:00
Harshal Sheth
3c0f63c50a
fix(ingest): hide deprecated path_spec option from config ( #5944 )
2022-10-04 12:14:00 -07:00
Thomas Tauber-Marshall
6b83cab82c
feat(ingest): add CorpUser and CorpGroup to the Python SDK ( #5930 )
...
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-10-04 12:13:38 -07:00
Gabe Lyons
1325b8ad71
feat(search): improved search snippet FE logic ( #6109 )
...
* starting improvements on search snippet
* flesh out ranking logic
* adding tests
* responding to comments
2022-10-04 11:27:46 -07:00
Gabe Lyons
ce90310dd0
feat(advanced-search): Complete Advanced Search: backend changes & tying UI together ( #6068 )
...
* stashing progress
* adding remove option
* more progress
* editing
* further in
* additional rendering improvements
* stashing adv search progress
* stashing more progress
* propagating not filters back to UI
* more frontend progress
* more filters working
* getting ready for data platform selector
* add platform select functionality
* locking out switching btwn advanced and standard filters
* final polish
* remove unneeded code
* added unit and cypress tests
* resolutions after merge
* adding documentation
* cleaning up & refactoring
* removing console.log
* minor ui fix & removing unneeded code
* fixing lineage search
* fixing lints
* fix display of degree
* fixing test
* fixing lint
* responding to comments
* fixing tests
* fix smoke tests
* fixing cypress
* fixing cypress test
* responding to comments
2022-10-04 10:20:04 -07:00
Peter Szalai
396fd31ddc
fix(mae-consumer): use JAVA_TOOL_OPTIONS instead of JDK_JAVA_OPTIONS ( #6114 )
2022-10-04 09:07:44 -07:00
Roko Gudić
d52fde126f
feat(ingest): salesforce - add sandbox support ( #6105 )
...
Co-authored-by: rgudic <roko.gudic@infobip.com>
2022-10-04 09:05:53 -07:00
John Joyce
e2c5d2a4ce
feat(ui): bump max recommendations for Platforms ( #6113 )
2022-10-04 18:35:04 +05:30
Shirshanka Das
bea5a0751e
chore(deps): upgrade opentelemetry dependencies ( #6100 )
...
Co-authored-by: Pedro Silva <pedro@acryl.io>
2022-10-03 22:38:09 -07:00
RyanHolstien
bfb903cfb8
feat(ingest): add async option to ingest proposal endpoint ( #6097 )
...
* feat(ingest): add async option to ingest proposal endpoint
* small tweak to validate before write to K, also keep existing path for timeseries aspects
* avoid double convert
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-10-03 19:56:19 -05:00
Peter Szalai
5fb875a32b
feat(docs): Improve documentation on Search ( #5889 )
2022-10-03 09:35:46 +02:00
Shirshanka Das
e688dd554a
chore(deps): upgrade neo4j to 4.4.x ( #6101 )
2022-10-02 23:16:45 -07:00
Shirshanka Das
bab5acc5e3
chore(deps): upgrade graphql-java deps to 19.0 ( #6099 )
2022-10-02 19:35:10 -07:00
Shirshanka Das
d590ae8f2f
docs: add information about mapping ports for datahub-gms ( #6092 )
2022-10-02 16:47:21 -07:00
Shirshanka Das
48b46971b8
feat(ingest): remove hardcoded env variable default for cli version ( #6075 )
2022-10-02 16:46:34 -07:00
Tamas Nemeth
05f5c123bc
fix(ingest): bigquery-beta - Lowering a bit memory footprint of bigquery usage ( #6095 )
...
* Lowering a bit memory footprint of bigquery usage
* Filtering out not seen tables from usage generation
2022-10-01 14:39:04 +02:00
Gabe Lyons
266216311e
fix(lineage): fix missed casing in lineage registry ( #6078 )
...
* fix backwards case sensitive lineage
* update tests
* make EdgeInfo equals and hashcode case resilient
* updating lint
Co-authored-by: John Joyce <john@acryl.io>
2022-09-30 13:52:28 -07:00
Aseem Bansal
79575b2815
feat(retention): change default policy, add API to apply retention ( #6088 )
2022-09-30 16:11:39 +05:30
Shirshanka Das
3d8d8c6f8e
fix(ingest): lookml - extract column correctly ( #6093 )
2022-09-30 10:03:22 +02:00
Harshal Sheth
446b10dcc3
fix(ingest): bump lkml
version ( #6091 )
2022-09-29 20:46:03 -07:00
Gabe Lyons
7359d922fc
feat(advanced search): Add component to show all advanced search filters & add new filter ( #6058 )
...
* adding select value modal
* expanding gql model and adding advanced search filter component
* adding advanced search filters component
* removing console logs
* improve readability
* responding to comments
2022-09-29 17:25:38 -07:00
Peter Szalai
4792ac56b7
feat(monitoring): track graphql errors in metrics ( #6087 )
...
* feat(monitoring): track graphql errors in metrics
* fix(statuscode): use status code
* address linting
* address linting
2022-09-29 21:36:17 +02:00
Gabe Lyons
8163e1cbe9
fix(ui): fix schema infinite rerender ( #6082 )
2022-09-29 08:38:19 -07:00
Tamas Nemeth
a6930562fd
fix(ingest): presto-on-hive - Setting display name properly ( #6065 )
2022-09-29 16:20:17 +02:00
Harshal Sheth
71f5ec7f19
fix(ingest): mssql - alias for mssql-odbc source ( #6080 )
2022-09-29 15:33:49 +02:00
Harshal Sheth
05b9d4ef2f
fix(doc): note that Athena doesn't support lineage ( #6081 )
2022-09-29 15:30:09 +02:00
Tomáš Kubín
596d48448e
fix(elasticsearch) Analytics indices creation on AWS ES ( #5502 )
...
* refactor(elasticsearch-setup-job): create-indices.sh readability
The script contains many copy-pasting and is not easy to follow.
Add comments, extract commonly used operations into functions, unify approaches.
* fix(elasticsearch-setup-job): AWS indices creation
Fix the issue where Amazon OpenSearch (AWS ES) indices are incorrectly initialised
and the Analytics screen shows errors only.
* feat(elasticsearch-setup-job): configuration hint
mention USE_AWS_ELASTICSEARCH env value if it seems it's set the wrong way
* fix(elasticsearch-setup-job): silent curl
* fix(elasticsearch-setup-job): better USE_AWS_ELASTICSEARCH hint
* docs(elasticsearch-setup-job): index dropping explained
- more comments
- more defensive approach
- index file renamed
* fix(elasticsearch-setup-job): script fixes
* merge(elasticsearch-setup-job): merging in PR #5937
* merge(elasticsearch-setup-job): merging in PR #5963
* merge(elasticsearch-setup-job): merging in PR #5975
Co-authored-by: Pedro Silva <pedro@acryl.io>
2022-09-29 14:10:51 +01:00
Patrick Marx
9e7bd1a84f
fix(mae-consumer): fix regression on base64 encoding ( #6061 )
...
Pull request #5827 introduced a regression by removing coreutils
from the mae-consumer Dockerfile (coreutils was added in #3723 ).
This broke the base64 call in the startup script s.th. the Elasticsearch
auth header will not be correctly set when username and password are
provided.
To make sure that the startup script fails on these errors in the
future, set "-euo pipefail" which lets the bash script fail on errors
and unset variables.
Also refactor the startup script to make it more stable and readable.
Co-authored-by: Pedro Silva <pedro@acryl.io>
2022-09-29 12:13:45 +01:00
Pedro Silva
164bc1aa53
Revert "chore(setup): change defaults for partitions ( #6074 )" ( #6086 )
2022-09-29 15:44:32 +05:30
Pedro Silva
f83eb6f759
fix(elastic-setup) Fixing env var logic ( #6079 )
2022-09-29 10:53:45 +05:30
Shirshanka Das
74d9fa25a6
feat(ingest): looker - add support for simple column level lineage ( #6084 )
2022-09-28 20:41:30 -07:00
Mayuri Nehate
21a8718b10
feat(ingest): add column-level lineage support for snowflake ( #6034 )
2022-09-28 16:30:05 -07:00
John Joyce
09dec1acec
fix(): Attempting to test paypal optimizations ( #6073 )
2022-09-28 09:40:19 -07:00
Aseem Bansal
4cf635e16e
chore(setup): change defaults for partitions ( #6074 )
2022-09-28 15:04:35 +05:30
Harshal Sheth
7e08a05a22
docs(ingest): clarify bigquery-beta multiproject setup ( #6071 )
2022-09-27 23:52:55 -07:00
Gabe Lyons
129a27abef
fix(ui): show soft deleted status of containers ( #6072 )
2022-09-27 22:26:33 -07:00
Paul Logan
eae86a6880
docs: create SECURITY.md ( #6069 )
...
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-09-27 20:16:07 -07:00
Tamas Nemeth
3b9e9793a7
fix(ingest): bigquery-beta - handling complex types properly ( #6062 )
2022-09-27 21:31:24 +02:00
Harshal Sheth
59a2228d13
fix(ingest): correct tableau browse paths ( #6064 )
2022-09-27 12:30:52 -07:00
Aseem Bansal
1c4e127ff9
feat(retention): disable applying retention on bootstrap ( #6066 )
2022-09-27 12:24:37 -07:00
Gabe Lyons
63007cf86f
docs(approval workflows): adding approval workflow docs ( #5896 )
...
* updated approval docs
* further updating proposals doc
* adding approval docs
* delete old file
* clarified the purpose of approval flows
* addressing comments
* updating sidebars
* update iframe
* update index
2022-09-27 11:31:19 -07:00
GYUHOON KIM
b45d5eb56a
fix(elasticsearch_index): create datahub_usage_event index where datahub_analytics_enabled
set to false
( #5974 )
2022-09-27 10:20:31 -07:00
Harshal Sheth
7da2e9852f
fix(ingest): compat with mypy 0.981 ( #6056 )
2022-09-27 17:34:57 +02:00
Harshal Sheth
3f1d47c069
feat(ingest): list referenced env variables in recipe ( #6043 )
2022-09-26 23:16:18 -07:00
mohdsiddique
c062bf2201
fix(ingestion): Tableau test case execution fix ( #6005 )
2022-09-26 18:14:42 -07:00
Shirshanka Das
1d45b81748
fix(deps): metadata-io - remove parquet dependency ( #6046 )
2022-09-26 18:08:53 -07:00
Mayuri Nehate
dc8b9d3c4d
docs(ingest): add path spec examples for s3 ( #6050 )
2022-09-26 18:06:54 -07:00
Gabe Lyons
3eace6490e
feat(advanced search): adding advanced search filter component & prereqs for it ( #6055 )
...
* adding select value modal
* expanding gql model and adding advanced search filter component
* remove log
* nits
* responding to comments
2022-09-26 15:13:04 -07:00
Tamas Nemeth
32b8bef92e
fix(ingest): bigquery-beta - Additional fixes for Bigquery beta ( #6051 )
2022-09-26 14:08:09 -07:00