5512 Commits

Author SHA1 Message Date
Pedro Silva
db35aca869
feat(frontend) Adds multiple group claim support (#4450) 2022-03-21 13:33:53 -07:00
Aseem Bansal
c5f1d2c9bd
feat(ingestion): snowflake, bigquery - enhancements to log and bugfix (#4442)
feat(ingestion): add logging for snowflake, bigquery
2022-03-21 09:50:36 -07:00
Aseem Bansal
dc9228fa9b
doc: add guide for ui tabs (#4333)
* doc: add guide for ui tabs

* docs: add details on properties tab

* add validation tab

* change arrangement
2022-03-21 07:28:42 -07:00
John Joyce
58dab764c4
Fixing privilege option display bug (#4443) 2022-03-18 15:46:59 -07:00
Gabe Lyons
bf35d4c83e
fix tableau connector when it cannot connect to URI (#4451) 2022-03-18 15:46:46 -07:00
Xu Wang
89a8fa05eb
(docs) add RFC file to introduce Notebook entity data model (#4237)
* add RFC file to introduce DataDoc entity

* add PR link

* Model Notebook instead of DataDoc

DataDoc could be viewed as a subset of Notebook. We could model Notebook
instead and make DataDoc a subtype of Notebook

* update picture file name

* Put rfc number and resolve pr comments

Co-authored-by: Xu Wang <xu.wang@grandrounds.com>
2022-03-18 14:43:08 -07:00
Kevin Neville
d8e6f890a9
fix: Replace old repository link with new link (#4446) 2022-03-18 14:12:19 -07:00
cuong-pham
12bb2e1231
getting database directly from upstream tables incase there are multiple databases in upstreamDatabases (#4447) 2022-03-18 14:11:07 -07:00
Tamas Nemeth
430ca10c15
Passing entity properly on deletion (#4436)
Query filter use platform property properly if paltform instance specified
2022-03-18 12:30:41 +01:00
Ravindra Lanka
60925e3e8c
Fix bug in the SchemaField type computation for AVRO logical types. (#4433) 2022-03-18 12:06:54 +01:00
mayurinehate
2f078c981c
feat(ingestion): tableau - support for tableau version 2021.1 and older (#4437)
fixes #4119
v0.8.31
2022-03-17 14:07:36 -07:00
Pedro Silva
0a522e5c6a
Makes filtered search deletes include BOTH removed and non-removed (#4440) 2022-03-17 13:22:28 -07:00
Pedro Silva
693aedc8b9
Adds elasticsearch mapping (#4444) 2022-03-17 13:15:18 -07:00
leifker
628d818816
feat(protobuf): Gradle protobuf example project (#4432) 2022-03-17 10:43:03 -07:00
Gabe Lyons
2d82531a1d
fix(no-code metadata models in ui): fixes bug with rendering renderSpec aspects (#4430)
* fix weakly typed aspects after batchgetv2 change

* remove spurious models
v0.8.30
2022-03-16 17:03:43 -07:00
Pedro Silva
aa593c32d8
Flexible search on soft delete (#4405)
* Adds filter logic to correct DB

* Fix build

* Adds documentation & fixes flag typo

* apply review comments

* Adds test for filtered search

* Adds warning log for redundant parameter combo
2022-03-16 16:35:04 -07:00
Aseem Bansal
d4d1635f2b
fix: don't set None default (#4422) 2022-03-16 14:59:58 -07:00
Tamas Nemeth
f557b2c1b3
fix(ingestion) containers: Adding platform instance to container keys (#4279) 2022-03-16 14:57:50 -07:00
Gabe Lyons
1ab3ad3986
feat(gql): make gql layer resistant to unresolvable relationships (#4424)
* query for custom properties on containers

* dont break gql if fine grained lineage is present
2022-03-16 14:19:10 -07:00
Matt Matravers
ca4de4d7ac
build: Fix line endings for Windows check-out (#4370)
To avoid the need for dos2unix when checking out the repo on Windows.

See: https://docs.github.com/en/get-started/getting-started-with-git/configuring-git-to-handle-line-endings
2022-03-16 12:17:47 -07:00
mayurinehate
9025bfb8d0
fix(ingest): extract redshift platform correctly from sqlalchemy uri (#4421)
* fix(ingest): extract redshift platform from sqlalchemy uri
2022-03-16 19:36:23 +01:00
Gabe Lyons
ad039aab67
tests(cypress): reduce cypress flakiness by retrying login on failure (#4423)
* query for custom properties on containers

* retry login in cypress

* syntax fix
2022-03-16 10:37:32 -07:00
Aseem Bansal
2d10d9905b
fix: change log levels to debug (#4411) 2022-03-15 19:32:03 -07:00
John Joyce
11f809abd2
feat(oidc): Adding support for extracting single string groups claim (#4419) 2022-03-15 17:41:19 -07:00
John Joyce
86f240769f
Fixing OIDC encryption bug from v0.8.29 (#4418) 2022-03-15 17:41:08 -07:00
Gabe Lyons
431ba4b2a9
fix(ingestion): looker - various fixes (#4394)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-03-15 15:48:34 -07:00
Pedro Silva
e8f6c4cabd
feat(cli) Changes rollback behaviour to apply soft deletes by default (#4358)
* Changes rollback behaviour to apply soft deletes by default

Summary:
Addresses feature request: Flag in delete command to only delete aspects touched by an ingestion run; add flag to nuke everything by modifying the default behaviour of a rollback operation which will not by default delete an entity if a keyAspect is being rolled-back.

Instead the key aspect is kept and a StatusAspect is upserted with removed=true, effectively making a soft delete.
Another PR will follow to perform garbage collection on these soft deleted entities.

To keep old behaviour, a new parameter to the cli ingest rollback endpoint: --hard-delete was added.

* Adds restli specs

* Fixes deleteAspect endpoint & adds support for nested transactions

* Enable regression test & fix docker-compose for local development

* Add generated quickstart

* Fix quickstart generation script

* Adds missing var env to docker-compose-without-neo4j

* Sets status removed=true when ingesting resources

* Adds soft deletes for ElasticSearch + soft delete flags across ingestion sub-commands

* Makes elastic search consistent

* Update tests with new behaviour

* apply review comments

* apply review comment

* Forces Elastic search to add documents with status removed false when ingesting

* Reset gradle properties to default

* Fix tests
2022-03-15 12:05:52 -07:00
Dexter Lee
ab0b5162af
fix(lineage): Move lineage registry to entity-registry module (#4412)
* Move lineage registry

* Fix test
2022-03-15 11:59:59 -07:00
Gabe Lyons
540d1b3be5
feat(lineage): hide soft deleted nodes in lineage & adds banner in entity page (#4410)
* query for custom properties on containers

* updating queries

* hide soft deleted entities in lineage viz

* add banner for soft deleted entities

* fix tests
2022-03-15 11:17:13 -07:00
Ankit keshari
55357783f3
Refactoring the quries into a single one to get the search results on Home Page (#4372) 2022-03-14 22:24:45 -07:00
Ravindra Lanka
30ed5f2a2f
feat(ingestion): cli - Add the ability to query the latest timeseries aspect value via the get command. (#4395) 2022-03-14 19:03:56 -07:00
Jorgen Evens
af5c4ee4d0
fix(ingest): handle endpoints without 200 response in openapi (#4332) 2022-03-14 17:52:08 -07:00
Ravindra Lanka
50ef658339
fix(ingestion): Invoke SqlLineageSQLParser's implementation in a separate process (#4391) 2022-03-14 17:49:03 -07:00
Abhiram98
d82e1d31a4
fix(ingestion): redshift - read all tables (#4345) 2022-03-14 17:46:35 -07:00
WaStCo
bd3090ae86
fix(query_combiner): add try block to handle queries of type str (#4397)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-03-14 17:45:28 -07:00
Dexter Lee
a12c9d2a30
Add flag to enable cache (#4335) 2022-03-14 16:40:10 -07:00
Hassan Shahid
eb9a167e0d
build(ingestion): update markupsafe pinning for Airflow compatibility (#4388) 2022-03-14 16:19:59 -07:00
Ravindra Lanka
5aaf187371
fix(ingestion): Fix mypy error stateful committable & restore mypy version. (#4408) 2022-03-14 14:15:14 -07:00
John Joyce
a453ebf02d
feat(autocomplete): Show recent searches + improved autocomplete (#4400) 2022-03-14 14:07:49 -07:00
Aseem Bansal
1198123d78
fix: telemetry failure should not cause CLI failure (#4406) 2022-03-14 12:25:22 -07:00
John Joyce
ecd263b0d2
feat(*): Support setting owner type when assigning ownership (#4354) 2022-03-14 11:14:32 -07:00
Aditya Radhakrishnan
23404f9c35
fix(containers) - configure domain resolver for containers (#4404) 2022-03-14 11:09:05 -07:00
MugdhaHardikar-GSLab
a8a4d82d25
feat(spark-lineage): add support for custom env and platform_instance (#4208) 2022-03-14 10:48:27 -07:00
Aseem Bansal
f0230b05f5
fix: add missing logo (#4386) 2022-03-14 09:05:50 -07:00
cccs-eric
cb9b99f0ba
fix(ingest) Azure AD: support nested groups (#4367) (#4368)
LGTM - Thanks!
2022-03-14 08:59:04 -07:00
Aseem Bansal
4bcc2b3d12
feat(ingestion): improve logging, docs for bigquery, snowflake, redshift (#4344) 2022-03-14 08:50:29 -07:00
Gabe Lyons
bb413beb24
Revert "Fixed Bug: Alpha slider doesn’t move, only the color slider is movable in tag color picker (#4359)" (#4390)
This reverts commit cf7cefe20389e20754718cd07dab4ff13eba974c.
2022-03-13 13:43:29 -07:00
RyanHolstien
63a333928b
docs(model): update docs on extending metadata model, remove inaccurate faq (#4393) 2022-03-12 15:16:14 -08:00
leifker
bb8f45bd20
feat(ingestion): add java protobuf schema ingestion (#4178)
Co-authored-by: leifker <david.leifker@landsend.com>
2022-03-11 10:13:00 -08:00
John Joyce
c713b60810
fix(oidc): Update group membership each login (and make group extraction disabled by default) (#4380) 2022-03-11 08:49:31 -08:00