cuong-pham
12bb2e1231
getting database directly from upstream tables incase there are multiple databases in upstreamDatabases ( #4447 )
2022-03-18 14:11:07 -07:00
Tamas Nemeth
430ca10c15
Passing entity properly on deletion ( #4436 )
...
Query filter use platform property properly if paltform instance specified
2022-03-18 12:30:41 +01:00
Ravindra Lanka
60925e3e8c
Fix bug in the SchemaField type computation for AVRO logical types. ( #4433 )
2022-03-18 12:06:54 +01:00
mayurinehate
2f078c981c
feat(ingestion): tableau - support for tableau version 2021.1 and older ( #4437 )
...
fixes #4119
2022-03-17 14:07:36 -07:00
Pedro Silva
0a522e5c6a
Makes filtered search deletes include BOTH removed and non-removed ( #4440 )
2022-03-17 13:22:28 -07:00
Pedro Silva
693aedc8b9
Adds elasticsearch mapping ( #4444 )
2022-03-17 13:15:18 -07:00
leifker
628d818816
feat(protobuf): Gradle protobuf example project ( #4432 )
2022-03-17 10:43:03 -07:00
Gabe Lyons
2d82531a1d
fix(no-code metadata models in ui): fixes bug with rendering renderSpec aspects ( #4430 )
...
* fix weakly typed aspects after batchgetv2 change
* remove spurious models
2022-03-16 17:03:43 -07:00
Pedro Silva
aa593c32d8
Flexible search on soft delete ( #4405 )
...
* Adds filter logic to correct DB
* Fix build
* Adds documentation & fixes flag typo
* apply review comments
* Adds test for filtered search
* Adds warning log for redundant parameter combo
2022-03-16 16:35:04 -07:00
Aseem Bansal
d4d1635f2b
fix: don't set None default ( #4422 )
2022-03-16 14:59:58 -07:00
Tamas Nemeth
f557b2c1b3
fix(ingestion) containers: Adding platform instance to container keys ( #4279 )
2022-03-16 14:57:50 -07:00
Gabe Lyons
1ab3ad3986
feat(gql): make gql layer resistant to unresolvable relationships ( #4424 )
...
* query for custom properties on containers
* dont break gql if fine grained lineage is present
2022-03-16 14:19:10 -07:00
Matt Matravers
ca4de4d7ac
build: Fix line endings for Windows check-out ( #4370 )
...
To avoid the need for dos2unix when checking out the repo on Windows.
See: https://docs.github.com/en/get-started/getting-started-with-git/configuring-git-to-handle-line-endings
2022-03-16 12:17:47 -07:00
mayurinehate
9025bfb8d0
fix(ingest): extract redshift platform correctly from sqlalchemy uri ( #4421 )
...
* fix(ingest): extract redshift platform from sqlalchemy uri
2022-03-16 19:36:23 +01:00
Gabe Lyons
ad039aab67
tests(cypress): reduce cypress flakiness by retrying login on failure ( #4423 )
...
* query for custom properties on containers
* retry login in cypress
* syntax fix
2022-03-16 10:37:32 -07:00
Aseem Bansal
2d10d9905b
fix: change log levels to debug ( #4411 )
2022-03-15 19:32:03 -07:00
John Joyce
11f809abd2
feat(oidc): Adding support for extracting single string groups claim ( #4419 )
2022-03-15 17:41:19 -07:00
John Joyce
86f240769f
Fixing OIDC encryption bug from v0.8.29 ( #4418 )
2022-03-15 17:41:08 -07:00
Gabe Lyons
431ba4b2a9
fix(ingestion): looker - various fixes ( #4394 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-03-15 15:48:34 -07:00
Pedro Silva
e8f6c4cabd
feat(cli) Changes rollback behaviour to apply soft deletes by default ( #4358 )
...
* Changes rollback behaviour to apply soft deletes by default
Summary:
Addresses feature request: Flag in delete command to only delete aspects touched by an ingestion run; add flag to nuke everything by modifying the default behaviour of a rollback operation which will not by default delete an entity if a keyAspect is being rolled-back.
Instead the key aspect is kept and a StatusAspect is upserted with removed=true, effectively making a soft delete.
Another PR will follow to perform garbage collection on these soft deleted entities.
To keep old behaviour, a new parameter to the cli ingest rollback endpoint: --hard-delete was added.
* Adds restli specs
* Fixes deleteAspect endpoint & adds support for nested transactions
* Enable regression test & fix docker-compose for local development
* Add generated quickstart
* Fix quickstart generation script
* Adds missing var env to docker-compose-without-neo4j
* Sets status removed=true when ingesting resources
* Adds soft deletes for ElasticSearch + soft delete flags across ingestion sub-commands
* Makes elastic search consistent
* Update tests with new behaviour
* apply review comments
* apply review comment
* Forces Elastic search to add documents with status removed false when ingesting
* Reset gradle properties to default
* Fix tests
2022-03-15 12:05:52 -07:00
Dexter Lee
ab0b5162af
fix(lineage): Move lineage registry to entity-registry module ( #4412 )
...
* Move lineage registry
* Fix test
2022-03-15 11:59:59 -07:00
Gabe Lyons
540d1b3be5
feat(lineage): hide soft deleted nodes in lineage & adds banner in entity page ( #4410 )
...
* query for custom properties on containers
* updating queries
* hide soft deleted entities in lineage viz
* add banner for soft deleted entities
* fix tests
2022-03-15 11:17:13 -07:00
Ankit keshari
55357783f3
Refactoring the quries into a single one to get the search results on Home Page ( #4372 )
2022-03-14 22:24:45 -07:00
Ravindra Lanka
30ed5f2a2f
feat(ingestion): cli - Add the ability to query the latest timeseries aspect value via the get command. ( #4395 )
2022-03-14 19:03:56 -07:00
Jorgen Evens
af5c4ee4d0
fix(ingest): handle endpoints without 200 response in openapi ( #4332 )
2022-03-14 17:52:08 -07:00
Ravindra Lanka
50ef658339
fix(ingestion): Invoke SqlLineageSQLParser's implementation in a separate process ( #4391 )
2022-03-14 17:49:03 -07:00
Abhiram98
d82e1d31a4
fix(ingestion): redshift - read all tables ( #4345 )
2022-03-14 17:46:35 -07:00
WaStCo
bd3090ae86
fix(query_combiner): add try block to handle queries of type str ( #4397 )
...
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-03-14 17:45:28 -07:00
Dexter Lee
a12c9d2a30
Add flag to enable cache ( #4335 )
2022-03-14 16:40:10 -07:00
Hassan Shahid
eb9a167e0d
build(ingestion): update markupsafe pinning for Airflow compatibility ( #4388 )
2022-03-14 16:19:59 -07:00
Ravindra Lanka
5aaf187371
fix(ingestion): Fix mypy error stateful committable & restore mypy version. ( #4408 )
2022-03-14 14:15:14 -07:00
John Joyce
a453ebf02d
feat(autocomplete): Show recent searches + improved autocomplete ( #4400 )
2022-03-14 14:07:49 -07:00
Aseem Bansal
1198123d78
fix: telemetry failure should not cause CLI failure ( #4406 )
2022-03-14 12:25:22 -07:00
John Joyce
ecd263b0d2
feat(*): Support setting owner type when assigning ownership ( #4354 )
2022-03-14 11:14:32 -07:00
Aditya Radhakrishnan
23404f9c35
fix(containers) - configure domain resolver for containers ( #4404 )
2022-03-14 11:09:05 -07:00
MugdhaHardikar-GSLab
a8a4d82d25
feat(spark-lineage): add support for custom env and platform_instance ( #4208 )
2022-03-14 10:48:27 -07:00
Aseem Bansal
f0230b05f5
fix: add missing logo ( #4386 )
2022-03-14 09:05:50 -07:00
cccs-eric
cb9b99f0ba
fix(ingest) Azure AD: support nested groups ( #4367 ) ( #4368 )
...
LGTM - Thanks!
2022-03-14 08:59:04 -07:00
Aseem Bansal
4bcc2b3d12
feat(ingestion): improve logging, docs for bigquery, snowflake, redshift ( #4344 )
2022-03-14 08:50:29 -07:00
Gabe Lyons
bb413beb24
Revert "Fixed Bug: Alpha slider doesn’t move, only the color slider is movable in tag color picker ( #4359 )" ( #4390 )
...
This reverts commit cf7cefe20389e20754718cd07dab4ff13eba974c.
2022-03-13 13:43:29 -07:00
RyanHolstien
63a333928b
docs(model): update docs on extending metadata model, remove inaccurate faq ( #4393 )
2022-03-12 15:16:14 -08:00
leifker
bb8f45bd20
feat(ingestion): add java protobuf schema ingestion ( #4178 )
...
Co-authored-by: leifker <david.leifker@landsend.com>
2022-03-11 10:13:00 -08:00
John Joyce
c713b60810
fix(oidc): Update group membership each login (and make group extraction disabled by default) ( #4380 )
2022-03-11 08:49:31 -08:00
Gabe Lyons
7eb0017c44
fix(browse): fix browse double click issue ( #4382 )
2022-03-11 08:46:26 -08:00
Dexter Lee
fab9c23aa5
fix(removed): Make sure removed entities do not appear on recommendations ( #4353 )
2022-03-10 18:45:08 -08:00
mayurinehate
3ea72869f3
feat(GE): add option to disable sql parsing, use default parser ( #4377 )
2022-03-10 17:36:59 -08:00
Ankit keshari
cf7cefe203
Fixed Bug: Alpha slider doesn’t move, only the color slider is movable in tag color picker ( #4359 )
2022-03-10 17:29:45 -08:00
David Sanchez
49fda0fbf4
fix(docs): change cabify link ( #4373 )
2022-03-10 16:33:47 -08:00
Gabe Lyons
0e4a26b2a9
fix(ui): some small ui fixes for lineage ( #4381 )
...
* query for custom properties on containers
* small lineage ui nits
2022-03-10 15:23:47 -08:00
David Sanchez
d474387eeb
Add cabify as adopter ( #4360 )
2022-03-09 20:07:12 -08:00
