Xu Wang
d04092e634
feat(ingest): add python utility classes for NotebookUrn, CorpuserUrn and CorpGroupUrn ( #4469 )
...
* feat: add python utility classes for NotebookUrn, CorpuserUrn and CorpGroupUrn
Co-authored-by: Xu Wang <xu.wang@grandrounds.com>
Co-authored-by: Ravindra Lanka <rslanka@gmail.com>
2022-03-23 16:07:57 -07:00
Shubham Thakre
fd3723ac7e
Feature/modal-validation-and-UI-fixes-updates ( #4439 )
2022-03-23 13:35:45 -07:00
Kevin Hu
a7b0275b86
feat(ingest): simplify event IDs for function invocations ( #4398 )
...
* Simplify function call events
Co-authored-by: Ravindra Lanka <rslanka@gmail.com>
Co-authored-by: Ravindra Lanka <rslanka@gmail.com>
2022-03-23 12:52:29 -07:00
Sergio Gómez Villamor
9fbb521bfe
chore: acryl-data 0.6.12 ( #4474 )
2022-03-23 10:24:48 -07:00
Tamas Nemeth
5c8017789a
fix(redshift) Properly handling database alias in redshift usage and redshift lineage generation ( #4473 )
...
* Fix database-alias in redshift usage and redshift lineage generation
2022-03-23 16:01:14 +01:00
Gabe Lyons
4c1d04910b
enabling ml tabs ( #4471 )
2022-03-23 07:12:22 -07:00
Ethan Claassen
4476356ec8
fix: java dependency vulnerabilities ( #4460 )
...
* fix: java dependency vulnerabilities
* Upgrade org.hibernate:hibernate-validator (PLT-2)
2022-03-22 14:21:55 -07:00
Tamas Nemeth
2013d5ddbd
feat(ingest) data-lake: Add s3 properties metadata when ingesting s3 files ( #4453 )
...
* Add s3 porperties for data lake ingestion
2022-03-22 10:31:18 -07:00
Aseem Bansal
861015d57a
fix: change for repository change ( #4464 )
2022-03-22 09:21:09 -07:00
Aseem Bansal
15d5e418fb
fix(snowflake-usage): add more error handling ( #4466 )
2022-03-22 08:10:03 -07:00
Fernanda de Camargo
e290e6e07e
fix(ingest): add fix to tableau connector when table has None fields ( #4445 )
...
Co-authored-by: Ludmila Ferreira <ludmila.ferreira@elo7.com>
2022-03-22 14:59:18 +01:00
mayurinehate
885cf26828
docs(hive): update recipe with example to specify kerberos auth ( #4457 )
2022-03-22 13:38:21 +01:00
pedro-iatzky
6a6d744667
fix(ingest): bigquery - fix ingestion of external tables ( #4313 )
2022-03-22 13:35:41 +01:00
Gabe Lyons
c585f291e8
adding final transport options ( #4462 )
2022-03-22 10:03:11 +01:00
Xu Wang
277ed43109
feat(notebook): add data models for Notebook entity ( #4223 )
...
* add Notebook data model
* resolve PR comments
1. add glossaryTerms aspect
2. make text in TextCell not searchable
* add dataPlatformInstance aspect and make notebookTool non-searchable
* make data doc cell title optional
* mark Notebook related aspects and entity as in BETA version
* add comments in entry-registry.yml for notebook entity
Co-authored-by: Xu Wang <xu.wang@grandrounds.com>
2022-03-21 14:10:52 -07:00
Pedro Silva
db35aca869
feat(frontend) Adds multiple group claim support ( #4450 )
2022-03-21 13:33:53 -07:00
Aseem Bansal
c5f1d2c9bd
feat(ingestion): snowflake, bigquery - enhancements to log and bugfix ( #4442 )
...
feat(ingestion): add logging for snowflake, bigquery
2022-03-21 09:50:36 -07:00
Aseem Bansal
dc9228fa9b
doc: add guide for ui tabs ( #4333 )
...
* doc: add guide for ui tabs
* docs: add details on properties tab
* add validation tab
* change arrangement
2022-03-21 07:28:42 -07:00
John Joyce
58dab764c4
Fixing privilege option display bug ( #4443 )
2022-03-18 15:46:59 -07:00
Gabe Lyons
bf35d4c83e
fix tableau connector when it cannot connect to URI ( #4451 )
2022-03-18 15:46:46 -07:00
Xu Wang
89a8fa05eb
(docs) add RFC file to introduce Notebook entity data model ( #4237 )
...
* add RFC file to introduce DataDoc entity
* add PR link
* Model Notebook instead of DataDoc
DataDoc could be viewed as a subset of Notebook. We could model Notebook
instead and make DataDoc a subtype of Notebook
* update picture file name
* Put rfc number and resolve pr comments
Co-authored-by: Xu Wang <xu.wang@grandrounds.com>
2022-03-18 14:43:08 -07:00
Kevin Neville
d8e6f890a9
fix: Replace old repository link with new link ( #4446 )
2022-03-18 14:12:19 -07:00
cuong-pham
12bb2e1231
getting database directly from upstream tables incase there are multiple databases in upstreamDatabases ( #4447 )
2022-03-18 14:11:07 -07:00
Tamas Nemeth
430ca10c15
Passing entity properly on deletion ( #4436 )
...
Query filter use platform property properly if paltform instance specified
2022-03-18 12:30:41 +01:00
Ravindra Lanka
60925e3e8c
Fix bug in the SchemaField type computation for AVRO logical types. ( #4433 )
2022-03-18 12:06:54 +01:00
mayurinehate
2f078c981c
feat(ingestion): tableau - support for tableau version 2021.1 and older ( #4437 )
...
fixes #4119
2022-03-17 14:07:36 -07:00
Pedro Silva
0a522e5c6a
Makes filtered search deletes include BOTH removed and non-removed ( #4440 )
2022-03-17 13:22:28 -07:00
Pedro Silva
693aedc8b9
Adds elasticsearch mapping ( #4444 )
2022-03-17 13:15:18 -07:00
leifker
628d818816
feat(protobuf): Gradle protobuf example project ( #4432 )
2022-03-17 10:43:03 -07:00
Gabe Lyons
2d82531a1d
fix(no-code metadata models in ui): fixes bug with rendering renderSpec aspects ( #4430 )
...
* fix weakly typed aspects after batchgetv2 change
* remove spurious models
2022-03-16 17:03:43 -07:00
Pedro Silva
aa593c32d8
Flexible search on soft delete ( #4405 )
...
* Adds filter logic to correct DB
* Fix build
* Adds documentation & fixes flag typo
* apply review comments
* Adds test for filtered search
* Adds warning log for redundant parameter combo
2022-03-16 16:35:04 -07:00
Aseem Bansal
d4d1635f2b
fix: don't set None default ( #4422 )
2022-03-16 14:59:58 -07:00
Tamas Nemeth
f557b2c1b3
fix(ingestion) containers: Adding platform instance to container keys ( #4279 )
2022-03-16 14:57:50 -07:00
Gabe Lyons
1ab3ad3986
feat(gql): make gql layer resistant to unresolvable relationships ( #4424 )
...
* query for custom properties on containers
* dont break gql if fine grained lineage is present
2022-03-16 14:19:10 -07:00
Matt Matravers
ca4de4d7ac
build: Fix line endings for Windows check-out ( #4370 )
...
To avoid the need for dos2unix when checking out the repo on Windows.
See: https://docs.github.com/en/get-started/getting-started-with-git/configuring-git-to-handle-line-endings
2022-03-16 12:17:47 -07:00
mayurinehate
9025bfb8d0
fix(ingest): extract redshift platform correctly from sqlalchemy uri ( #4421 )
...
* fix(ingest): extract redshift platform from sqlalchemy uri
2022-03-16 19:36:23 +01:00
Gabe Lyons
ad039aab67
tests(cypress): reduce cypress flakiness by retrying login on failure ( #4423 )
...
* query for custom properties on containers
* retry login in cypress
* syntax fix
2022-03-16 10:37:32 -07:00
Aseem Bansal
2d10d9905b
fix: change log levels to debug ( #4411 )
2022-03-15 19:32:03 -07:00
John Joyce
11f809abd2
feat(oidc): Adding support for extracting single string groups claim ( #4419 )
2022-03-15 17:41:19 -07:00
John Joyce
86f240769f
Fixing OIDC encryption bug from v0.8.29 ( #4418 )
2022-03-15 17:41:08 -07:00
Gabe Lyons
431ba4b2a9
fix(ingestion): looker - various fixes ( #4394 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-03-15 15:48:34 -07:00
Pedro Silva
e8f6c4cabd
feat(cli) Changes rollback behaviour to apply soft deletes by default ( #4358 )
...
* Changes rollback behaviour to apply soft deletes by default
Summary:
Addresses feature request: Flag in delete command to only delete aspects touched by an ingestion run; add flag to nuke everything by modifying the default behaviour of a rollback operation which will not by default delete an entity if a keyAspect is being rolled-back.
Instead the key aspect is kept and a StatusAspect is upserted with removed=true, effectively making a soft delete.
Another PR will follow to perform garbage collection on these soft deleted entities.
To keep old behaviour, a new parameter to the cli ingest rollback endpoint: --hard-delete was added.
* Adds restli specs
* Fixes deleteAspect endpoint & adds support for nested transactions
* Enable regression test & fix docker-compose for local development
* Add generated quickstart
* Fix quickstart generation script
* Adds missing var env to docker-compose-without-neo4j
* Sets status removed=true when ingesting resources
* Adds soft deletes for ElasticSearch + soft delete flags across ingestion sub-commands
* Makes elastic search consistent
* Update tests with new behaviour
* apply review comments
* apply review comment
* Forces Elastic search to add documents with status removed false when ingesting
* Reset gradle properties to default
* Fix tests
2022-03-15 12:05:52 -07:00
Dexter Lee
ab0b5162af
fix(lineage): Move lineage registry to entity-registry module ( #4412 )
...
* Move lineage registry
* Fix test
2022-03-15 11:59:59 -07:00
Gabe Lyons
540d1b3be5
feat(lineage): hide soft deleted nodes in lineage & adds banner in entity page ( #4410 )
...
* query for custom properties on containers
* updating queries
* hide soft deleted entities in lineage viz
* add banner for soft deleted entities
* fix tests
2022-03-15 11:17:13 -07:00
Ankit keshari
55357783f3
Refactoring the quries into a single one to get the search results on Home Page ( #4372 )
2022-03-14 22:24:45 -07:00
Ravindra Lanka
30ed5f2a2f
feat(ingestion): cli - Add the ability to query the latest timeseries aspect value via the get command. ( #4395 )
2022-03-14 19:03:56 -07:00
Jorgen Evens
af5c4ee4d0
fix(ingest): handle endpoints without 200 response in openapi ( #4332 )
2022-03-14 17:52:08 -07:00
Ravindra Lanka
50ef658339
fix(ingestion): Invoke SqlLineageSQLParser's implementation in a separate process ( #4391 )
2022-03-14 17:49:03 -07:00
Abhiram98
d82e1d31a4
fix(ingestion): redshift - read all tables ( #4345 )
2022-03-14 17:46:35 -07:00
WaStCo
bd3090ae86
fix(query_combiner): add try block to handle queries of type str ( #4397 )
...
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-03-14 17:45:28 -07:00
