3981 Commits

Author SHA1 Message Date
Vivek Ratnavel Subramanian
eb81a6a61a
Fix json2ts build errors (#6332) 2022-07-25 12:10:50 -07:00
Teddy
aae4410c93
Fies #6183 - Ability to set profile sample at the profilier workflow level (#6292)
Fies  #6183 - Ability to set profile sample at the profilier workflow level (#6292)
2022-07-25 12:08:20 +02:00
Sriharsha Chintalapani
67339a6c25
Fix #6313: Add om-comment to entities (#6315)
* Fix #6313: Add om-comment to entities

* Fix #6313: Add om-comment to entities
2022-07-25 12:28:21 +05:30
Snyk bot
7c7e19b36f
fix: upgrade mobx from 6.0.1 to 6.6.1 (#6301)
Snyk has created this PR to upgrade mobx from 6.0.1 to 6.6.1.

See this package in npm:


See this project in Snyk:
https://app.snyk.io/org/harshach/project/450b4396-0ef4-4bb2-8b7a-9c8e6ab6c41d?utm_source=github&utm_medium=referral&page=upgrade-pr
2022-07-24 23:06:51 -07:00
Abhishek Pandey
f125c597a9
Atlas connector fix (#4112)
* refactored-atlas-schema

* atlas-source-connector-fixed

* code-formatted

* updated-service-creation

* code-formatted

* atlas-json-updated

* atlas-removed-from-database-service

* atlas-fqn-and-execution-flow-updated

* atlas-connector-fixed

* atlas--amundsen-removed-from-db-service

* code-cleanup

* removed-unused-codes

* code-smelled

* code-smell-removed
2022-07-25 11:23:36 +05:30
Nahuel
e2b176c5db
Fix failing test due to missing parameter in IngestionPipelineResource constructor (#6317) 2022-07-24 22:51:30 -07:00
Francisco J. Jurado Moreno
ae491f747f
[TASK-6295] Reduce memory footprint for S3 ingestion (#6308)
* Reduce memory footprint for parquet & CSV formats

* Add pagination, remove local var

* Add jsonl parser
2022-07-25 07:24:57 +02:00
Shailesh Parmar
3d2f3cfd15
Cypress: Add E2E test for delete service work flow (#6150) 2022-07-24 22:24:47 -07:00
Milan Bariya
5e5e728ea9
Create Messaging Topology (#6201)
Create Messaging Topology (#6201)
2022-07-25 07:17:15 +02:00
Nahuel
52b416ba65
Fix#5918: Save Airflow config credentials in secrets manager when bootstrapping (#6270)
* Implementation for saving auth provider airflow parameters in the Secret Manager

* Add Airflow configuration validator

* Add tests for validators

* Add missing tests
2022-07-25 07:08:14 +02:00
Pere Miquel Brull
7560635114
Fix #6280 - Bump DeltaLake version, tests and docs (#6307)
Fix #6280 - Bump DeltaLake version, tests and docs (#6307)
2022-07-24 18:49:15 +02:00
Pere Miquel Brull
e51aadae03
Fix curl vulnerability (#6311) 2022-07-24 08:24:35 -07:00
Pere Miquel Brull
810e6c7dfc
Fix #5822 - Remove looker env and rename props (#5700)
Fix #5822 - Remove looker env and rename props (#5700)
2022-07-24 16:02:26 +02:00
Francisco J. Jurado Moreno
539da30ca0
Ingest triggered dags too (#6296) 2022-07-23 10:23:12 -07:00
Pedro Sereno
14b9439b98
feature: add metabase sqllineage extraction (#6257)
* feature: add metabase sqllineage extraction

this solves issue-6190 and also fixes a bug in the existing lineage
that was trying to access key with a typo for the database name

* fix: sqllineage import
2022-07-23 13:44:31 +02:00
Francisco J. Jurado Moreno
78dd44ed32
[TASK-6140] Add OMeta header to SQLAlchemy-based queries (#6293)
[TASK-6140] Add OMeta header to SQLAlchemy-based queries (#6293)
2022-07-23 12:31:26 +02:00
Snyk bot
82c5592538
fix: upgrade com.auth0:java-jwt from 3.19.1 to 3.19.2 (#6272)
Snyk has created this PR to upgrade com.auth0:java-jwt from 3.19.1 to 3.19.2.

See this package in Maven Repository:
https://mvnrepository.com/artifact/com.auth0/java-jwt/

See this project in Snyk:
https://app.snyk.io/org/harshach/project/90e18217-fc70-4a90-bf04-270200cf86de?utm_source=github&utm_medium=referral&page=upgrade-pr
2022-07-22 22:41:27 -07:00
Francisco J. Jurado Moreno
756dae5605
[TASK-6241] Cache ES ingestion when ingesting usage (#6276)
* Cache ingestion

* Uncomment secrets manager

* Fix experiment stuff

* Fix style

* Add LRU cache

* Add tests

* Fix code smell
2022-07-22 23:33:22 +02:00
Nahuel
4d4a2fc2cf
FIX#5916: Only admin user retrieves connection params when external Secrets Manager is configured (#6228)
* Implementation for stop sending connection credentials when user is BOT

* Change way we add the connection to the service in the Secret Manager

* Services connection is not required as we want to stop returning it when SM is configured
2022-07-22 14:02:29 -07:00
Chirag Madlani
c9be0ceff2
fix(ui): app crashing on 401 error (#6287)
* fix(ui): app crashing on 401 error

* add null checkes
2022-07-22 14:02:02 -07:00
Sriharsha Chintalapani
ac4ad77e78
Issue-6289: Security upgrade org.flywaydb:flyway-maven-plugin from 8.1.0 to 8.5.11 (#6290) 2022-07-22 14:01:27 -07:00
Vivek Ratnavel Subramanian
c9ef84197a
Fix #6168 Backend: Restrict who can resolve or close a task (#6258) 2022-07-22 13:36:23 -07:00
Teddy
28623c7455
Fixes #6078 - DB column named metadata conflict with SQA reserved attribute (#6282) 2022-07-22 19:05:32 +02:00
Sachin Chaurasiya
c41af3eb0d
UI : Update Markdown Parser (#6275)
*  UI : Update Markdown Parser

* Add unit test for different formats

* FIx cypress tests
2022-07-22 22:06:01 +05:30
Shailesh Parmar
ba94121fce
UI: Global setting page (#6271)
* added left panel for global setting

* adding style for left panel

* removed unneccessary state depandancy and make setting route allowed only for sandbox and local env
2022-07-22 17:39:44 +05:30
Mayur Singal
75ccc803ad
Fix #5410: Topology for Pipeline Services (#6085)
Fix #5410: Topology for Pipeline Services (#6085)
2022-07-22 13:59:14 +02:00
restnek
41d0c182cb
ISSUE-3790: Remove unnecessary public modifiers in tests (#6222)
Co-authored-by: Sergey Akentyev <Sergey.Akentyev@nedra.digital>
2022-07-22 16:00:46 +05:30
Snyk bot
f67ff638a3
fix: catalog-rest-service/pom.xml to reduce vulnerabilities (#6265)
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-IONETTY-2812456
2022-07-22 08:37:05 +02:00
Teddy
d34d347a1c
overwrite default sum function to add super for BQ overflow (#6252) 2022-07-22 07:49:00 +02:00
mohitdeuex
809143b08f
Generated configs (#6167)
* [Backend][Improvement] Using Generated Configurations files

* [Backend][Improvement] Test failure

* [Backend][Improvement] Update Descriptions

* [Backend][Improvement] Config Resource Test Failure Fix

* [Backend][Config] adding suggested comments
2022-07-22 00:42:44 +05:30
Vivek Ratnavel Subramanian
fe0f9d88e9
Fix #6255 Backend: Ignore dashboard usage summary in activity feed (#6256) 2022-07-21 11:38:35 -07:00
Suresh Srinivas
b8f1491b8f
Fixes #6237 - Add ObjectContext and OperationContext to Policies (#6238)
* Operation context in progress

* Added support for list operation with new authorizer

* Added support for create operation with new authorizer

* Moved a large portion of authorization to new authorization model

* Remove unnecessary code

* Revert loggerLevel default due to codegen limitation

* Added decryptOrNullify to messagingService PUT endpoint

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
2022-07-21 11:25:55 -07:00
Teddy
893665f33d
Fixes #6031 & #6236 -- Handle binary field & UUID when ingesting sample data (#6233)
Fixes #6031 & #6236 -- Handle binary field & UUID when ingesting sample data (#6233)
2022-07-21 20:14:44 +02:00
Pere Miquel Brull
d89521cf52
Fix #6161 - kill endpoint for Airflow REST (#6244)
Fix  #6161 - kill endpoint for Airflow REST (#6244)
2022-07-21 19:04:02 +02:00
Pere Miquel Brull
f97902392d
Add install_all (#6246) 2022-07-21 16:51:46 +02:00
Pere Miquel Brull
385b7edac9
Prepare CI for Airflow APIs (#6240)
Prepare CI for Airflow APIs (#6240)
2022-07-21 12:29:57 +02:00
mohitdeuex
09b34af689
[Backend] Add support for @mentions notification via web sockets #5874 (#6089)
* [Backend] Add support for @mentions notification via web sockets #5874

* [Backend] Reformat source mvn

* [Backend] Thread Conversation Entity Handle

* [Backend][Mention] Updated to not use addressedTo
2022-07-21 15:13:11 +05:30
Sachin Chaurasiya
f6b7af8c6e
Fix #6242 Handle Pipeline without tasks on Pipeline view (#6243) 2022-07-21 15:10:15 +05:30
Sachin Chaurasiya
12ffa9338e
Add unit test for task page components part-2 (#6229) 2022-07-21 10:15:06 +05:30
Harsh Vador
c4169a5105
Fix #4753 UI: Make setting owner and tier tag more intuitive by eliminating Manage tab (#6107)
Co-authored-by: Chirag Madlani <chirag.m@deuexsolutions.com>
2022-07-20 10:32:15 -07:00
Teddy
e1fac99353
Fixes #5723 and implement interface processor logic (#6219)
* Added datetime for min/max

* Added profiler interface

* Update core.py to work with profiler_interface

* Implement interface logic for orm_profiler object

* Fix unique_ratio logic

* removed changes to table.json

* Added Protocol for type hint

* Changed protocol to abc + fixed sonar code smell

* Fixed py_format
2022-07-20 17:54:10 +02:00
Suresh Srinivas
7768b4d0e9
Fixes #6205 Initialize test users for integration testing (#6206) 2022-07-20 06:52:26 -07:00
Shailesh Parmar
0d1e57baf2
fixed issue 6071: Service ingestion workflows should be configurable as scheduled or on-demand (#6216)
* fixed issue 6071: Service ingestion workflows should be configurable as scheduled or on-demand

* fixing cypress
2022-07-20 18:40:20 +05:30
Teddy
0505eb1a6a
Fixes #6074 -- Update str to datetime/date for min/max (#6178)
* changed min/max str type to datetime/date

* bumped version dev

* Fixed typo in datetime -> dateTime
2022-07-20 14:46:00 +02:00
Sachin Chaurasiya
91c6de706c
Fix softDelete should not sent hardDelete true (#6226) 2022-07-20 17:20:36 +05:30
Pere Miquel Brull
2936c0e4e3
Remove retry in ES query (#6191)
Remove retry in ES query (#6191)
2022-07-20 12:44:50 +02:00
Rabi Narayan Sahoo
0190456f3d
Removed test environment (#6214) 2022-07-20 14:47:56 +05:30
Onkar Ravgan
1673b1aa30
DynamoDB Topology refactor (#5967)
DynamoDB Topology refactor (#5967)
2022-07-20 10:42:40 +02:00
Chirag Madlani
c556481610
fix(ui): #6068 softDelete should not sent hardDelete true (#6218) 2022-07-20 14:07:37 +05:30
Nahuel
dfb017008b
Fix missing SonarCloud decorator in PR when triggering GH workflow for py3.9 (#6220) 2022-07-20 10:28:18 +02:00