423 Commits

Author SHA1 Message Date
Teddy
4b9f213dbf
Fixes Issue #11863 - Add Status to DQ (#11893)
* feat: added entityReference field in testSuite to link testSuite to an entity when the testSuite is executable.

* feat: added `executableEntityReference` as an entity reference for executable test suite to their entity

* feat: add status object to test case results

* feat: ran python linting

* feat: fixed  update to
2023-06-06 10:09:16 +00:00
Teddy
721869428e
Revert "Fixe Issue #11863 - Add Status logic for test case results (#11881)" (#11892)
This reverts commit 06735fe8dbaac5b267c9a2cf744ca154f88a9247.
2023-06-06 09:56:12 +02:00
Teddy
06735fe8db
Fixe Issue #11863 - Add Status logic for test case results (#11881)
* feat: added entityReference field in testSuite to link testSuite to an entity when the testSuite is executable.

* feat: added `executableEntityReference` as an entity reference for executable test suite to their entity

* feat: add status object to test case results

* feat: ran python linting
2023-06-06 09:45:49 +02:00
Ayush Shah
65f370e4aa
Rename GCS to GCP (#11812) 2023-06-06 11:57:00 +05:30
Suresh Srinivas
ee52b631f9
Move entity registration from EntityRepository to EntityResource (#11886) 2023-06-05 20:51:08 -07:00
Mohit Yadav
26db825b71
Added Support for Slack Related Configuration , Added Slack Bot , Sla… (#11791)
* Added Support for Slack Related Configuration , Added Slack Bot , Slack Installer and Slack Application Configuration

* comment

* Checkstyle

* Update Encrypt and Decrypt to encrypt all settings for slack

* Fix typo

* Update version for client and bolt

* Update deps

* Remove dependency for Slack bolt servlet
2023-06-06 00:55:14 +05:30
Mohit Yadav
146a7b285c
Fix Update Issue in MetadataService in case the ES config is updated (#11885) 2023-06-06 00:22:33 +05:30
Suresh Srinivas
d978580703
Fixes #11872 - Add authorization for Usage APIs (#11873) 2023-06-02 15:50:29 -07:00
Suresh Srinivas
b4d56bb559
Remove unnecessary constructors in ResultList implementations (#11871) 2023-06-02 13:03:24 -07:00
Teddy
c98a15ca19
Fixes #11705 - Update ingestion and backend to match new DQ flow (#11836)
* feat: refactor ingestion flow logic

* feat: ran python linting

* feat: update tests to match new workflow

* feat: ran python linting

* feat: update sample data test suite name

* feat: Added backend logic to support logical and executable test suites

* feat: clean up java and json code

* feat: added sample data for logical and executable test suites

* feat: remove executable from CreateTestSuite

* feat: ran python and java linting

* feat: added README info for data quality structure

* skipping cypress to keep main green

* fixed typescript type issue

---------

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2023-06-01 23:19:13 -07:00
Pere Miquel Brull
fdeea71671
Fix Looker explore git link & Add BitBucket reader (#11837)
* Add looker test connection step

* Add looker test connection step

* Update Credentials

* Fix explore link and add bitbucket reader

* Format

* Fix test

* Fix spline linting

* Fix import
2023-06-02 07:19:32 +02:00
Sriharsha Chintalapani
dae4b64326
Fix #11855: Tags can get deleted if the service name matches partially with targetFQN (#11856)
* Fix #11855: Tags can get deleted if the service name matches partially with targetFQN

* Fix #11855: Tags can get deleted if the service name matches partially with targetFQN
2023-06-01 20:48:29 -07:00
Mohit Yadav
e55628fef3
Improvements for Change Event Parsing Logic (#11616)
* Improvements for Change Event Parsing Logic

* Remove plural from columns , update message and handle case for array field types

* Removed Redundant Code for Feed Threads, moved to util class

* Fix Entity Conversion Failures

* Fix Message Decorator type

* Revert to previous logic for extracting change event

* update File
2023-06-01 21:54:41 +05:30
Mohit Yadav
3255c5980a
Remove Unnecessary fields from GET and DELETE (#11745) 2023-05-28 23:55:13 +05:30
Mohit Yadav
79d6d0bcd3
Add extension to OpenMetadata (#11786)
* Add extension to OpenMetadata

* Typo Comment

* remove log
2023-05-28 23:44:02 +05:30
Louie
956ec58930
Add ES RestHighLevelClient TCP keep alive timeout (#11731)
* Add RestHighLevelClient TCP keep alive timeout

* Merge RestHighLevelClient configs
2023-05-28 10:10:46 -07:00
Suresh Srinivas
f0f64a7b21
Change combined EncryptDecrypt methods to separate Encrypt and Decrpyt methods (#11755) 2023-05-25 12:35:25 -07:00
07Himank
ef2869cd9a
Delete Tasks related to entity when the entity is deleted (#11660)
* Delete Tasks related to entity when the entity is deleted

* Delete all conversation related to entity only when its permanantly deleted

* renamed function name deleteTasksForRelatedEntity to deleteAllConversationsRelatedToEntity

---------

Co-authored-by: Himank Mehta <himankmehta@Himanks-MacBook-Air.local>
2023-05-25 10:48:46 +05:30
Sriharsha Chintalapani
160984baf1
Fix #11673: Service connection details will be viewable based on view permissions and by default masked for users and unmasked for bots (#11738) 2023-05-24 08:54:14 +02:00
Pere Miquel Brull
da32d392d8
Revert ES backend version (#11703)
* Revert ES backend version

* Revert ES backend version

* Revert ES backend version

* Format
2023-05-23 10:00:06 -07:00
Suresh Srinivas
ac8498ab80
Remove unnecessary singletons (#11713) 2023-05-23 08:37:03 -07:00
Mohit Yadav
3050363faa
Fix Random Password not generated when Email Config is present (#11701) 2023-05-22 11:29:33 +05:30
Pere Miquel Brull
d52d773707
Send encrypted automation workflow (#11681) 2023-05-19 15:04:42 +02:00
Pere Miquel Brull
50ad38ea0f
Fix #11548 - Secrets Managers comms with OMeta (#11602)
* Remove secretsManagerCredentials from backend

* Remove secretsManagerCredentials from backend

* Add secrets manager loader

* Load SM in the ometa client

* Fix tests

* Fix tests

* Fix Lint

* Mock AWS region

---------

Co-authored-by: Ayush Shah <ayush@getcollate.io>
2023-05-19 09:43:11 +02:00
Deepa Rao
2369c782f8
Part of fix 11492 - Add missing fields in Container update (#11493)
* Part of fix 11492 -  Provide support for updating Container entity

* Part of fix 11492 -  Provide support for updating Container entity
2023-05-18 12:52:54 -07:00
07Himank
4d2bbb3b75
Logged the Email Messages which are not sent as smpt settings is not … (#11650)
* logged the Email Messages which are not sent as smpt settings is not enabled

* modified change event message

* used a genric message for all

* logs a genric message with email id

---------

Co-authored-by: Himank Mehta <himankmehta@Himanks-MacBook-Air.local>
2023-05-18 19:03:14 +05:30
07Himank
fb4e7c3c74
Fix Docker Image Java Vulnerabilities (#11623)
* fixed vulnerablity issue

* jackson-dataformat

---------

Co-authored-by: Himank Mehta <himankmehta@Himanks-MacBook-Air.local>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2023-05-17 16:38:05 -07:00
Sriharsha Chintalapani
923360c47a
Fix #11543: Elasticsearch Re-index with language other than EN will m… (#11628)
* Fix #11543: Elasticsearch Re-index with language other than EN will make error appears

* Fix tag mappings
2023-05-17 11:18:07 +02:00
Sachin Chaurasiya
4df64ef6fe
feat(#11596): add support for custom logo config in settings (#11597)
* feat(#11596): add support for custom logo config in settings

* fix: edit custom logo config

* chore: update application config provider

* fix: unit test

* fate: create separate brand logo component

* Add Accessible Logo Config From ConfigResource

* update custom logo api

* minor change

* fix: styling and use brand logo component

* fix(#11503) Custom Login Logo does not change after adding new custom logo

* restored delete files

* doc: update custom logo config doc

* update the icon

* test: add unit test for brand logo

* test: add unit test for custom logo config setting page

* test: add unit test for custom logo config form

* test: fix cy test

* fix: url input validation

* test: add cypress test

* test: update cy test to check for validation

* update the doc

* test: fix cypress test

* chore: make height and width required in BrandLogo component

* chore: update component name

---------

Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
2023-05-17 11:26:34 +05:30
Mohit Yadav
d12d32bf65
Add settings to Db for Custom Logo (#11583)
* Add settings to Db for Custom Logo

* Add test for Settings
2023-05-12 23:34:02 +05:30
Pere Miquel Brull
4c77eaea72
Filter tables by databaseSchema (#11574) 2023-05-12 10:25:08 -07:00
Mohit Yadav
93e97674c5
Data Insight Report Improvement (#11547)
* Fix Mail to be sent to Team Users in case the email is missing

* Unwanted Comment
2023-05-11 13:55:57 +05:30
Suresh Srinivas
14b622efd0
11287 Task - Add retention period and customer properties to Database, Schema, and Tables (#11511) 2023-05-10 16:08:21 -07:00
mohitdeuex
944a07cbd5 Trigger Api Only admin can invoke 2023-05-10 23:57:21 +05:30
Mohit Yadav
5bbd49cc60
[InsightReport] DataInsight Manual trigger Job (#11538)
* Add Manual Trigger for Insight Reports

* unrequ change

* add time diff comment
2023-05-10 23:49:50 +05:30
Mohit Yadav
647ff49dcb
Sonar Fixes P1 (#11507)
* sonar lint fixes

* PARENT_FIELD

* review comments

* Fix failing glossaryTest
2023-05-10 20:30:17 +05:30
Mohit Yadav
0aa6c08cf6
Servlets Log Error Messages (#11514)
* remove stack trace logging

* Fixed Error Messages

* Feed Servelt logging
2023-05-10 10:56:28 +05:30
Teddy
60de33d7cf
Fixes #11384 - Implement mem. optimization for sys. metrics (#11460)
* fix: optimize system metrics retrieval for memory

* fix: ran python linting

* fix: logic to retrieve unique system metrics operations

* fix: added logic to clean up query before parsing it

* fix: added E2E tests for rds, bq, snflk system metrics

* fix: ran python linting

* fix: fix postgres query + add default byte size to env var

* fix: ran python linting
2023-05-09 12:05:35 +02:00
Louie
5bce6447f6
Fixed typo SMPTS to SMTPS (#11487)
* Fixed typo SMPTS to SMTPS

* sonar lint fixes

---------

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
2023-05-09 11:22:20 +05:30
Nahuel
b2f2320145
Fix#10584: Update Lineage API to support lineage from table to dashboard data model (#11489)
* Fix: Update Lineage API to support lineage from table to dashboard data model

* Minor change
2023-05-08 22:02:11 -07:00
Pere Miquel Brull
80af2b20bb
Centralize SSL Schemas & Add SSL for Airflow REST (#11363) 2023-05-08 21:05:10 +02:00
Mohit Yadav
f50bf5ec70
Bootstrap users fix + Ldap Fix error message (#11463)
* Fix issues in Bootstrapping Admin Users

* Fix Ldap Binding Message

* Remove delete

* do not remove the user on own

* failing tests fix

* null should also add auth-mechanism
2023-05-08 23:52:55 +05:30
07Himank
196681b499
fixed elastic search update issue when entity is restored (#11488)
Co-authored-by: Himank Mehta <himankmehta@Himanks-MacBook-Air.local>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
2023-05-08 23:52:41 +05:30
Mohit Yadav
98201724c3
Fix for test logging exception for metadata service + updated Insight Template URl (#11485) 2023-05-08 21:25:41 +05:30
Ayush Shah
65fc94a292
Fix Dynamodb connection (#11473)
---------

Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
Co-authored-by: Nahuel Verdugo Revigliono <nahuel@getcollate.io>
2023-05-08 15:48:38 +00:00
Mohit Yadav
498873c011
Data insight reporting + extras (#11317)
* Refactor Data Insight Chart for Reusability

* Data Insight Reporting

* Add Schedule Info

* Add Error Handling

* Add Profile Field

* Remove Endpoint as required field

* Missing Language

* Reformat

* Remove Task and Test Result Settings

* Fix test

* fix: typescript errors

* fix: send alertType for subscriptions request

* feat: add alert data insights report page

* Fix test

* fix: alert type typescript error

* fix: loading flicker on alerts page

* chore: add placeholders for data insight report alert page

* fix: alert icon styling

* fix: confirmation is not showing up for delete operation for subscription.

* fix: delete operation is not working from alert details page

* fix Activity Feed Errors on update

* fix: test

* chore: change the description text area to the markdown editor

* Data Insight Reporting should be created on system startup

* Restrict DataInsight Report to only one

* Review Comments

* feat: show the default DataInsightReport data

* sonar fixes

* sonar fixes

* deprecate ConfirmationModal

* trigger should be updated

* feta: add edit flow for data insight report

* remove custom option for schedule info

* chore: update data insight report icon

* test: add unit test for add data insight alert form

* fix: update cypress tests

* update local message

* test: add unit tests

* move sql changes to a different file

* spacing issues

* add tag provider in createRequest

* chore: send provider in create and update alert request.

* fix: code smells

* fix: comment typo

* fix: permission issue for event subscription

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2023-05-08 16:54:45 +05:30
07Himank
9d61d63ce4
solve the issue for mutually exclusive tags validation for PUT API (#11428)
* solve the issue for mutually exclusive tags validation for PUT API

* checkstyle

---------

Co-authored-by: Himank Mehta <himankmehta@Himanks-MacBook-Air.local>
2023-05-08 15:06:42 +05:30
Nahuel
41ea49d11e
Fix: Secrets Manager not working with Airflow AWS config (#11459)
* Fix: Secrets Manager not working with Airflow config

* Address Python Checkstyle

* Minor change
2023-05-08 07:54:31 +00:00
Suresh Srinivas
6606576575
Fixes #11397 hasAnyRole and inAnyTeam condition policy error (#11471) 2023-05-06 16:55:31 -07:00
Suresh Srinivas
52cd031036
Fixes #11245 - fix test failures (#11465) 2023-05-05 16:52:33 -07:00