2200 Commits

Author SHA1 Message Date
Chirag Madlani
c936ac3a41
feat(ui): Data observability and notifications (#14806)
* Centralize EventType

* Format better for readability

* Add Handling for Thread as Change Event

* Centralize logic for Entity Message Creation

* Add Thread Parent Message in Conversation

* Add Task and Announcement

* Support for multiple destinations

* Delete existing alerts for schema changes

* Delete all tables data for event subscription

* Centralize logic for Notifications and Observability

* Change Field Name and Remove redundant code

* Test Fixes

* Add more fields

* Add Optional

* Logical Test Case Addition Chnage Event

* Add Filter By Owner

* Fix Email Entity Url

* added data observability settings page

* localization changes for other languages

* Handler closure and cleanup

* complete create observibility flow

* fix searchIndex method error

* Update Entity Observability Filter

* working observability creation

* complete creation flow

* fix action with arguments

* fix form validations and form data formulation for 'input.actions' field

* localization changes for other languages

* Fixes for Data Observability

* Add mention notification

* Only apply mention to conversation

* fIx test case

* bug fixes for add and edit observability alert form functionality

* fIx test case

* add feature to config internal along with external destinations in alert form

* Fix Formatting

* Fix Url Redirection

* add observability alert details page

* localization changes for other languages

* remove filter and action required rules

* fix styling for observability form and details page

* add delete functionality on observability alert details page

* update view page layout and add a warning in configure destination step

* localization changes for other languages

* feat(ui): support notification with new flow (#14848)

* feat(ui): support notification with new flow

* fix notifications

* add missing filters for notification alert creation flow

* update the filter hiding logic to show at the start always

* add check to show Actions section in observability alert creation form

* code cleanup and improvements

* add breadcrumb to add notification alert page

* Add General Metadata Filters

* remove code smells and code cleanup for add notification page

* add new filter

* show activity feed alert on notifications list page

* add notification alert details page changes

* localization changes for other languages

* show icons for all the entities in the alert trigger dropdown

* redirect to notification alert listing page after deleting the notification alert

* change add alert page title

* add logic to disable all destinations except email for users

* fixed unit tests

* code improvements and cleanups

---------

Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
2024-01-26 13:56:18 +05:30
07Himank
5e653d25ff
fix a part of es exception while migrate (#14876) 2024-01-25 20:03:15 +05:30
Mayur Singal
dcd3d47c2b
Fix #14590: Improve airflow plugin error message (#14839)
* Fix #14590: Improve airflow plugin error message

* Update openmetadata-service/src/main/java/org/openmetadata/service/clients/pipeline/airflow/AirflowRESTClient.java

Co-authored-by: Ayush Shah <ayush@getcollate.io>

* Update msg

* Update RichTextEditorPreviewer in AirflowMessageBanner component

---------

Co-authored-by: Ayush Shah <ayush@getcollate.io>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2024-01-25 15:26:49 +01:00
07Himank
cb7db8ce8f
Minor fix Search service (#14837)
* Minor fix

* fix minor search fixes
2024-01-25 18:17:48 +05:30
Onkar Ravgan
70316b9680
MINOR: Fixed life cycle index mapping for raw_cost_analysis_report_index (#14832)
* fix life cycle index mapping

* fixes

* removed epoch
2024-01-24 09:23:09 -08:00
07Himank
115870b2af
Pipeline and stored procedure lineage fix (#14681)
* pipeline and stored procedure lineage

* pipeline and stored procedure lineage

* fix: pass entity type in url

* fix unit tests

* pipeline and stored procedure lineage

* pipeline lineage

* pipeline and stored procedure lineage

* fix performance issues

* pipeline and stored procedure lineage done

* optimisation

* fix fullscreen mode

* add pipeline animation

* update loading state

* fix styling

* update pipeline status

* fixes

* fix cypress

* fix cypress

* fix cypress

---------

Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2024-01-24 11:04:31 +05:30
Chirag Madlani
45efaefc46
fix(ui): password error message for char limits (#14808)
* fix(ui): password error message for char limits

* fix java side code
2024-01-23 12:38:35 +05:30
Sriharsha Chintalapani
a9e193608c
Fix #14318: Add support of JSON logs (#14783) 2024-01-21 22:59:28 -08:00
Sriharsha Chintalapani
15eb094cff
Improve error response to the client. Added errorType so that client can handle better than depending on the http status codes (#14784) 2024-01-21 08:07:07 -08:00
Mohit Yadav
0851b87442
Use 8.2.0 version of mysql (#14801) 2024-01-19 23:41:46 +05:30
Teddy
71592df3e7
fix: filtering logic when getting latest incidents (#14760) 2024-01-18 08:12:25 +00:00
Mohit Yadav
1e6c1a616b
Add Notification [WIP] (#14674)
* Centralize EventType

* Format better for readability

* Add Handling for Thread as Change Event

* Centralize logic for Entity Message Creation

* Add Thread Parent Message in Conversation

* Add Task and Announcement

* Support for multiple destinations

* Delete existing alerts for schema changes

* Delete all tables data for event subscription

* Centralize logic for Notifications and Observability

* Change Field Name and Remove redundant code

* Test Fixes

* Add more fields

* Add Optional

* Logical Test Case Addition Chnage Event

* Add Filter By Owner

* Fix Email Entity Url

* Handler closure and cleanup
2024-01-18 12:46:01 +05:30
Sriharsha Chintalapani
bfa8827d38
Fix #14038: Inconsistent search results between auto-suggest box and … (#14747)
* Fix #14038: Inconsistent search results between auto-suggest box and actual search results

* use dataAsset instead of all alias

---------

Co-authored-by: karanh37 <karanh37@gmail.com>
2024-01-17 21:37:36 -08:00
Suresh Srinivas
c4b9d1bd21
Dependency updates (#14767) 2024-01-17 19:49:39 -08:00
Mohit Yadav
70b74d7d4f
Remove info log and using JsonUtils to convert the Ingestion Pipeline (#14759) 2024-01-17 17:25:33 +05:30
Mohit Yadav
bfbd953b53
Fix messages and percentages in Data Insight reports (#14731) 2024-01-17 16:11:43 +05:30
Teddy
aa92db3176
fix: clear incident ID when testCase result is success (#14755) 2024-01-17 10:23:36 +00:00
Mohit Yadav
7dcdc1a37d
Fix Expression Parsing (#14753) 2024-01-17 13:22:49 +05:30
Teddy
085dfc0012
MINOR: Update Incident Manager Flow 2024-01-17 07:23:03 +01:00
mohitdeuex
cfbb94aa32 Call Stop at the end 2024-01-17 10:51:29 +05:30
Teddy
1ace95c9c5
MINOR: add recordChange call for computePassedFailedRowCount (#14716)
* MINOR: add recordChange call for `computePassedFailedRowCount`

* style: ran java linting
2024-01-16 07:55:34 -08:00
Sriharsha Chintalapani
b4b1b2e224
Fix #14694: Search - Change default operator to OR instead of AND (#14695)
* Fix #14694: Search - Change default operator to OR instead of AND

* Minor: Remove ngram from the indexes

* Tune weights on the search fields
2024-01-15 22:20:20 -08:00
Onkar Ravgan
f1049d55c4
Fixed mode test connection (#14693) 2024-01-12 18:29:12 +05:30
Sriharsha Chintalapani
49c1756583
MINOR - Test Case Ownership, keep severity, add test case result incidentId (#14691)
* MINOR - Test Case Ownership, keep severity, add test case result incidentId

* fix immutability

* Fix tests

* MINOR - Test Case Ownership, keep severity, add test case result incidentId

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2024-01-11 23:36:29 -08:00
mohitdeuex
e418f4da2f Collate Knowledge Center Indexes needs entity 2024-01-12 11:54:47 +05:30
Sriharsha Chintalapani
e786380915
Minor: Add glossary index to SearchIndexFactory (#14690)
* Minor: Add glossary index to SearchIndexFactory

* Minor: Add glossary index to SearchIndexFactory
2024-01-11 16:54:40 -08:00
Shiyang Xiao
241f3c68d7
Fixes #14413: Add SAS connector (#14415)
* feat: SAS Viya connector

* refactor SASCatalog to SAS

* add SAS logo to UI and connection documentation

* doc changes

* modify ingestion logic

* revert original changes

* added support for dataflow & perfect logic for reports/datatables

* add filter doc

* more updates to perfect ingestion for each asset type

* fix a bug with table lineage not created properly

* Delete ingestion/pipelines/sasCatalog.yaml

* precomit fix

* Conversion to database connector

* minor fixes

* make custom properties type generic

* Add SAS javaEnum

* add dummy variable for sas.yaml

---------

Co-authored-by: lizmc <liz.mcintosh@sas.com>
Co-authored-by: Shiyang Xiao <Shiyang.Xiao@sas.com>
2024-01-11 06:46:57 -08:00
Ayush Shah
9c6d202555
Add Sample data, modify regex pattern (#14467) 2024-01-11 14:23:33 +05:30
Mohit Yadav
ff690d8dd4
Format better for readability (#14682) 2024-01-11 12:46:30 +05:30
Mohit Yadav
501c22f6c1
Change for Building Collate List Filter (#14665) 2024-01-10 14:34:14 +05:30
Sriharsha Chintalapani
8d8d71e4f9
Fix #14442: Glossary index is not updated on Glossary deletion (#14638)
* Fix #14442: Glossary index is not updated on Glossary deletion

* Fix #14442: update SearchIndexApp to add Glossary

* Add Glossary to other config schema

---------

Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
2024-01-09 08:34:45 -08:00
07Himank
44af8b3a47
working on lineage es integration (#14181)
* working on lineage es integration

* os change

* working

* working on lineage es integration

* add curremt lineage, special character handling, delete lineage

* remove test code

* update lineage index work done

* fix: add lineage ui changes

* fix: lineage add edit

* fix: center on load

* fix: add remove edges

* fix: column lineage issues

* use reactflow controls

* add collapse

* added upstream and downstream depth diffrently

* depth and collapse

* fix loading of dialog

* add includeDeleted in API

* cleanup

* cleanup

* cleanup

* initial unit tests

* fix tests

* cleanup

* update filter query

* fix: allow sql query to update

* use input instead of select

* unit tests

* unit tests

* fix edge removal

* cleanup

* description and deleted

* fix: initial lineage tests

* fix unit tests

* fix: review comments

* added edgedescription

* refactor custom nodes

* refactor condition

* add pipeline status color

* fix unit tests

* cleanup

* cleanup

* fix: lineage url

* depth issue resolved

---------

Co-authored-by: karanh37 <33024356+karanh37@users.noreply.github.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
2024-01-09 08:34:17 -08:00
Sriharsha Chintalapani
9cafde3847
Fix #11700: While doing recursive delete, check if a previous iteration already deleted the children (#14629) 2024-01-08 22:09:45 -08:00
Mohit Yadav
645195f99e
Fix Syntax for Activity Feed Alert (#14634) 2024-01-09 11:21:47 +05:30
Sriharsha Chintalapani
8f37d7da05
Fix #14610: includeEmptyTestSuite behavior causing not include newly created test suites (#14611)
* Fix #14610: includeEmptyTestSuite behavior causing not include newly created test suites

* Fix tests

* Fix tests

* Fix tests
2024-01-08 18:58:47 -08:00
07Himank
7b7c25529b
Minor Fix Knowledge (#14576)
* Minor Fix Knowledge

* checkstyle

* checkstyle
2024-01-08 10:47:05 -08:00
Mohit Yadav
dad886eaba
Remove LMAX Disruptor , use queue and Quartz (#14422)
* Remove LMAX Disruptor , use queue and Quartz

* Spotless Fix

* Spotless formatting

* Review Comments

* Improvements

* Improvements to add Retry and DLQ

* Spotless fix

* Update Stats

* Fix stats

* Fix delete Failures

* Fix Failing Tests

* Fix Failing Tests

* Fix Failing Tests

* Postgres Fix

* Fix Schema Change for Change Event Table

* Failing test

* Fix Error for non ChangeDescriptions

* Adds Observability On Top of Event Subscription

* Make List Separate

* Add more filters for Test Suite

* Populate Default Schema Updates to Look for

* typo

* Add matchFieldChange and other in paramAdditionalContext

* Review Comments

* Spotless fix

* Merge issue

* Update Filter as per new Syntax

* Fix Failing Test
2024-01-09 00:13:45 +05:30
Sriharsha Chintalapani
b9781746ce
Fix #8496: Segregate ES indexes for use in shared infrastructure (#14606)
* Fix #8496: Segregate ES indexes for use in shared infrastructure

* Fix tests

* use entityType aggregation key for counts

* localisation

* Revert openmetadata.yaml changes

* Update sample_data.yaml

---------

Co-authored-by: karanh37 <karanh37@gmail.com>
2024-01-08 08:29:11 -08:00
Sriharsha Chintalapani
dcff230bb6
Fix #12854: Executable TestSuite should inherit the ownership from its table (#14612) 2024-01-08 17:24:37 +01:00
Pere Miquel Brull
e8eb2bda3c
MINOR - Hide AutoTagger, add MetaPilot search, and fix apps status calls (#14201)
* MINOR - Hide AutoTagger & MetaPilot search & Fix apps status calls

* Fix method call

* Fix method call

* Fix method call

* "additionalProperties": true

* Use EntityRef

* Use ES sink

* Update UI schema type
2024-01-08 14:57:07 +01:00
Sriharsha Chintalapani
10e2f69add
MINOR - exclude logback (#14615)
* exclude logback

* exclude logback
2024-01-08 08:41:24 +01:00
Pere Miquel Brull
b92fd5cde4
MINOR - Move test case incident to the top of the data_quality_data_time_series (#14600)
* Add field and index

* MINOR - Move test case incident to the top of the data_quality_data_time_series table

* Fix test

* Fix compile

* Format

* Update incidentId

* Rename field

* Fix patch
2024-01-08 07:42:15 +01:00
Onkar Ravgan
ecdb7b9f41
Fixes 14109 and 14325: Optimised Tableau Connector (#14548)
* Optimised tableau conn

* Added comment
2024-01-08 06:33:05 +01:00
Sriharsha Chintalapani
a41a341aca
Minor: Revert JWT Filter changes to extract username (#14607) 2024-01-06 23:49:52 -08:00
Ayush Shah
d513dc4d4d
#11890: Add GCS Json schema changes (#14559)
* Issue-11890: Add GCS Json schema changes

* Modify Gcs Security config

* Add Test Def for gcs

* Add gcs for storage_metadata_config
2024-01-06 19:27:36 -08:00
Pere Miquel Brull
aa79bcb923
#14471 - Clean up ingestion status when deleting the ingestion pipeline (#14592) 2024-01-06 09:31:29 -08:00
Mayur Singal
a789fc86d6
Fix #13053: Remove Connection URI config MongoDB (#14584)
* Fix #13053: Remove Connection URI cofig MongoDB

* pyformat & test fixes
2024-01-05 10:51:12 -08:00
Suresh Srinivas
308b4c2096
Clean up code issues flagged by IDE (#14585) 2024-01-05 07:01:08 -08:00
Pere Miquel Brull
0255171218
MINOR - Create Test Case Resolution ts entry & delete resolution when… (#14541)
* MINOR - Create Test Case Resolution ts entry & delete resolution when Test Case is deleted
2024-01-05 09:15:49 +01:00
Aniket Katkar
5a0880ccaa
#11374: Removed the announcement knowledge panel customisability (#14196)
* Removed the announcement knowledge panel
Announcements widget will only show on landing page if  announcements are present

* renamed the MyDataPageV1 to  MyDataPage

* added unit tests for the MyDataPage component

* Added unit tests for customizablePage and MyDataPage

* removed the API call to fetch announcements in customizeMyData component

* added unit tests for CustomizeMyData component

* added unit tests for EmptyWidgetPlaceholder component

* Added unit tests for AddWidgetModal components

* updated the data test ids for widgets

* updated the data test id for KPI widget

* added data-testids related to customize page flow

* Added tests for persona CRUD operations

* localization change for other languages

* updated data test ids related to customize landing page

* updated the persona flow spec

* added cypress tests for customizable landing page flow

* fixed unit tests

* updated the my data page logic to add announcement widget

* fixed empty widget placeholder not showing after resetting the layout

* Minor: Fix the DocStoreResourceTest

* remove the border for announcement widget

---------

Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
2024-01-05 11:30:00 +05:30