1565 Commits

Author SHA1 Message Date
Mohit Yadav
6d015980b7
[Fixes] Patch Minor Fixes (#14919)
* Patch Minor Fixes

* Patch Minor Fixes

* java checkstyke

* Fix Failing Test

* fix filtering
2024-01-30 00:41:45 +05:30
07Himank
38726971cf
Knowledge Center SearchFIx (#14935) 2024-01-29 09:01:19 -08:00
Pere Miquel Brull
1492f79da1
MINOR - Revert #14468 - DuckDB Connector (#14934) 2024-01-29 16:10:53 +01:00
07Himank
b90d0e6365
Sort by popularity (#14873)
* sort by popularity

* sort by popularity

* checkstyle

* Fix totalVotes & indexing

* rebase with main

* add popularity and name sort field

* update unit tests

* Fix feedResourceTest

* Remove Ngram from team search indexing

* Change boost for ngram to 1.0

* py test

* 0 totalvotes if votes is null

---------

Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
2024-01-29 20:40:18 +05:30
07Himank
db7db07812
make isBot (#14914) 2024-01-29 16:08:03 +05:30
Aniket Katkar
8afde3ee82
Minor[WIP]: Fix observability cypress tests (#14907)
* modify error alert to get more details on API failure in cypress

* Fix Alert Type for postgres

* revert changes to show API errors in error toast

---------

Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
2024-01-29 12:31:52 +05:30
Mohit Yadav
c9fab1e4e6
Sort Tier Data (#14916) 2024-01-29 12:23:22 +05:30
Sachin Chaurasiya
8d1780c5b4
Fix(#14262): Format the ES reindexing logs for better readability (#14849)
* Fix(#14262): Format the ES reindexing logs for better readability

* Refactor formatJsonString function in StringsUtils.ts

* Fix Error Schema for Search Indexing Application

* Refactor AppLogsViewer.component.tsx

* Fix import order and add default value for formatJsonString

* Refactor formatJsonString function in StringsUtils.ts

* Fix Schema

---------

Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
2024-01-29 12:16:20 +05:30
IceS2
373cafcda2
Fixes #5448: Implement initial Iceberg Connector using PyIceberg (#14825)
* Create the iceberg connection schema

* Link the IcebergConnection configuration with the forms on the UI

* Add the pyiceberg dependency on the ingestion package

* Create the get_connection and test_connection functions

* First iteration on the iceberg ingestion logic

* Add A more comprehensive implementation of the Iceberg Source

* Add UnitTests

* Update icebergConnection definition

* Update the iceberg souce code based on new schema

* Updated icebergConnecgtion schema for simplicity and to be able to configure Converters

* Updated setup dependencies to be more flexible

* Updated get_owner_ref logic

* Fix formatting

* Changed the icebergConnection json schema structure to enable the ClassConverters

* Add the IcebergCatalog and IcebergFileSystem ClassConverters

* Refactor the code to take into account the new jsonSchema structure

* Fix formatting

* Add Documentation for the Iceberg Connector

* Fix Menu order for Iceberg

* ui: add Iceberg service icon and constant

* Fix DynamoDb Catalog issue due to how PyIceberg instantes it

* Changed uri title to URI

* Fix ClassConverter for Iceberg

* Fix GetSecretValue for password types

* Fix formatting

* Fix formatting

* Add Iceberg Connector Images for the docs

* Add pylint disable for Hacky super() call

* Add Iceberg.md for the UI docs

* Fix pylint complaint

* Fix pylint complaint

* Fix UnitTests

* fix type error and unit tests

* update pipeline type checks

* Fix Sonar Cloud complaints

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2024-01-29 06:32:58 +01:00
Pere Miquel Brull
90dc3e830c
MINOR - Bump testcontainers & mysql test version (#14906)
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2024-01-28 16:45:34 -08:00
Sriharsha Chintalapani
5bdd057440
Fix feedResourceTest (#14904) 2024-01-28 15:45:57 -08:00
Teddy
bd09755fc0
ISSUE #14851: Error when deleting last test case result (#14868)
* fix: error if no testCaseResult exists when updating testSuite summary state

* fix: add return statement on resultsummaries update
2024-01-28 10:27:05 -08:00
Pere Miquel Brull
0332fb9fe5
#13934 - Update test connection no response error msg (#14897)
* #13934 - Update test connection no response error msg

* #13934 - Update test connection no response error msg
2024-01-28 10:25:15 -08:00
Sriharsha Chintalapani
f6ecc41d7c
Fix #11944: API support to fetch count for mentions (#14858)
* Fix #11944: API support to fetch count for mentions

* Add closedTask/totalTask

* fetch count as per new count api for entity and user page and remove mentions tab from entity

---------

Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2024-01-28 16:19:29 +05:30
Mohit Yadav
3f234df7cc
Fix Display Name for Alerts (#14889)
* Fix Display Names

* FIx Names and condition
2024-01-26 14:50:18 +05:30
Chirag Madlani
c936ac3a41
feat(ui): Data observability and notifications (#14806)
* Centralize EventType

* Format better for readability

* Add Handling for Thread as Change Event

* Centralize logic for Entity Message Creation

* Add Thread Parent Message in Conversation

* Add Task and Announcement

* Support for multiple destinations

* Delete existing alerts for schema changes

* Delete all tables data for event subscription

* Centralize logic for Notifications and Observability

* Change Field Name and Remove redundant code

* Test Fixes

* Add more fields

* Add Optional

* Logical Test Case Addition Chnage Event

* Add Filter By Owner

* Fix Email Entity Url

* added data observability settings page

* localization changes for other languages

* Handler closure and cleanup

* complete create observibility flow

* fix searchIndex method error

* Update Entity Observability Filter

* working observability creation

* complete creation flow

* fix action with arguments

* fix form validations and form data formulation for 'input.actions' field

* localization changes for other languages

* Fixes for Data Observability

* Add mention notification

* Only apply mention to conversation

* fIx test case

* bug fixes for add and edit observability alert form functionality

* fIx test case

* add feature to config internal along with external destinations in alert form

* Fix Formatting

* Fix Url Redirection

* add observability alert details page

* localization changes for other languages

* remove filter and action required rules

* fix styling for observability form and details page

* add delete functionality on observability alert details page

* update view page layout and add a warning in configure destination step

* localization changes for other languages

* feat(ui): support notification with new flow (#14848)

* feat(ui): support notification with new flow

* fix notifications

* add missing filters for notification alert creation flow

* update the filter hiding logic to show at the start always

* add check to show Actions section in observability alert creation form

* code cleanup and improvements

* add breadcrumb to add notification alert page

* Add General Metadata Filters

* remove code smells and code cleanup for add notification page

* add new filter

* show activity feed alert on notifications list page

* add notification alert details page changes

* localization changes for other languages

* show icons for all the entities in the alert trigger dropdown

* redirect to notification alert listing page after deleting the notification alert

* change add alert page title

* add logic to disable all destinations except email for users

* fixed unit tests

* code improvements and cleanups

---------

Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
2024-01-26 13:56:18 +05:30
07Himank
5e653d25ff
fix a part of es exception while migrate (#14876) 2024-01-25 20:03:15 +05:30
Mayur Singal
dcd3d47c2b
Fix #14590: Improve airflow plugin error message (#14839)
* Fix #14590: Improve airflow plugin error message

* Update openmetadata-service/src/main/java/org/openmetadata/service/clients/pipeline/airflow/AirflowRESTClient.java

Co-authored-by: Ayush Shah <ayush@getcollate.io>

* Update msg

* Update RichTextEditorPreviewer in AirflowMessageBanner component

---------

Co-authored-by: Ayush Shah <ayush@getcollate.io>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2024-01-25 15:26:49 +01:00
07Himank
cb7db8ce8f
Minor fix Search service (#14837)
* Minor fix

* fix minor search fixes
2024-01-25 18:17:48 +05:30
Onkar Ravgan
70316b9680
MINOR: Fixed life cycle index mapping for raw_cost_analysis_report_index (#14832)
* fix life cycle index mapping

* fixes

* removed epoch
2024-01-24 09:23:09 -08:00
07Himank
115870b2af
Pipeline and stored procedure lineage fix (#14681)
* pipeline and stored procedure lineage

* pipeline and stored procedure lineage

* fix: pass entity type in url

* fix unit tests

* pipeline and stored procedure lineage

* pipeline lineage

* pipeline and stored procedure lineage

* fix performance issues

* pipeline and stored procedure lineage done

* optimisation

* fix fullscreen mode

* add pipeline animation

* update loading state

* fix styling

* update pipeline status

* fixes

* fix cypress

* fix cypress

* fix cypress

---------

Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2024-01-24 11:04:31 +05:30
Chirag Madlani
45efaefc46
fix(ui): password error message for char limits (#14808)
* fix(ui): password error message for char limits

* fix java side code
2024-01-23 12:38:35 +05:30
Sriharsha Chintalapani
a9e193608c
Fix #14318: Add support of JSON logs (#14783) 2024-01-21 22:59:28 -08:00
Sriharsha Chintalapani
15eb094cff
Improve error response to the client. Added errorType so that client can handle better than depending on the http status codes (#14784) 2024-01-21 08:07:07 -08:00
Mohit Yadav
0851b87442
Use 8.2.0 version of mysql (#14801) 2024-01-19 23:41:46 +05:30
Teddy
71592df3e7
fix: filtering logic when getting latest incidents (#14760) 2024-01-18 08:12:25 +00:00
Mohit Yadav
1e6c1a616b
Add Notification [WIP] (#14674)
* Centralize EventType

* Format better for readability

* Add Handling for Thread as Change Event

* Centralize logic for Entity Message Creation

* Add Thread Parent Message in Conversation

* Add Task and Announcement

* Support for multiple destinations

* Delete existing alerts for schema changes

* Delete all tables data for event subscription

* Centralize logic for Notifications and Observability

* Change Field Name and Remove redundant code

* Test Fixes

* Add more fields

* Add Optional

* Logical Test Case Addition Chnage Event

* Add Filter By Owner

* Fix Email Entity Url

* Handler closure and cleanup
2024-01-18 12:46:01 +05:30
Sriharsha Chintalapani
bfa8827d38
Fix #14038: Inconsistent search results between auto-suggest box and … (#14747)
* Fix #14038: Inconsistent search results between auto-suggest box and actual search results

* use dataAsset instead of all alias

---------

Co-authored-by: karanh37 <karanh37@gmail.com>
2024-01-17 21:37:36 -08:00
Suresh Srinivas
c4b9d1bd21
Dependency updates (#14767) 2024-01-17 19:49:39 -08:00
Mohit Yadav
70b74d7d4f
Remove info log and using JsonUtils to convert the Ingestion Pipeline (#14759) 2024-01-17 17:25:33 +05:30
Mohit Yadav
bfbd953b53
Fix messages and percentages in Data Insight reports (#14731) 2024-01-17 16:11:43 +05:30
Teddy
aa92db3176
fix: clear incident ID when testCase result is success (#14755) 2024-01-17 10:23:36 +00:00
Mohit Yadav
7dcdc1a37d
Fix Expression Parsing (#14753) 2024-01-17 13:22:49 +05:30
Teddy
085dfc0012
MINOR: Update Incident Manager Flow 2024-01-17 07:23:03 +01:00
mohitdeuex
cfbb94aa32 Call Stop at the end 2024-01-17 10:51:29 +05:30
Teddy
1ace95c9c5
MINOR: add recordChange call for computePassedFailedRowCount (#14716)
* MINOR: add recordChange call for `computePassedFailedRowCount`

* style: ran java linting
2024-01-16 07:55:34 -08:00
Sriharsha Chintalapani
b4b1b2e224
Fix #14694: Search - Change default operator to OR instead of AND (#14695)
* Fix #14694: Search - Change default operator to OR instead of AND

* Minor: Remove ngram from the indexes

* Tune weights on the search fields
2024-01-15 22:20:20 -08:00
Onkar Ravgan
f1049d55c4
Fixed mode test connection (#14693) 2024-01-12 18:29:12 +05:30
Sriharsha Chintalapani
49c1756583
MINOR - Test Case Ownership, keep severity, add test case result incidentId (#14691)
* MINOR - Test Case Ownership, keep severity, add test case result incidentId

* fix immutability

* Fix tests

* MINOR - Test Case Ownership, keep severity, add test case result incidentId

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2024-01-11 23:36:29 -08:00
mohitdeuex
e418f4da2f Collate Knowledge Center Indexes needs entity 2024-01-12 11:54:47 +05:30
Sriharsha Chintalapani
e786380915
Minor: Add glossary index to SearchIndexFactory (#14690)
* Minor: Add glossary index to SearchIndexFactory

* Minor: Add glossary index to SearchIndexFactory
2024-01-11 16:54:40 -08:00
Shiyang Xiao
241f3c68d7
Fixes #14413: Add SAS connector (#14415)
* feat: SAS Viya connector

* refactor SASCatalog to SAS

* add SAS logo to UI and connection documentation

* doc changes

* modify ingestion logic

* revert original changes

* added support for dataflow & perfect logic for reports/datatables

* add filter doc

* more updates to perfect ingestion for each asset type

* fix a bug with table lineage not created properly

* Delete ingestion/pipelines/sasCatalog.yaml

* precomit fix

* Conversion to database connector

* minor fixes

* make custom properties type generic

* Add SAS javaEnum

* add dummy variable for sas.yaml

---------

Co-authored-by: lizmc <liz.mcintosh@sas.com>
Co-authored-by: Shiyang Xiao <Shiyang.Xiao@sas.com>
2024-01-11 06:46:57 -08:00
Ayush Shah
9c6d202555
Add Sample data, modify regex pattern (#14467) 2024-01-11 14:23:33 +05:30
Mohit Yadav
ff690d8dd4
Format better for readability (#14682) 2024-01-11 12:46:30 +05:30
Mohit Yadav
501c22f6c1
Change for Building Collate List Filter (#14665) 2024-01-10 14:34:14 +05:30
Sriharsha Chintalapani
8d8d71e4f9
Fix #14442: Glossary index is not updated on Glossary deletion (#14638)
* Fix #14442: Glossary index is not updated on Glossary deletion

* Fix #14442: update SearchIndexApp to add Glossary

* Add Glossary to other config schema

---------

Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
2024-01-09 08:34:45 -08:00
07Himank
44af8b3a47
working on lineage es integration (#14181)
* working on lineage es integration

* os change

* working

* working on lineage es integration

* add curremt lineage, special character handling, delete lineage

* remove test code

* update lineage index work done

* fix: add lineage ui changes

* fix: lineage add edit

* fix: center on load

* fix: add remove edges

* fix: column lineage issues

* use reactflow controls

* add collapse

* added upstream and downstream depth diffrently

* depth and collapse

* fix loading of dialog

* add includeDeleted in API

* cleanup

* cleanup

* cleanup

* initial unit tests

* fix tests

* cleanup

* update filter query

* fix: allow sql query to update

* use input instead of select

* unit tests

* unit tests

* fix edge removal

* cleanup

* description and deleted

* fix: initial lineage tests

* fix unit tests

* fix: review comments

* added edgedescription

* refactor custom nodes

* refactor condition

* add pipeline status color

* fix unit tests

* cleanup

* cleanup

* fix: lineage url

* depth issue resolved

---------

Co-authored-by: karanh37 <33024356+karanh37@users.noreply.github.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
2024-01-09 08:34:17 -08:00
Sriharsha Chintalapani
9cafde3847
Fix #11700: While doing recursive delete, check if a previous iteration already deleted the children (#14629) 2024-01-08 22:09:45 -08:00
Mohit Yadav
645195f99e
Fix Syntax for Activity Feed Alert (#14634) 2024-01-09 11:21:47 +05:30
Sriharsha Chintalapani
8f37d7da05
Fix #14610: includeEmptyTestSuite behavior causing not include newly created test suites (#14611)
* Fix #14610: includeEmptyTestSuite behavior causing not include newly created test suites

* Fix tests

* Fix tests

* Fix tests
2024-01-08 18:58:47 -08:00