1681 Commits

Author SHA1 Message Date
IceS2
b9e49fc35d
Make Fetching Data Async (#18822) 2024-11-28 10:53:57 +01:00
Karan Hotchandani
b614594252
Json logic query builder fixes (#18819)
* minor workflow changes

* fix json logic fixes for extension field

* fix tests

* query builder ui changes

* minor add entity type in global search

* fix tests

* update certification ui

* update default icons

* minor add test id
2024-11-28 08:42:46 +01:00
Akash Verma
609620e54f
fixes : #12891: "Added more test connection cases for Airflow ingestion" (#18769) 2024-11-28 13:02:04 +05:30
Amir Shakeri
860b420d3d
Remove ORDER BY from the postgres DELETE statement (#18757)
Co-authored-by: amir.shakeri <amir.shakeri@free-now.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2024-11-27 23:21:23 -08:00
Teddy
fb826b2c68
MINOR -- propagate result to suites (#18823)
* fix: update result summary for test suite

* fix: stream pattern

* fix: inverse null conditional logic
2024-11-28 08:09:56 +01:00
Imri Paran
e58efdde67
feat: added getLatestRecord for extension (#18797) 2024-11-27 10:08:53 +00:00
sonika-shah
e8031bcc0e
Improvement : Teams api to update and remove users (#18729) 2024-11-27 10:11:27 +01:00
Siddhant
15f56c124a
fix: Minus sign correction. (#18802) 2024-11-27 12:22:58 +05:30
IceS2
8cade39bad
MINOR: Increase visibility on flowable process (#18792)
* Add annotation to turn delete_recursive test into the last one to be executed

* Improve Fetching Entities by only fetching the FQN

* Cut back default batchsize to 500

* implement logging for flowable process

* Implement Error Handling Flow

* Remove testing code

* Checking if User is Reviewer when resolving glossary task
2024-11-26 17:04:59 +01:00
Teddy
68abc1a821
fix: minor observability bugs (#18795) 2024-11-26 16:34:46 +01:00
Aniket Katkar
998cbd1558
Improvements: Alerts bug fixes and improvements (#18753)
* Add and improve the permission logic for the notifications and observability alerts pages
Add logic to update the description from alert details page.
Add logic to set the logged in user as the owner while alert creation

* Remove the permission check for the `/{alertType}/resources` API since it's not necessary

* Update the playwright tests to cover the new alert features

* Add playwright to test the test destinations filter

* Fix the unit tests

* Add unit test for AlertRecentEventsTab component

* update the variable.less import to reference

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2024-11-26 18:00:58 +05:30
Keshav Mohta
10a7f4ea6c
Fixes #15543: Implemented ElasticSearch Index Template Ingestion (#18686) 2024-11-26 14:42:43 +05:30
Kenil Shah
09db201a57
UI: Add option to stop the running application (#18759)
* Add Stop functionality for Applications

* show kill button by default

* Add option to stop the running application

* fix: show stop button for ruuning & activeerror status

* add localisation files

* added unit tests

* update localisation files

---------

Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
2024-11-26 11:55:47 +05:30
Mayur Singal
40a70357e8
MINOR: Add UDF support for SP - backend (#18767) 2024-11-25 15:27:53 +05:30
sonika-shah
76bd8d8886
fix java checkstyle (#18768) 2024-11-25 13:58:18 +05:30
IceS2
b3d765dce1
MINOR: Governance Workflows fixes (#18744)
* Add annotation to turn delete_recursive test into the last one to be executed

* Improve Fetching Entities by only fetching the FQN

* Cut back default batchsize to 500
2024-11-24 11:30:56 -08:00
sonika-shah
0e4160949c
Add async apis for csv import (#18647)
* Add async apis for import csv

* checkstyle fix

* fix checkstyle after merge from main

* fix auts

* fix backend tests

* ui: add async import support for glossary

* ui: improve the import page layout

* ui: add async import support for teams and users

* show banner at the top

* fix unit test

* update importteams page test

* minor change

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2024-11-24 13:30:31 +05:30
Sriharsha Chintalapani
04659132b7
Minor: skip domain check for bots and admin (#18734) 2024-11-22 10:41:42 -08:00
Sriharsha Chintalapani
532efbe5ab
Minor: Search RBAC, handle tier tags (#18733) 2024-11-22 10:40:48 -08:00
Sriharsha Chintalapani
9484d838a4
Minor: fix Lineage export when there is no column / pipeline edge (#18737)
* Minor: fix Lineage export when there is no column / pipeline edge

* add test for lineage export (#18709)

Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>

* add lineage export tests

---------

Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: Sweta Agarwalla <105535990+sweta1308@users.noreply.github.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
2024-11-22 08:21:19 -08:00
Mohit Yadav
51f3591714
Add Null check for source config (#18746) 2024-11-22 17:34:12 +05:30
Siddhant
702c34c0af
NoSchedule as ScheduleType for Slack App (#18715)
* fix: NoSchedule as scheduleType for Slack App

* fix: remove callback url from the config.

* no render of schedule for noSchedule type

* fix: Migrations and add ScheduleType.NoSchedule

* fix: Migrations

---------

Co-authored-by: karanh37 <karanh37@gmail.com>
2024-11-21 22:29:09 -08:00
Teddy
dbd03c64c2
fix: test case reindex performance (#18723) 2024-11-21 16:28:26 +01:00
IceS2
890a4f8755
Fix missing check on set entity certification (#18713) 2024-11-20 19:04:03 +01:00
IceS2
dc101044d9
MINOR: Add the possibility to have no Schedule and trigger the workflow manually (#18640)
* Add the possibility to have no Schedule and trigger the workflow manually

* add locales

* add locales to other langs

* Fix Flaky GlossaryTerm test

* fix locales

* change certificate aggregation name

* Fix Checkstyle and expand timeout for waitForTaskToBeCreated

* Fix flaky glossary term test

* Fix timeout

* fix timeout

---------

Co-authored-by: karanh37 <karanh37@gmail.com>
2024-11-20 15:35:34 +01:00
Teddy
0dca5362b9
fix: handle potential null node in DQ failure lineage (#18707) 2024-11-20 14:12:08 +01:00
Teddy
429e48aa3a
#18677 - Added Lineage Field back to SearchLineage (#18687)
* fix: add lineage field back to searchLineage

* add lineage tests

---------

Co-authored-by: karanh37 <karanh37@gmail.com>
2024-11-20 11:13:09 +01:00
Teddy
91de99ad17
MINOR: Move from Date to LocalDate for thread safe operations (#18679)
* fix: move from Date to LocalDate for thread safe operations

* style: ran java linting

* fix: invalid range in test case
2024-11-20 08:20:13 +01:00
Siddhant
dad3c9d7f2
refactor: Slack app improvements (#18684) 2024-11-19 19:08:47 +05:30
Mohit Yadav
0bf5a98501
Add Checksum package to pom (#18696) 2024-11-19 18:49:07 +05:30
Imri Paran
12945c62c0
revert aws sdk version from f0b76c45d081fe66bded44c60fa4560a879cb346 (#18695)
Due to failures in migration:

```
2024-11-19 17:16:15.916	picocli.CommandLine$ExecutionException: Error while calling command (public java.lang.Integer org.openmetadata.service.util.OpenMetadataOperations.migrate(boolean)): java.lang.NoClassDefFoundError: software/amazon/awssdk/checksums/SdkChecksum
2024-11-19 17:16:15.641	Updating bot users in case of an update on the JSON schema: [managed-aws]
2024-11-19 17:16:14.903	Updating services in case of an update on the JSON schema: [managed-aws]
```
2024-11-19 18:42:05 +05:30
Mohit Yadav
b45eb5a416
Removed Consumer (#18685) 2024-11-19 17:16:43 +05:30
Antoine Balliet
b63ad63898
fix: update dashboard data model when sql changes (#18657)
Co-authored-by: Teddy <teddy.crepineau@gmail.com>
2024-11-19 12:40:42 +01:00
Mohit Yadav
ae1e7e6d22
run es bulk in async (#18649) 2024-11-18 09:07:07 -08:00
Sriharsha Chintalapani
f0b76c45d0
fix: openmetadata-service/pom.xml to reduce vulnerabilities (#18651)
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-IONETTY-8367012

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
2024-11-18 09:04:18 -08:00
Sriharsha Chintalapani
19497db455
Minor: Fix Column Level Lineage export (#18670) 2024-11-18 07:29:04 -08:00
Teddy
83911501dc
FIX: test summary reindexing (#18667)
* fix: test summary reindexing

* fix: clean up test case result from index on test case deletion
2024-11-18 15:16:57 +01:00
Mohit Yadav
f0b0a47625
Change Defaults (#18675) 2024-11-18 19:45:36 +05:30
sonika-shah
853bbc205b
GEN-1983 : Feat - Support Tag Asset Page (#18505)
* Feat :  Support bulk adding tag to Assets

* remove warnings

* add apis for assets remove

* Fix: Add tag page (#18461)

* add tag page which all Assets

* update as per feedbacks

* update as per feedbacks

* add divider in header badge

* remove styling

* update permission and refactoring code

* updated as per comments

* fix sonar cloud issues

* add delete asset functionality

* refactor entityTypeString

* made the top bar fixed to top

* add tests for tag page

* fix check failures issue

* fix tag page check failure

* fix flaky test issue

* add tag page tests

* update the add asset test

* update playwright tests

* add right panel in tag page

* updated as per feedbacks

* remove usage test

* updated as per feedbacks

---------

* Backend: make bulkAssets api async

* Backend: limit bulkAssets api async to Tag Assets page

* Update Tag page Assets API (#18622)

* create branch

* update add asset API

* add websocket on tags page

---------

Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: karanh37 <karanh37@gmail.com>

* add failed case for socket operation

---------

Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: Sweta Agarwalla <105535990+sweta1308@users.noreply.github.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
2024-11-18 17:57:07 +05:30
Mohit Yadav
66c253ef10
Add Queue Size in Configuration (#18672) 2024-11-18 12:45:08 +01:00
Ayush Shah
6f1df37ba1
Fixes GEN-1260: Add Validators while creating table to escape special characters (#18456) 2024-11-18 15:02:57 +05:30
IceS2
231025df67
MINOR: Improve PeriodicBatchEntityTrigger Workflows performance (#18664)
* Update default configurations

* Refactor how we call the main Workflow in order to increase performance
2024-11-18 08:17:22 +01:00
Sriharsha Chintalapani
88c8fb48f3
Add Edit glossary terms, Edit Tier , Edit Tags as separate permissions (#18331)
* Add EditGlossaryTerms Permission

* Fix #18330: Add EDIT_GLOSSARY_TERM permission and enforce EDIT_TIER permisson

* add edit glossary term permission check in UI

* revert EDIT_GLOSSARY_TERMS operation

* Add EDIT_GLOSSARY_TERMS to common operations

* Add EDIT_TIER to common operations

* add default empty array for tags field, as patch calls can run into issues

* Fix tests

* Fix tests

* added glossary terms

* fix conflicts

* fix permission check for data model

* Add EditGlossaryTerms to DataConsumerPolicy

* Add EditGlossaryTerms,EditTier to DataConsumerPolicy

* fix tests

* Fix migrations for EditTier,EditGlossaryTerms

* add edit tier permission to data consumer

* Fix tests

* fix pytests

* missing test_dbt.py

---------

Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
2024-11-15 10:50:15 -08:00
Sriharsha Chintalapani
783ec62e4c
Add Lineage Export Async endpoint using Search (#18553)
* Add Lineage Export Async endpoint using Search

* Lineage api (#18593)

* add api for lineage export

* update API call for lineage async

* use JsonUtils instead of objectMapper to read lineage search response

---------

Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: Sweta Agarwalla <105535990+sweta1308@users.noreply.github.com>
Co-authored-by: sonikashah <sonikashah94@gmail.com>
2024-11-15 09:11:23 -08:00
IceS2
71f93633ac
Update Glossary Approval Workflow name (#18658) 2024-11-15 16:15:01 +01:00
Mohit Yadav
8c6de372f1
Add Latch for consumers (#18655) 2024-11-15 14:15:35 +05:30
Mohit Yadav
560e28df76
Search Index Issues (#18648)
* Search Index Issues

* Log Thread

* Make logs debug

* Remove Current Therad Name
2024-11-14 22:19:35 +05:30
Aniket Katkar
bfc12feafc
GEN-1976: Alert improvements (#18448)
* Move the alert components to the components folder from pages folder

* auto generated localization changes and linting changes

* Fix the imports

* Add AlertConfigDetails component

* Add tabs in the alert details page

* auto generated localization changes

* Apply permissions for alert and add owner update functionality

* Change the alert update method from PUT to PATCH

* Add the recent events tab

* auto generated localization changes

* Improve the recent events tab for alert details

* Implement the logic to show alert events count on the alert details page

* auto generated localization and linting changes

* Add the pagination logic for the recent events list on the alert details page

* Fix the logic for previous click in NextPreviousWithOffset

* Localization change for other languages

* Hide pagination when not required

* Add pagination and permissions to API; create eventsRecord API; fix timestamp issue

* fix: remove publisherName from test destination message.

* Fix the recent events tab error

* fix: Resolve PATCH API issue with destination ID creation.

* fix: Delete associated alert metrics upon alert deletion

* feat: Detailed HTTP Response for Destination Test

* Add the test external destination functionality

* localization changes for other languages

* fix: Set status for testing destination in EmailPublisher

* Add advanced configurations for webhook destinations

* Localization changes for other languages

* Fix the destination status not showing
Add the POST and PUT radio button in advanced configs

* Localization changes for other languages

* Update the API to fetch the alert event diagnostic counts

* Improve the AlertConfigDetails component to show the alert configs properly

* fix: Display displayName instead of fullyQualifiedName in templates

* Fix the test destination result not showing the first time

* Fix the test destination status not showing for already existing destinations

* Fix the unit tests

* Fix playwright tests

* refactor: Separate sendMessage and sendTestMessage methods; add statusContext

* fix: Use name or fqn as fallback if displayName is null or empty

* fix: upsert successfulChangeEvent

* eliminate the GovernanceWorkflowChangeEvent option from external destination

* Add code comments

* Fix the unit test

---------

Co-authored-by: Siddhant <86899184+Siddhanttimeline@users.noreply.github.com>
Co-authored-by: Siddhanttimeline <siddhanttimeline9@gmail.com>
2024-11-14 17:39:45 +05:30
Mayur Singal
14643f2b50
DI - Add metric name in group name (#18634) 2024-11-14 10:50:19 +05:30
Mayur Singal
f345c4914f
GEN-1933: Separate Description Status for table and column (#18614) 2024-11-14 10:31:44 +05:30