2141 Commits

Author SHA1 Message Date
sonika-shah
773982210d
fix : aggregation issue in opensearch while fetching domain hierarchy (#19594) 2025-01-29 19:14:41 +05:30
Mohit Yadav
8c5eee8f07
Add prometheus counter for search and database (#19561)
* Add prometheus counter for search and dartabase

* chenge env

* typo - review comments
2025-01-29 00:08:45 +05:30
Mohit Yadav
58d5988a16
Add Onboarding SQL (#19525)
* Add Primary Key Migration

* Update queries and conflict on apps data store

* Update queries and conflict on apps data store

* add index on isBot
2025-01-28 11:45:58 +05:30
Teddy
36d8519b09
feat: add entityFQN query param for test case (#19541) 2025-01-27 17:51:06 +01:00
Mayur Singal
eea4b65b80
Fix #19198: di fix custom property filter (#19531) 2025-01-27 15:54:41 +05:30
sonika-shah
5b63c36ef1
Fix #19116 : Support for domain hierarchy listing (#19191)
* Backend support for domain hierarchy listing

* use linkedHashmap to maintain order of results in hierarchy

* Revert changes to generated files to match main

* show all domains for non admin user

* change select domain layout

* fix multiple save

* fix playwright

* cleanup

* fix domain tests

* fix domain tests

* fix icon styling

* show icons on navbar domain list

* update tests

---------

Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
2025-01-27 15:43:42 +05:30
Imri Paran
5482b94a57
feat(schedule-application): enable scheduling application using config file (#19470)
- added schedule to app private config
- reschedule a schedule application job in quartz if it exists.
2025-01-27 13:39:46 +05:30
sonika-shah
82198f8126
GEN -19341 : Improvement - Avoid usage of CONCAT in WHERE clause (#19510)
* Improvement : Avoid usage of CONCAT in WHERE clause

* fix tests

* remove usage of @BindFqnConcat

* remove usage of @BindFqnConcat

* fix test

* fix test
2025-01-27 11:20:25 +05:30
Siddhant
473688648b
Fix #18834: Introduce new setting OpenMetadataBaseUrlConfiguration to set the server endpoint (#19366)
* Refactor: Introduce openMetadataBaseUrlConfiguration to set up the server endpoint and remove OpenMetadataUrl from smtpSettings.json

* migrations.

* refactor(cli): add setOpenMetadataUrl command to store OpenMetadata URL

* refactor(cli): add configureEmailSettings command to manage SMTP/Email configuration

* load initialData when config is not present in the db

* add om url settings page

* update locales

* add e2e

* load omBaseUrl with default host and port: localhost:8585 when not present

---------

Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
2025-01-27 10:20:04 +05:30
Imri Paran
a6670af500
MINOR: Use interface schemas for governance workflows (#19411)
* feat(apps): support event subscriptions

- added support for apps with event subscriptions.
- added support for custom consumers on event subscriptions.
- use native application methods instead of reflection in ApplicationHandler

* removed runMethodFromApplication reflection and use concrete methods from AbstractNativeApplication

* format

* fix(governance-workflows): defined interface in workflow schema

- defined types for workflow nodes
- fixed updateEdge method in WorkflowDefinitionRepository

* ref(governance-workflows): use explicit types in schema

use explicit interface type in json schemas and use annotations to infer the concrete classes when deserializing

* - implemented CustomSignal trigger
- use JsonTypeInfo and JsonSubTypes to infer types in jsonschema for nodes and triggers
- Implemented JsonLogicFilter task
- implemented placeholder noop task

* - simplified trigger type names
- removed governance workflow root "type"
- added "deployed" field to governance workflow
- applied changes to existing gov-workflows
- migrations

* fixed migrations
2025-01-24 09:08:06 +01:00
Mohit Yadav
907eb7cb07
Move Recreate Out of executors (#19501)
* Move Recreate Out of executors

* Add Entities option in Operations

* Fix Reindexing for null list for referred columns
2025-01-24 10:38:45 +05:30
IceS2
901063b802
FIX #19386 & #19388: Fixing Data Insights index mapping (#19423)
* Fixing Data Insights index mapping

* Add OpenMetadataOperations cli endpoint to reindex data insights

* Improve IndexMapTemplate building

* Improve the code a bit

* Fix test
2025-01-23 10:02:52 +01:00
Teddy
cacfabd9ce
ISSUE #1052 - Implement List entities with test suites repo logic (#19461)
* fix: centralized listWithOffset logic

* feat: dq app config + list entities with tests logic

* fix: test case
2025-01-22 08:08:07 +01:00
Mohit Yadav
5064602dc8
[Fix-19437] Redirection issue on IDP initiated calls (#19443)
Co-authored-by: Siddhant <86899184+Siddhanttimeline@users.noreply.github.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2025-01-22 11:46:32 +05:30
Siddhant
486230827d
#15600: Retention Application : Delete change_events, activity threads, versions based on admin retention policies (#18913)
* feat(retention-policy): initial setup of the Retention Policy app

* refactor: Update logic to make RetentionPolicyApp a ScheduledOrManual app

* refactor: Update retention policy JSON schema and logic to support event subscription, versions, and activity thread with individual retention periods

* refactor: Rename eventSubscriptionRetentionPeriod to changeEventRetentionPeriod

* fix: Implement activity thread retention policy cleanup

* chore: Remove activity thread and versions retention code; add banner and icon
2025-01-21 18:12:35 +05:30
sonika-shah
9a69c18b59
Minor : Get missing dataProducts and pipeline properties in /customProperties api (#19445) 2025-01-21 14:58:04 +05:30
Imri Paran
3abae45403
MINOR: feat(apps): support event subscriptions (#19338)
* feat(apps): support event subscriptions

- added support for apps with event subscriptions.
- added support for custom consumers on event subscriptions.
- use native application methods instead of reflection in ApplicationHandler

* removed runMethodFromApplication reflection and use concrete methods from AbstractNativeApplication

* format
2025-01-21 07:10:26 +01:00
Chirag Madlani
00a37c6180
Fix(ui): refresh call concurrency for multiple browser tabs (#19303)
* fix(ui): refresh auth token for multi browser tabs

* update refresh logic

* fix multiple tab issue

* fix tests

* added tests

* fix ingestion bot failure

* fix sonar cloud

* update test description

* remove unused code and reset test on after all

* bump playwright

* avoid running refresh tests as it's been flaky for postgres

* revert playwright version bump changes

* Put 500 status

---------

Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
2025-01-20 23:31:56 +05:30
Mayur Singal
e5acdab3b8
MINOR: Fix DI Filter not getting applied (#19400) 2025-01-20 10:37:07 +05:30
sonika-shah
b8ea105395
Fix - 19359 : Get only non-deleted entities in export (#19396) 2025-01-17 14:44:14 +05:30
Teddy
d8e6219200
MINOR - Async test case result deletion (#19390)
* fix: async test case result deletion

* move async call to calling method
2025-01-16 16:24:20 +01:00
Gyowanny P. Queiroz
cbbef9e3b9
Move PipelineServiceClient to openmetadata-spec (#19381) 2025-01-15 14:41:47 -03:00
Teddy
084d2efa6c
MINOR - createMany endpoint for test case resource (#19340)
* feat: createMany endpoint for test case resource

* test: createMany tests for test cases

* fix: change ops context to test case + copy nullified object
2025-01-15 17:28:23 +01:00
sonika-shah
788dfc331f
dataProduct : get inherited fields from corresponding Domain (#19343)
* dataProduct : get inherited fields from corresponding Domain

* add tests

---------

Co-authored-by: karanh37 <karanh37@gmail.com>
2025-01-14 22:16:23 +05:30
Mohit Yadav
3c2f037534
Fix Search Index for ER Model (#19349) 2025-01-14 19:47:48 +05:30
Mohit Yadav
d66c689f6d
Add Indexing Stack (#19305) 2025-01-09 22:51:49 +05:30
Mohit Yadav
4c15cc0d91
Add Operations to install Onboarding app (#19298)
* Add Operations to install app

* Initiate Jwt
2025-01-09 16:10:35 +05:30
Mohit Yadav
adfbc21a00
revert: Circular Rendering issue for lineage (#19270) (#19299) 2025-01-09 16:07:21 +05:30
Mayur Singal
8f27ed0455
MINOR: Implement pagination in pipeline lineage render (#19295) 2025-01-09 15:21:04 +05:30
Imri Paran
7d05902945
fix: reverted deprecated fields on testSuite (#19284)
Added deprecated fields with a notice. This is to ensure migrations that use them do not break.
2025-01-08 18:34:17 -08:00
Mohit Yadav
78e8d360a5
Default App Config to all (#19291) 2025-01-09 00:55:13 +05:30
IceS2
9697ee6271
Add Match Any Certification to Policies (#19271) 2025-01-08 11:16:56 +01:00
Mohit Yadav
1f766791fd
[Fix-19094] Circular Rendering issue for lineage (#19270)
* Fix Circulare Rendering issue for lineage

* Review
2025-01-08 15:30:54 +05:30
Sriharsha Chintalapani
490ebdebc3
Issue-19197: Deleting Data Product should delete the data asset relationships (#19208)
* Issue-19197: Deleting Data Product should delete the data asset relationships

* Issue-19197: Deleting Data Product should delete the data asset relationships

* Minor: Fix the deleteByName

* add tests for data product delete case

* fix flaky tests

* update data products fqn keyword mapping

* Update table_index_mapping.json

* fix flaky test

* fix tests

* fix flaky tests

* fix flakiness

---------

Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
2025-01-08 15:08:08 +05:30
Teddy
e432af9fb5
ISSUE-19131: Fix patch removing testSuites field (#19260)
* fix: patch removing testSuites field

* fix: revert comment update
2025-01-08 08:20:11 +01:00
Mohit Yadav
dba3e58e4c
[OMOperations] Add Reset Password option (#19253)
* Add Reset Password option

* Add Email option

* Add option to set initial password in yaml
2025-01-08 11:51:38 +05:30
Ashish Gupta
2179b43232
fix the search for custom properties in advance search for some types (#19113)
* fix the search in advance search custom properties

* modify v1/metadata/types/customProperties api to get customPropertyConfig along with name and type

* added config list in the entity ref list

* fix type of duration, timestamp and other types

* minor ui changes

* remove customProperty type which are not supported for now

* added playwright test around the duration type property

* fix flaky test

---------

Co-authored-by: sonikashah <sonikashah94@gmail.com>
2025-01-08 11:08:34 +05:30
sonika-shah
5ccc0c5a2a
Improvement #19065 : Support removing existing enumKeys (for enum type custom property) (#19054)
* Improvement : Support removing existing enumKeys (for enum type custom property)

* initial implementation of background job job runner for enum cleanup

* fix postgres query

* ui: allow existing enum value updates in EditCustomPropertyModal

* create BackgroundJob to use jsonSchema

* feat: add socket event handling for background job part1

* fix(i18n): remove trailing spaces in Galician language JSON file

* refactor to use jsonSchema

* feat(ui): show browser notification for custom property update

* feat(utils): add getCustomPropertyEntityPathname function and tests

* change enumCleanup trigger condition

* feat(i18n): add enum property update message to multiple language JSON files

* enhancement : improve execution flow and better exception handling with test

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2025-01-07 19:25:59 -08:00
Pere Miquel Brull
e56f477a4a
Fix #19147 - Executable Test Suites (#19221)
* backend

* format & tests

* rename backend

* migrations and ingestion

* format & tests

* format & tests

* tests

* format & tests

* tests

* updated ui side of changes

* addressing comment

* fixed failing unit test

* fix test list

* added e2e test, and fixed existing test

---------

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2025-01-07 17:59:54 +01:00
sonika-shah
15ea84a873
Bug Fix - Glossary export returns null values in relatedTerms column (#19173)
* Bug Fix - Glossary export returns null values in relatedTerms column

* Add coverage test
2025-01-07 08:21:05 -08:00
Sriharsha Chintalapani
6142f24bca
Issue-19066: ViewAll() not working with matchAnyTag() and isOwner() conditions (#19209)
* Issue-19066: ViewAll() not working with matchAnyTag() and isOwner() conditions

* Issue-19066: ViewAll() not working with matchAnyTag() and isOwner() conditions

* Fix tests

* Minor: Fix checkstyle

---------

Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
2025-01-07 07:39:46 -08:00
Sriharsha Chintalapani
3678d1c3d6
upgrade logback versions (#19259) 2025-01-07 19:30:36 +05:30
sonika-shah
53e93fe377
move activeFqn to new method (#19263) 2025-01-07 16:20:59 +05:30
IceS2
617b8948e7
MINOR: Add Governance Bot to the workflow automated tasks (#19222)
* Add Governance Bot to the workflow automated tasks

* Fix tests
2025-01-07 07:55:41 +01:00
sonika-shah
3d8b9b3217
Persist Knowledge Page hierarchy state on refresh (#19236) 2025-01-07 12:10:36 +05:30
sonika-shah
38a970b829
Bug Fix : ApiEndpoint reindexing failure (#19200) 2025-01-05 23:16:31 +05:30
sonika-shah
0d3393c3c1
Fix - Existing custom properties getting removed on import of empty extension column (#19234) 2025-01-05 23:16:14 +05:30
IceS2
1c793cc268
MINOR: Remove Delete Events from Workflow Consumer (#19219)
* Remove Delete Events from Workflow Consumer

* Remove Delete Events from Workflow Consumer
2025-01-03 18:32:18 +01:00
Mayur Singal
87f5b54b6b
Fix #19141: Data Insight Tier Filter does not work (#19142) 2025-01-03 15:44:01 +05:30
Mohit Yadav
d60327c448
Onboarding Application Changes for OSS (#19203) 2025-01-03 13:49:34 +05:30