2262 Commits

Author SHA1 Message Date
mgorsk1
337108e212
🎉 Init (#19377) 2025-02-13 09:00:09 +05:30
Gyowanny P. Queiroz
2559c79edd
MINOR - Hybrid Ingestion Agent - Link ingestion agents to ingestion pipelines (#19751)
* Hybrid Ingestion Agent - Link ingestion agents to ingestion pipelines

* Store relationship as HAS types

* Java checkstyle

* Trigger CI
2025-02-12 14:31:51 +01:00
Pere Miquel Brull
ede8108a5a
MINOR - Validate basic suites do have basicEntityRef (#19763)
* MINOR - Validate basic suites do have basicEntityRef

* add test
2025-02-12 14:07:16 +01:00
Mayur Singal
e873ba0f1b
Fix #19201: Fix connection password masking (#19749) 2025-02-12 16:16:25 +05:30
IceS2
b120748656
MINOR: Use namespaced variables (#19648)
* Use namespaced variables

* Fix test

* Add LOG, remove uneeded catch

* Add Log, Refactor VariableHandler

* Add Validation at Definition time

* Add migration

* Remove comments

* Fix migrations by not setting deployed if workflowHandler is not initialized
2025-02-11 17:26:32 +05:30
sonika-shah
c0eb7d08de
GEN -19588 Sort Enum type Custom Property Values (#19637)
* GEN -19588 Sort Enum type Custom Property Values

* fix py-tests

* use streams for sorting
2025-02-11 14:29:01 +05:30
IceS2
7e6fc02585
Remove description check for columnDescriptionStatus (#19715) 2025-02-11 12:43:25 +05:30
Mohit Yadav
08de322e34
Fixes Email Issue in system repository being null (#19733) 2025-02-11 12:36:12 +05:30
Sriharsha Chintalapani
7e7691df15
Remove unused json-smart dependency (#19701)
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2025-02-10 20:36:10 -08:00
Imri Paran
5f73dd717b
Fix 19499: feat(apps): add app config in run record (#19544)
* feat(apps): add app config in run record

- changed returned schema type of "status" to "AppRunRecord"!
- added a "config" field in the app record
- added a "pending" stage so that "external" app status can be mapped ti internal app status

* added note about schema compatiblity

* added app config for external apps

* show config for every app run

* add tests

* revert open change for now

* Revert "revert open change for now"

This reverts commit e1492a5c92d1967b3d47230a25df4c2c3d399de2.

* update dependency

---------

Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
2025-02-07 15:21:58 +01:00
IceS2
c34b612df3
Fix followers for Data Insights index (#19693) 2025-02-07 13:47:48 +01:00
Sriharsha Chintalapani
be27f3e8fc
User Permissions on TestSuite and TestCases (#19072)
* issue-11002: user with Delete permission not able to delete testCases

* Fix creation of testSuite if there are conditions in policies

* issue-19072: User Permissions on TestSuite and TestCases

* replace `executable` with `basic`

* Improvement: Revamp the permissions for testCase & testSuite details page (#19137)

* Feat: revamp the permissions in test case and test suite details page

* minor fixes

* added permission checks for test case details page

* Add multiple permission check to Authorizer

* fixed failing unit test

* fix: incident and results permission

* added permission checks for incident manager

* fix: failing java tests

* allow edit the test case if table has edit permission for test case

* fix: test case detail + test suite resource

* fix: test suite PUT and PATCH permission

* style: ran java linting

* style: ran java linting

---------

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
2025-02-05 14:05:53 +01:00
Imri Paran
74c69a157a
chore(apps): reset error triggers on schedule (#19606) 2025-02-05 10:21:52 +01:00
dechoma
2308d4a4f3
remove object aliasing from buildReceiversListFromActions (#19495)
* remove object aliasing from buildReceiversListFromActions

* fix linting

---------

Co-authored-by: Siddhant <86899184+Siddhanttimeline@users.noreply.github.com>
Co-authored-by: sonika-shah <58761340+sonika-shah@users.noreply.github.com>
2025-02-04 10:39:04 +05:30
Mohit Yadav
6fba495daf
[MINOR] Fixes String value length (20054016) exceeds the maximum allowed (20000000, (#19643)
* Fixes Caused by: com.fasterxml.jackson.databind.JsonMappingException: String value length (20054016) exceeds the maximum allowed (20000000, from

* Update log message
2025-02-04 10:24:33 +05:30
mohitdeuex
04cab8e71a Revert "- Update lineage model and api"
This reverts commit c5cce2b0c7c1be7ba654bfc2677da0d05215a895.
2025-02-03 12:11:07 +05:30
mohitdeuex
03f492ad1d Revert "- Adds updatedAt and updatedBy"
This reverts commit c6b462f0ab5905fe339c08a05ab819ca940dd06d.
2025-02-03 12:11:07 +05:30
Mohit Yadav
78123db16c
Merge branch 'lineage-work' into main 2025-02-03 11:43:01 +05:30
sonika-shah
d067121fa3
Fix #17059 - Task cannot be closed by the non-admin user who created it (#19528)
* Fix #17059 - Task cannot be closed by the non-admin user who created it

* uncommented playwright test around the flow

---------

Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2025-02-03 11:04:50 +05:30
mohitdeuex
c6b462f0ab - Adds updatedAt and updatedBy 2025-02-02 23:13:15 +05:30
mohitdeuex
c5cce2b0c7 - Update lineage model and api 2025-02-02 22:46:28 +05:30
sonika-shah
773982210d
fix : aggregation issue in opensearch while fetching domain hierarchy (#19594) 2025-01-29 19:14:41 +05:30
Mohit Yadav
8c5eee8f07
Add prometheus counter for search and database (#19561)
* Add prometheus counter for search and dartabase

* chenge env

* typo - review comments
2025-01-29 00:08:45 +05:30
Mohit Yadav
58d5988a16
Add Onboarding SQL (#19525)
* Add Primary Key Migration

* Update queries and conflict on apps data store

* Update queries and conflict on apps data store

* add index on isBot
2025-01-28 11:45:58 +05:30
Teddy
36d8519b09
feat: add entityFQN query param for test case (#19541) 2025-01-27 17:51:06 +01:00
Mayur Singal
eea4b65b80
Fix #19198: di fix custom property filter (#19531) 2025-01-27 15:54:41 +05:30
sonika-shah
5b63c36ef1
Fix #19116 : Support for domain hierarchy listing (#19191)
* Backend support for domain hierarchy listing

* use linkedHashmap to maintain order of results in hierarchy

* Revert changes to generated files to match main

* show all domains for non admin user

* change select domain layout

* fix multiple save

* fix playwright

* cleanup

* fix domain tests

* fix domain tests

* fix icon styling

* show icons on navbar domain list

* update tests

---------

Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
2025-01-27 15:43:42 +05:30
Imri Paran
5482b94a57
feat(schedule-application): enable scheduling application using config file (#19470)
- added schedule to app private config
- reschedule a schedule application job in quartz if it exists.
2025-01-27 13:39:46 +05:30
sonika-shah
82198f8126
GEN -19341 : Improvement - Avoid usage of CONCAT in WHERE clause (#19510)
* Improvement : Avoid usage of CONCAT in WHERE clause

* fix tests

* remove usage of @BindFqnConcat

* remove usage of @BindFqnConcat

* fix test

* fix test
2025-01-27 11:20:25 +05:30
Siddhant
473688648b
Fix #18834: Introduce new setting OpenMetadataBaseUrlConfiguration to set the server endpoint (#19366)
* Refactor: Introduce openMetadataBaseUrlConfiguration to set up the server endpoint and remove OpenMetadataUrl from smtpSettings.json

* migrations.

* refactor(cli): add setOpenMetadataUrl command to store OpenMetadata URL

* refactor(cli): add configureEmailSettings command to manage SMTP/Email configuration

* load initialData when config is not present in the db

* add om url settings page

* update locales

* add e2e

* load omBaseUrl with default host and port: localhost:8585 when not present

---------

Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
2025-01-27 10:20:04 +05:30
Imri Paran
a6670af500
MINOR: Use interface schemas for governance workflows (#19411)
* feat(apps): support event subscriptions

- added support for apps with event subscriptions.
- added support for custom consumers on event subscriptions.
- use native application methods instead of reflection in ApplicationHandler

* removed runMethodFromApplication reflection and use concrete methods from AbstractNativeApplication

* format

* fix(governance-workflows): defined interface in workflow schema

- defined types for workflow nodes
- fixed updateEdge method in WorkflowDefinitionRepository

* ref(governance-workflows): use explicit types in schema

use explicit interface type in json schemas and use annotations to infer the concrete classes when deserializing

* - implemented CustomSignal trigger
- use JsonTypeInfo and JsonSubTypes to infer types in jsonschema for nodes and triggers
- Implemented JsonLogicFilter task
- implemented placeholder noop task

* - simplified trigger type names
- removed governance workflow root "type"
- added "deployed" field to governance workflow
- applied changes to existing gov-workflows
- migrations

* fixed migrations
2025-01-24 09:08:06 +01:00
Mohit Yadav
907eb7cb07
Move Recreate Out of executors (#19501)
* Move Recreate Out of executors

* Add Entities option in Operations

* Fix Reindexing for null list for referred columns
2025-01-24 10:38:45 +05:30
IceS2
901063b802
FIX #19386 & #19388: Fixing Data Insights index mapping (#19423)
* Fixing Data Insights index mapping

* Add OpenMetadataOperations cli endpoint to reindex data insights

* Improve IndexMapTemplate building

* Improve the code a bit

* Fix test
2025-01-23 10:02:52 +01:00
Teddy
cacfabd9ce
ISSUE #1052 - Implement List entities with test suites repo logic (#19461)
* fix: centralized listWithOffset logic

* feat: dq app config + list entities with tests logic

* fix: test case
2025-01-22 08:08:07 +01:00
Mohit Yadav
5064602dc8
[Fix-19437] Redirection issue on IDP initiated calls (#19443)
Co-authored-by: Siddhant <86899184+Siddhanttimeline@users.noreply.github.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2025-01-22 11:46:32 +05:30
Siddhant
486230827d
#15600: Retention Application : Delete change_events, activity threads, versions based on admin retention policies (#18913)
* feat(retention-policy): initial setup of the Retention Policy app

* refactor: Update logic to make RetentionPolicyApp a ScheduledOrManual app

* refactor: Update retention policy JSON schema and logic to support event subscription, versions, and activity thread with individual retention periods

* refactor: Rename eventSubscriptionRetentionPeriod to changeEventRetentionPeriod

* fix: Implement activity thread retention policy cleanup

* chore: Remove activity thread and versions retention code; add banner and icon
2025-01-21 18:12:35 +05:30
sonika-shah
9a69c18b59
Minor : Get missing dataProducts and pipeline properties in /customProperties api (#19445) 2025-01-21 14:58:04 +05:30
Imri Paran
3abae45403
MINOR: feat(apps): support event subscriptions (#19338)
* feat(apps): support event subscriptions

- added support for apps with event subscriptions.
- added support for custom consumers on event subscriptions.
- use native application methods instead of reflection in ApplicationHandler

* removed runMethodFromApplication reflection and use concrete methods from AbstractNativeApplication

* format
2025-01-21 07:10:26 +01:00
Chirag Madlani
00a37c6180
Fix(ui): refresh call concurrency for multiple browser tabs (#19303)
* fix(ui): refresh auth token for multi browser tabs

* update refresh logic

* fix multiple tab issue

* fix tests

* added tests

* fix ingestion bot failure

* fix sonar cloud

* update test description

* remove unused code and reset test on after all

* bump playwright

* avoid running refresh tests as it's been flaky for postgres

* revert playwright version bump changes

* Put 500 status

---------

Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
2025-01-20 23:31:56 +05:30
Mayur Singal
e5acdab3b8
MINOR: Fix DI Filter not getting applied (#19400) 2025-01-20 10:37:07 +05:30
sonika-shah
b8ea105395
Fix - 19359 : Get only non-deleted entities in export (#19396) 2025-01-17 14:44:14 +05:30
Teddy
d8e6219200
MINOR - Async test case result deletion (#19390)
* fix: async test case result deletion

* move async call to calling method
2025-01-16 16:24:20 +01:00
Gyowanny P. Queiroz
cbbef9e3b9
Move PipelineServiceClient to openmetadata-spec (#19381) 2025-01-15 14:41:47 -03:00
Teddy
084d2efa6c
MINOR - createMany endpoint for test case resource (#19340)
* feat: createMany endpoint for test case resource

* test: createMany tests for test cases

* fix: change ops context to test case + copy nullified object
2025-01-15 17:28:23 +01:00
sonika-shah
788dfc331f
dataProduct : get inherited fields from corresponding Domain (#19343)
* dataProduct : get inherited fields from corresponding Domain

* add tests

---------

Co-authored-by: karanh37 <karanh37@gmail.com>
2025-01-14 22:16:23 +05:30
Mohit Yadav
3c2f037534
Fix Search Index for ER Model (#19349) 2025-01-14 19:47:48 +05:30
Mohit Yadav
d66c689f6d
Add Indexing Stack (#19305) 2025-01-09 22:51:49 +05:30
Mohit Yadav
4c15cc0d91
Add Operations to install Onboarding app (#19298)
* Add Operations to install app

* Initiate Jwt
2025-01-09 16:10:35 +05:30
Mohit Yadav
adfbc21a00
revert: Circular Rendering issue for lineage (#19270) (#19299) 2025-01-09 16:07:21 +05:30
Mayur Singal
8f27ed0455
MINOR: Implement pagination in pipeline lineage render (#19295) 2025-01-09 15:21:04 +05:30