13822 Commits

Author SHA1 Message Date
Ram Narayan Balaji
8deff55f9e Increase the Flowable's polling time to 60 seconds to poll timer and async jobs table 2025-09-07 19:41:22 +05:30
Ram Narayan Balaji
52c3c82ead
Merge branch 'main' into feature/custom-workflows 2025-09-05 21:30:21 +05:30
Ram Narayan Balaji
e43f245e80 Workflow Transaction Manager to handle authorization as part of its functionality, Added Validation for workflows using /validate endpoint 2025-09-05 21:29:55 +05:30
Chirag Madlani
b6f9ed4a5b
fix(test): aut failures for bot and persona profile (#23254)
* fix(test): aut failures for bot and persona profile

* fix personaDeleteionUserprofile

* fix data contract aut failure

* rever unwanted changes
2025-09-05 21:22:39 +05:30
Harshit Shah
a5f6e9d13b
Allow multi assets selection for curated assets (#23084)
* Allow multi assets selection for curated assets

* fix failing test

* update empty widget icon sizes

* fix failing tests

* add certification filter

* fix failing unit test

* address comments

* fix e2e test

* add curated assets e2e tests

* minor fix

* Fix curated assets issue and add unit tests

* fix failing unit tests

* add e2e tests

* fix e2e test

* fix failing tests

* minor fix

* address comments

* minor fix
2025-09-05 17:24:50 +05:30
Teddy
1ef191a2aa
ISSUE #1534 - Profiler Refactor for Metadata Extraction Application (#23200)
* feat: added exporter app config

* refactor: added entityprofile resource & added backward compatibility to existing API

* feat: added tests to get_profile_data_by_type

* feat: remove non supported event types

* chore: added migrations to 1.9.7

* chore: added application creation readme

* chore: move migrations to 1.9.8

* fix: failing java test

* style: ran java linting
2025-09-05 13:07:04 +02:00
Adrià Manero
571d7ee2eb
Allow Alerts to notify Lineage downstream entities stakeholders (#23218)
* Setup schema and core lineage traversal service for retrieving downstream entities

* Update getTargetsForAlert signature to use SubscriptionDestination

* Modify alert target finder method to support lineage entities analysis

* Rename utility class and method to explore downstream entities of the lineage graph

* Apply style

* Prevent entering on recursion when maxDepth is lower than 0

* Update generated TypeScript types

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-09-05 12:49:37 +02:00
Keshav Mohta
103857f90c
Fixes #23010 #: BigQuery Project Selection In Profiler & AutoClassification Workflow (#23233)
* fix: added code for separate engine and session for each project in rofiler and classification and refactor billing project approach

* fix: added entity.database check, bigquery sampling tests

* fix: system metrics logic when bigquery billing project is provided
2025-09-05 14:09:14 +05:30
Marat Khambelov
972afc375a
ISSUE-23207: Date formatters work according to the chosen language (#23258) 2025-09-05 12:48:39 +05:30
Ashish Gupta
13bf23939f
fix contract schema pagination key selection not persisting (#23250)
* fix contract schema pagination key selection not persisting

* fix the unit test

* added playwrigt for it
2025-09-05 12:46:35 +05:30
Ashish Gupta
999af800b3
fix contract status button not visible in persona having contract tab (#23237)
* fix contract status button not visible in persona having contract tab

* supported playwright test for the same

* fix the unit test failing
2025-09-05 10:21:13 +05:30
Sriharsha Chintalapani
1f4186b661
Add missing tier mapping (#23263) 2025-09-04 14:24:17 -07:00
Ram Narayan Balaji
0b56562e2b
Fix: setInheritedFields for spreadsheet, worksheet, file, directory (#23262) 2025-09-04 14:24:01 -07:00
Mohit Tilala
d926ed9dad
[Snowflake] Handle cases when stream source is not retrievable (#23245) 2025-09-05 00:27:31 +05:30
Mohit Yadav
080f0d21fb
Concurrency issues in search (#23249)
* Fix - 23213 : WebSocketManager Issue on concurrent modification

* Await till consumers comelete the job

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2025-09-04 10:25:50 -07:00
Shailesh Parmar
2fb41687d2
Fix #23232 Users with Data Product edit permission unable to upload images due to missing Domain resource permission (#23257)
Fixes
2025-09-04 10:25:35 -07:00
Ram Narayan Balaji
be5887eb00
Restore deleted entities will take inherited fields into consideration (#23255)
* Restore deleted entities will take inherited fields into consideration

* dummy commit
2025-09-04 10:09:20 -07:00
Mohit Tilala
9b2b4d2452
[Lineage] Fix cross services lineage changes of service_names to missed methods (#23240)
* Fix cross db changes of service_names to missed methods

* Handle string value passed to service_names
2025-09-04 20:38:05 +05:30
Dhruv Parmar
70d9a1182e
fix(ui): Flaky ServiceEntity And Entity Playwright (#23162)
* fix flaky serviceEntity and entity

* added new testid

* fix domain list flakyness

* fix flaky user as owner in unsorted list

* addressed comments

* fixed flaky tests from entity spec

* removed unwanted code

* removed unwanted code

* added playwright config file for debugging cl issue

* removed playwright file
2025-09-04 20:20:05 +05:30
Teddy
4537a54717
fix: remove cursor from tcr pagination (#23214) 2025-09-04 16:46:15 +02:00
Pere Miquel Brull
1e48241f51
MINOR - Add Security, SLA and Terms of Use to Data Contract (#23230)
* jsonschema

* MINOR - Add Security, SLA and Terms of Use to Data Contract

* Update generated TypeScript types

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-09-04 11:51:34 +02:00
Shailesh Parmar
7961a583f5
feat: Added documentation panel for test case form (#23085)
* feat: add TestCaseForm documentation and enhance TestCaseForm component layout

* Refactor TestCaseForm and related components for improved structure and styling

- Updated IDs in TestCaseForm for consistency
- Enhanced styling in TestCaseFormV1 for better layout
- Added onClick handler to SelectionCardGroup for improved interactivity
- Improved ServiceDocPanel to handle markdown loading state

* Enhance TestCaseForm and related components with detailed test definitions and improved styling

* Enhance ServiceDocPanel with EntitySummaryPanel integration and add styling for embedded documentation

* Refactor TestCaseForm and EditTestCaseModalV1 components for improved field handling and integrate ServiceDocPanel for enhanced documentation display

* Add display name section to TestCaseForm and enhance EditTestCaseModalV1 styling

* Enhance EditTestCaseModalV1 and TestCaseFormV1 tests with ServiceDocPanel integration and improved field focus handling

* Enhance ServiceDocPanel tests with improved rendering, markdown fetching, and active field highlighting

* Refactor test case selectors in DataQuality and TestCases specs for improved stability and visibility checks

* fixed failing test

* Fix selectors in DataQualityAndProfiler tests for consistency

* fixed test case
2025-09-04 14:02:54 +05:30
IceS2
ebc67a9f97
MINOR: Add new WorkflowType and converter (#23090)
* Add new WorkflowType and converter

* Update generated TypeScript types

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-09-04 10:11:35 +02:00
Akash Verma
8dd69af269
fix(snowplow) : json-changes (#23217)
* none

* snowplow-json-change

---------

Co-authored-by: Akash Verma <akashverma@Mac.lan>
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2025-09-04 09:34:25 +05:30
Ram Narayan Balaji
023e4d9090 Replace Tags/GlossaryTerms during Mutual Exclusivity and Append when there is no Mutual Exclusivity 2025-09-04 00:33:21 +05:30
github-actions[bot]
9461f0bae0 Update generated TypeScript types 2025-09-03 18:30:46 +00:00
Ram Narayan Balaji
58dfa62ccd Remove Extra assignees from user tasks 2025-09-03 23:57:30 +05:30
github-actions[bot]
d7f4951da2 Update generated TypeScript types 2025-09-03 18:08:19 +00:00
Ram Narayan Balaji
eba163496a Fix compilation issues and mvn spotless apply 2025-09-03 23:34:54 +05:30
Ram Narayan Balaji
400b03e89b Merge branch 'main' into feature/custom-workflows
# Conflicts:
#	openmetadata-service/src/main/java/org/openmetadata/service/governance/workflows/elements/nodes/automatedTask/impl/SetEntityAttributeImpl.java
#	openmetadata-service/src/main/java/org/openmetadata/service/migration/mysql/v1100/Migration.java
#	openmetadata-service/src/main/java/org/openmetadata/service/migration/postgres/v1100/Migration.java
#	openmetadata-service/src/main/java/org/openmetadata/service/migration/utils/v1100/MigrationUtil.java
#	openmetadata-spec/src/main/resources/json/schema/governance/workflows/elements/nodes/automatedTask/rollbackEntityTask.json
#	openmetadata-ui/src/main/resources/ui/src/generated/api/governance/createWorkflowDefinition.ts
#	openmetadata-ui/src/main/resources/ui/src/generated/governance/workflows/elements/nodes/automatedTask/setEntityAttributeTask.ts
2025-09-03 23:10:14 +05:30
Ram Narayan Balaji
ea76db36d4 DetailedUserApprovalTask changed to reviewChange task, Have validations for workflows where user approval tasks can only be available for entities that support reviewers 2025-09-03 23:01:55 +05:30
Johannes Schnepel
db61f01058
fix missing input sanitization of suggestions query (#23145)
Co-authored-by: Johannes Schnepel <johannes.schnepel@infoteam.de>
2025-09-03 18:55:38 +05:30
Ashish Gupta
f825ce2c26
fix the unit test for the DataContract (#23216) 2025-09-03 17:37:04 +05:30
Ram Narayan Balaji
c97078a3fe
SERVER_ENABLE_VIRTUAL_THREAD is marked false (#23219) 2025-09-03 15:55:04 +05:30
Nithin Teekaramanaa
9dbce9b9e9
Update user_mixin.py (#23167) 2025-09-03 11:28:39 +02:00
Mohit Tilala
f2fd8a9107
Fixes #22452: [Snowflake] Add custom host support for View in Snowflake source url (#23209) 2025-09-03 14:13:03 +05:30
Aniket Katkar
44a39ed475
Chore(UI): Fix advanced search playwright flakiness (#23176)
* Fix the flakiness in advanced search spec

* Add applications docs

* Fix the selection confirmation not working in case of custom property

* Fix the DataContract spec failure

* Fix the errors
2025-09-03 13:30:37 +05:30
celtiaml
e925e14edb
Fixes ISSUE-22200: Fix Spanish translations (#23165)
* Fix Spanish translations

* Fix remaining Spanish translations

* resolve conflict

* revert unwanted removed

---------

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2025-09-03 13:01:49 +05:30
Ram Narayan Balaji
5cb33ce78a
Implementation of Adding Entity Status and Reviewers to assets (#22904)
* Initial Implementation of Adding Status and Reviewers to assets for workflows

* Update generated TypeScript types

* Copilot Review Comments Addressed

* Removed DataProduct Reviewer Inheritance as it is irrelevant

* Commit: Classification has status and reviewers, DataContract uses the same status enums, changed the logic to be APPROVED instead of Active, DataContract can have null status as seen in tests, Changed Workflow to use workflowStatus instead of status as it is contradicting with the approval status, Fixed Tests

* Default for reviewers is null

* Default for reviewers is createSchema

* Addressed CoPilots comments

* Update generated TypeScript types

* Workflow status to workflowStatus in db and migrations

* Revert "Workflow status to workflowStatus in db and migrations"

This reverts commit 676e8789358654bc6f980f855c372f33c22fc40b.

* Changed status to entityStatus in the schema files

* Java Implementation of Default Status, Search Client improvements and Test fixes and new tests

* Adding entityStatus and reviewers in the searchIndex mappings and common attributes

* Data Migration scripts to change the glossaryTerm and dataContract structure

* Update generated TypeScript types

* Fixed zh/spreadsheet index json error

* Fix Postgre migration script

* Changed the entityStatus.json to status.json
Removed the duplicates of entityStatus in the indexMapping
Modified the sample data to take in EntityStatus.Approved instead of ContractStatus.Active

* Update generated TypeScript types

* dummy commit

* Fix UI Build Issues with the New EntityStatus
Fix py tests

* Migrations for all the entities that need entityStatus

* Update generated TypeScript types

* Removed Post Migration scripts

* Fix UI  and py for entityStatus

* Update generated TypeScript types

* Fix: DataContractResourceTest

* Fix UI and py for importing entityStatus

* UI to show and fetch Reviewers

* cleanup

* Removed Overridden SetDefaultStatus in GlossaryTermRepository

* Removed unnecessary validation

* Added entityStatus in search_entity_index_mapping.json

* Fixed DataContractResourceTest

* mvn spotless apply and fix migration scripts

* fix tests

* fix type error

* fix advanced search tests

* Status comparison using enums and supportsStatus to supportsEntityStatus

* mvn spotless apply

* fix merge conflict

* update entity status

* fix tests

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
2025-09-03 12:49:45 +05:30
Sweta Agarwalla
5625260237
fix(test): tag spec flakiness (#23190)
* fix tag spec flakiness

* fix explore filter order
2025-09-03 12:48:01 +05:30
Ashish Gupta
9aa194d877
chore(ui): fix the flaky test around metric spec (#23181)
* fix the flaky test around metric and customize landing

* reverted the customize test

* reverted the unwanted changes
2025-09-03 12:19:27 +05:30
Mohit Tilala
04a3639e47
Fixes #21895 #22363 #22369: Lineage improvements with multiprocessing, stored procedure level temp table processing and lineage filtering with db & schema (#22371)
* MINOR: Improve UDF Lineage Processing & Better Logging Time & MultiProcessing (#20848)

* Fix multiprocessing with better memory management and Airflow 2+ compatibility

* Add support for both multiprocessing and multithreading for relevant platforms

* Handle conflicting cross-db lineage changes of service_name parameter change

* Handle stored proc queries without caching all and increase the thread timeout times to cover 100% lineage

* Fix `get_table_query` inheritance and pylint

* Remove  mocks from db_utils tests

* Better db_utils test and fix the service_names parameter in case of schema_fallback

---------

Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
2025-09-03 11:26:14 +05:30
Karan Hotchandani
6b1184d203
fix search settings playwright (#23201) 2025-09-03 10:39:37 +05:30
sonika-shah
b2b61d7b62
Fix Data Product to asset mapping lost after upgrade (#23195) 2025-09-03 08:26:10 +05:30
github-actions[bot]
21c586e3a1 Update generated TypeScript types 2025-09-03 00:53:49 +00:00
satish
dbb44a49d3
Update API proxy path (#23153)
Co-authored-by: Satish <satish@Satishs-MacBook-Pro.local>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2025-09-02 23:46:15 +05:30
Ram Narayan Balaji
9184766e36 Changed info to debug logs 2025-09-02 23:15:29 +05:30
Ram Narayan Balaji
bc6d8ac71c
Merge branch 'main' into feature/custom-workflows 2025-09-02 23:03:50 +05:30
Ram Narayan Balaji
dfca8f9781 Test cases for custom workflows 2025-09-02 23:03:11 +05:30
Mayur Singal
0e3a550c95
MINOR: Fix column lineage validation (#23075) 2025-09-02 22:00:18 +05:30