2365 Commits

Author SHA1 Message Date
sonika-shah
c55c66f845
Move user activity migrations to 1.9.9 (#23453) 2025-09-18 12:21:56 +05:30
Ayush Shah
dc125b67a4
fix: update OpenMetadata API version to 1.9.8 (#23430) 2025-09-17 09:57:46 +05:30
Ram Narayan Balaji
edebee9b73
Add entityStatus and reviewers to testCase, reviewers for testSuite (#23340)
* Add entityStatus and reviewers to testCase

* Update generated TypeScript types

* Filtering fields based on parent for testCase

* Reviewers for Test Suite, Inherit Reviewers from all test suites for this test case

* Update generated TypeScript types

* getFiltered Fields centralised in the EntityUtil

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-09-16 18:20:38 +00:00
Adrià Manero
840f7e2a68
Setup NotificationTemplate CRUD (#23293) 2025-09-16 15:21:11 +02:00
sonika-shah
cc18ba1554
feat: Add configurable filters aggregation for tag source segregation in search (#23363)
* feat: Add configurable filters aggregation for tag source segregation in search

* Update generated TypeScript types

* use script based aggregation

* use script based aggregation

* Update generated TypeScript types

* update aggregations with script

* add migrations to fetch updated searchSettings

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
2025-09-16 15:16:06 +05:30
aravinds502
fe08a1511f
fix[Issue-22794]: Restore the owner list with original owners (#23252) 2025-09-16 13:00:31 +05:30
Ram Narayan Balaji
c4c851c077
Fix #22547: Include All the tests to be run in the CI build for openmetadata-service (#22552)
* Include All the tests to be run in the CI build for openmetadata-service

* Resort to individual directory includes in the surefire plugin

* Fix: RateLimiterComparisonTest

* Fix: RateLimiterProductionReadinessTest

* Fix: ListFilterTest

* Fix: SearchListFilterTest

* Fix: RequestLatencyContextTest

* Fix: RequestLatencyTrackingSimpleTest

* fix: SearchRepositoryTest failing tests

* fix: SearchRepositoryTest failing tests

* fix:FuzzySearchClauseTest failing tests

* fix:SearchClusterMetricsTest failing tests

* fix SM tests

* fix UserMetricsServletTest

* fix JwtFilterTest,MicrometerBundleTest,TagUsageCacheTest

* Fix RuleEngineTests

* Corrected TestUsageCacheTest

* Fix Java CheckStyle

* Fix CollectionDAOEventOrderingTest

* Fixes: CI test failures in TagUsageCacheTest.java - eliminate timing assertion and focus on testing/validating cache functionality

* Fixes: CI test failures in RelationshipCacheTest.java - eliminate timing assertion and focus on testing/validating cache functionality

* Fix RelationshipCacheTest.java

* Disable Request Latechny Threshold Tests

---------

Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
Co-authored-by: sonikashah <sonikashah94@gmail.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: sonika-shah <58761340+sonika-shah@users.noreply.github.com>
Co-authored-by: aji-aju <ajithprasad770@gmail.com>
2025-09-16 12:20:26 +05:30
Teddy
dad07bc7fa
ISSUE #23281 - changed passed/failed[Rows] to Long to handle 64-bits numbers (#23325)
* fix: changed passed/failed[Rows] to Long to handle 64-bits numbers

* fix: failing test case
2025-09-16 08:38:33 +02:00
Teddy
f54e902bfe
fix: implement noop decryptConfig for external app pipeline generation (#23407) 2025-09-16 08:01:27 +02:00
Sriharsha Chintalapani
4d2087cf64
Fix: revert removal of deployIngestionPipeline method (#23406) 2025-09-15 23:54:12 +02:00
sonika-shah
6797f739f3
Fix #21097 - Add new rule noDomain() (#22874)
* Fix #21097 - Add new rule noDomain()

* remove repeating logic

* add playwright test

* address feedback
2025-09-15 21:42:59 +05:30
Sriharsha Chintalapani
cf7931ee3b
Add logging endpoint into S3 (#22533)
* Add logging endpoint into S3

* Update generated TypeScript types

* Stream Ingestion logs to S3

* Update generated TypeScript types

* Address comments

* Update generated TypeScript types

* create logs mixin, use clients to stream logs

* centralize logs sending into mixin

* use StreamableLogHandlerManager instead global handler

* improve condition

* remove example workflow file

* formatting changes

* fix tests and format

* tests, checkstyle fix

* minor changes

* reformat code

* tests fix

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
Co-authored-by: harshsoni2024 <harshsoni2024@gmail.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2025-09-15 07:22:25 -07:00
IceS2
7c9d85ae2e
FIXES #21808: Add domain filtering support to incident manager (#23120)
* feat: Add domain filtering support to incident manager

- Add domain query parameter to TestCaseResolutionStatusResource API
- Implement domain join logic in TestCaseResolutionStatusRepository
- Update frontend types to include domain parameter
- Integrate domain filtering in IncidentManager component using domain store
- Incidents are now automatically filtered by the active domain selection

Fixes #21808

Co-authored-by: IceS2 <IceS2@users.noreply.github.com>

* Allow Incidents to be filtered by Domain

* Remove wrong code

* Fix Checkstyle

* Fix UI tests

* Fix optional chaining in paging parameter parsing

* Update API endpoints in Incident Manager tests to use new search/list structure

* Fix SearchListFilter

* Fix Filter

* Fix Get Latest from Search

* Fix Get Latest from Search

* fix: correct string interpolation in API request URL for test case filtering

* adding debug log

* minor

* Fix OpenSearch issues

* revert logs, and playwright config

---------

Co-authored-by: claude[bot] <209825114+claude[bot]@users.noreply.github.com>
Co-authored-by: IceS2 <IceS2@users.noreply.github.com>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
Co-authored-by: Teddy <teddy.crepineau@gmail.com>
2025-09-15 16:15:46 +02:00
Ram Narayan Balaji
364fb5155a
Fix SearchClient to have a tie break sort, Flaky GlossaryTermResourceTest, BotResourceTest for Etag and floating point validations (#23364)
* Fix Flaky GlossaryTermResourceTest, BotResourceTest for Etag and floating point validations

* Adding name.keyword as an additional tie breaker sort when _score is used

* Certification timestamp is the issue, fixing it by increasing to 150 seconds due to heavy load in CI
2025-09-15 19:26:45 +05:30
Mohit Yadav
4efb507a0c
Fix Issue for removed user updating an entity (#22931)
* Fix Issue for removed user updating an entity

* Fix updatingUser resolution to use current updater instead of previous

---------

Co-authored-by: aji-aju <ajithprasad770@gmail.com>
Co-authored-by: Ajith Prasad <37380177+aji-aju@users.noreply.github.com>
2025-09-15 18:22:25 +05:30
Bhanu Agrawal
f1039fdb40
refactor: Convert Elasticsearch script constants to Java text blocks for improved readability (#23347) 2025-09-15 17:04:31 +05:30
Bhanu Agrawal
55d9054d69
fix: resolve critical security vulnerabilities (Netty, Spring, commons-lang) (#23324)
* fix: upgrade Spring Framework to 6.1.15 for security vulnerability

  - Upgrades spring-beans, spring-core, spring-expression from 6.1.14 to 6.1.15
  - Addresses security vulnerability detected by Snyk
  - Patch release with no breaking changes

* fix: resolve critical security vulnerabilities in dependencies
2025-09-15 17:02:59 +05:30
Bhanu Agrawal
72e2aeb0b8
fix: Convert dynamic Elasticsearch scripts to parameterized scripts to avoid compilation limit (#23393) 2025-09-15 16:53:57 +05:30
Mohit Yadav
455d9cd68c
Added better Searching via Claude tool (#23343) 2025-09-12 18:55:24 +05:30
Mohit Yadav
d1e829ed8c
Remove Embeddings for Table Index (#23322)
* Remove Embeddings for Table Index

* Check style fix
2025-09-12 12:16:14 +05:30
Ram Narayan Balaji
9fd34c8f89
Feat #20586 Implementation of Custom Metrics Measurement Units (#22876)
* Initial Implementation of Custom Metrics Measurement Units

* Update generated TypeScript types

* Removed Regex patterns and length validations as they are not needed

* Add a new column with index for custom units

* Remove comments in the sql

* update ui and add playwright

* fix metric selector

* fix tests

* address feedbacks

* remove unused field

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
2025-09-11 15:14:38 +05:30
Mayur Singal
d705fffc1d
Fix #1968: Query Runner Schema (#23077) 2025-09-11 10:41:11 +05:30
Bhanuagr
c336257cf4
fix: iterate arrays in reverse when removing elements in SearchClient (#23215)
* fix: iterate arrays in reverse when removing elements in SearchClient

Changed loops in SearchClient.java to iterate backwards over tags, dataProducts,
lineage, entityRelationship, and testSuites arrays before removing elements.

This prevents skipping elements or index errors due to forward iteration while removing items.

* Refactor Painless scripts to use removeIf and Java multiline strings

* Fix failed Java checkstyle

---------

Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
2025-09-11 10:35:43 +05:30
sonika-shah
673da282c3
Add missing user_activity migrations to 1.9.8 (#23304)
* Add missing user_activity migrations to 1.9.8

* replace with dynamic sql queries in case of mysql

* move to java migrations for adding missing userActivity columns

* Revert postgres schemaChanges.sql to match main branch exactly

* fix test
2025-09-11 00:54:30 +05:30
sonika-shah
2e7af27c0d
Fix test flakiness in FeedResourceTest (#23300) 2025-09-09 23:40:20 +05:30
Mohit Yadav
450840eb8e
Drop Insights Indexes (#23294) 2025-09-08 17:59:14 +05:30
Chirag Madlani
5b7c569ebf
feat(ui): support custom operator for array object contains (#23248)
* feat(ui): support custom operator for array object contains

* add contains logicOps

* added playwright test and supported contains in tags and glossary as well

* fix sonar issue

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2025-09-08 11:26:37 +02:00
Pere Miquel Brull
4483e183cb
MINOR - Update contract security schema (#23274)
* MINOR - Update contract security schema

* Update generated TypeScript types

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-09-08 10:42:34 +02:00
Pere Miquel Brull
17d5a5d83f
MINOR - Handle chart for Data Contract and add schema validations (#23242)
* test for chart

* MINOR - Handle chart for Data Contract and add schema validations

* MINOR - Handle chart for Data Contract and add schema validations
2025-09-08 10:42:15 +02:00
Teddy
568baab426
ISSUE #2031 - Add App Runner to Application Entity (#23259)
* feat: added exporter app config

* refactor: added entityprofile resource & added backward compatibility to existing API

* feat: added tests to get_profile_data_by_type

* feat: remove non supported event types

* chore: added migrations to 1.9.7

* chore: added application creation readme

* feat: implemented backend support for agent runner for external applications

* chore: move migrations to 1.9.8

* Update generated TypeScript types

* fix: added setIngestionRunner method to serviceEntityInterface interface

* Update generated TypeScript types

* fix: remove service instanceof MetadataService in deploy endpoint

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-09-08 08:04:50 +02:00
Teddy
1ef191a2aa
ISSUE #1534 - Profiler Refactor for Metadata Extraction Application (#23200)
* feat: added exporter app config

* refactor: added entityprofile resource & added backward compatibility to existing API

* feat: added tests to get_profile_data_by_type

* feat: remove non supported event types

* chore: added migrations to 1.9.7

* chore: added application creation readme

* chore: move migrations to 1.9.8

* fix: failing java test

* style: ran java linting
2025-09-05 13:07:04 +02:00
Adrià Manero
571d7ee2eb
Allow Alerts to notify Lineage downstream entities stakeholders (#23218)
* Setup schema and core lineage traversal service for retrieving downstream entities

* Update getTargetsForAlert signature to use SubscriptionDestination

* Modify alert target finder method to support lineage entities analysis

* Rename utility class and method to explore downstream entities of the lineage graph

* Apply style

* Prevent entering on recursion when maxDepth is lower than 0

* Update generated TypeScript types

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-09-05 12:49:37 +02:00
Ram Narayan Balaji
0b56562e2b
Fix: setInheritedFields for spreadsheet, worksheet, file, directory (#23262) 2025-09-04 14:24:01 -07:00
Mohit Yadav
080f0d21fb
Concurrency issues in search (#23249)
* Fix - 23213 : WebSocketManager Issue on concurrent modification

* Await till consumers comelete the job

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2025-09-04 10:25:50 -07:00
Ram Narayan Balaji
be5887eb00
Restore deleted entities will take inherited fields into consideration (#23255)
* Restore deleted entities will take inherited fields into consideration

* dummy commit
2025-09-04 10:09:20 -07:00
Teddy
4537a54717
fix: remove cursor from tcr pagination (#23214) 2025-09-04 16:46:15 +02:00
Pere Miquel Brull
1e48241f51
MINOR - Add Security, SLA and Terms of Use to Data Contract (#23230)
* jsonschema

* MINOR - Add Security, SLA and Terms of Use to Data Contract

* Update generated TypeScript types

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-09-04 11:51:34 +02:00
IceS2
ebc67a9f97
MINOR: Add new WorkflowType and converter (#23090)
* Add new WorkflowType and converter

* Update generated TypeScript types

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-09-04 10:11:35 +02:00
Ram Narayan Balaji
5cb33ce78a
Implementation of Adding Entity Status and Reviewers to assets (#22904)
* Initial Implementation of Adding Status and Reviewers to assets for workflows

* Update generated TypeScript types

* Copilot Review Comments Addressed

* Removed DataProduct Reviewer Inheritance as it is irrelevant

* Commit: Classification has status and reviewers, DataContract uses the same status enums, changed the logic to be APPROVED instead of Active, DataContract can have null status as seen in tests, Changed Workflow to use workflowStatus instead of status as it is contradicting with the approval status, Fixed Tests

* Default for reviewers is null

* Default for reviewers is createSchema

* Addressed CoPilots comments

* Update generated TypeScript types

* Workflow status to workflowStatus in db and migrations

* Revert "Workflow status to workflowStatus in db and migrations"

This reverts commit 676e8789358654bc6f980f855c372f33c22fc40b.

* Changed status to entityStatus in the schema files

* Java Implementation of Default Status, Search Client improvements and Test fixes and new tests

* Adding entityStatus and reviewers in the searchIndex mappings and common attributes

* Data Migration scripts to change the glossaryTerm and dataContract structure

* Update generated TypeScript types

* Fixed zh/spreadsheet index json error

* Fix Postgre migration script

* Changed the entityStatus.json to status.json
Removed the duplicates of entityStatus in the indexMapping
Modified the sample data to take in EntityStatus.Approved instead of ContractStatus.Active

* Update generated TypeScript types

* dummy commit

* Fix UI Build Issues with the New EntityStatus
Fix py tests

* Migrations for all the entities that need entityStatus

* Update generated TypeScript types

* Removed Post Migration scripts

* Fix UI  and py for entityStatus

* Update generated TypeScript types

* Fix: DataContractResourceTest

* Fix UI and py for importing entityStatus

* UI to show and fetch Reviewers

* cleanup

* Removed Overridden SetDefaultStatus in GlossaryTermRepository

* Removed unnecessary validation

* Added entityStatus in search_entity_index_mapping.json

* Fixed DataContractResourceTest

* mvn spotless apply and fix migration scripts

* fix tests

* fix type error

* fix advanced search tests

* Status comparison using enums and supportsStatus to supportsEntityStatus

* mvn spotless apply

* fix merge conflict

* update entity status

* fix tests

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
2025-09-03 12:49:45 +05:30
sonika-shah
b2b61d7b62
Fix Data Product to asset mapping lost after upgrade (#23195) 2025-09-03 08:26:10 +05:30
Mayur Singal
0e3a550c95
MINOR: Fix column lineage validation (#23075) 2025-09-02 22:00:18 +05:30
Adrià Manero
d33ffe40a3
Document current status of ChangeEventScheduler and Race Condition issue (#23198) 2025-09-02 16:10:18 +02:00
Ram Narayan Balaji
f4d8eb027a
Fix Flowable exception in GlossaryTermResourceTest (#23186) 2025-09-02 16:33:24 +05:30
Himanshu Khairajani
b6788677f4
Rename migration files from v195 to v196 (#23194)
Renamed migration classes and utilities to v196 for MySQL and PostgreSQL.

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-authored-by: --global <--global>
Co-authored-by: Claude <noreply@anthropic.com>
2025-09-02 09:25:48 +02:00
Akash Verma
421f345554
Snowplow Connector (#23133)
* Snowplow Connector

* markdown file change

* UI

* ts file

---------

Co-authored-by: Akash Verma <akashverma@Mac.lan>
2025-09-02 11:32:33 +05:30
Pere Miquel Brull
0e5093d366
FIX - Data Product bulk addition with different types (#23188)
* FIX - Data Product bulk addition with different types

* FIX - Data Product bulk addition with different types
2025-09-02 08:02:12 +02:00
Akash Verma
a41d0404c4
Feature: ServiceNow Connector (#23093)
* service now connector files

* updated schema and ui file

---------

Co-authored-by: Akash Verma <akashverma@Mac.lan>
2025-09-02 11:00:23 +05:30
Sriharsha Chintalapani
cb42409999
GlossaryTerm Search endpoint (#23005)
* Glossary Term load issues

* Glossary Term load issues

* Fix #20081: Infinite scroll Pagination support for Glossary Term Table in UI

* Fix #20081: Infinite scroll Pagination support for Glossary Term Table in UI

* fixed glossary infinite scroll

* removed script

* fixed glossary fialing playwright

* fixed expand and collapse for entire hierarchy

* Add search endpoint to support glossary term search

* Add search endpoint to support glossary term search

* fixed fetchAllTerm glitch (#23037)

* resolve conflicts and fix style

* minor prettier fix

* Fix(ui): Infinity Scroll Playwright  (#23088)

* fixed comments

* removed unncessary files

* addressed ui issue

---------

Co-authored-by: Ashish Gupta <ashish@getcollate.io>

* Fix(ui):Infinite Scroll Unit Tests (#23131)

* fixed failing unit tests

* fixed mock type field

* Minor: Move migrations to 1.9.6

* Revert unintended changes in 1.9.5 migration files

* fix build

---------

Co-authored-by: Dhruv Parmar <83108871+dhruvjsx@users.noreply.github.com>
Co-authored-by: sonika-shah <58761340+sonika-shah@users.noreply.github.com>
Co-authored-by: sonikashah <sonikashah94@gmail.com>
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
2025-09-02 09:32:16 +05:30
Mayur Singal
6b65b5d075
MINOR: Fix data insight index for multidomain (#23159) 2025-09-01 13:10:26 +05:30
Mohit Yadav
643618823a
Fix Resource Context - Invalid Entity Type being passed (#23164) 2025-08-30 06:55:27 -07:00