1200 Commits

Author SHA1 Message Date
Teddy
d5c6e5b19a
ISSUE #24020: add supportedServcices for relavnt service DQ display (#24706)
* fix: add supportedServcices for relavnt service DQ display

data diff is not supported by all services. We need to only
display it on supported services

* fix: added query param and create filed
2025-12-05 15:40:33 +01:00
Ram Narayan Balaji
1bec15ea39
Feat: #24424 Flowable History Timed Cleanup and Ops Command for cleanup (#24367)
* Flowable History Timed Cleanup and Ops Command for cleanup

* Remove Commented Code

* Update generated TypeScript types

* Fix Migration column name

* Test Cases

* Remove cleanupAll parameter

* cron for default every sunday 12 am

* cron for default every sunday 12 am - 0 0 0 ? * 1

* Move Migrations to 1.11.1

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-12-05 16:35:23 +05:30
Ram Narayan Balaji
13a3bab075
Improv# Store Flowable Exceptions, Remove Internal Entities in Workflows, Improve Resume and Suspend Workflows - Release 1.11.1 (#24649)
* Flowable Exceptions are Stored in OMD instance tables, Remove internal fields from workflow event consumption

* Store Stages in Workflow in case of Errors

* Improvise Suspend and Resume workflow

* Update generated TypeScript types

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-12-05 14:29:44 +05:30
Aniket Katkar
9cd5e6cb82
Feat: Support multiple agent types in filtering and API calls (#24642)
* Support multiple agent types in filtering and API calls

* Fix java checkstyle

* test

* fix

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2025-12-02 11:31:21 +01:00
Bhanu Agrawal
5b2c79ca97
Make recreateIndex default true for search index (#24564) 2025-12-01 12:16:55 +01:00
sonika-shah
f87b111d13
Fix : Update dashboardDataModel sourceUrl mapping in search (#24608) 2025-11-28 20:48:28 +05:30
Keshav Mohta
86f7ab6e15
Fixes: Boolean Field Display Label (#24513)
* fix:rename field dbt search across databases -> dbt search across database services

* fix: update description and owners field titles

* fix: title

---------

Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
2025-11-28 18:47:35 +05:30
Mohit Yadav
b0d989cc43
[Fix] Search index stats : Added Reader and Sink Stats (#24566)
* Fix Search Index Stats

* Add language locale

* Update generated TypeScript types

* Update stats to sync back from Sink

* Add Migration

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-11-28 13:26:00 +05:30
Tomas Montiel Prieto
dd2fee105f
update embedding model default dim (#24582) 2025-11-28 08:28:20 +01:00
Suman Maharana
9603b88a29
Fix Pipeline Obs : use db instead of es (#24587)
* Pipeline Obs API es to db

* fix filters

* add servicetype filter

* fix paginations

* fix filters

* added pagination to observability

* Update generated TypeScript types

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
2025-11-28 07:36:49 +01:00
Sriharsha Chintalapani
4584580748
Fix #18690: Add support of ODCS (Open Data Contract Standard) (#24589)
* Fix #18690: Add support of ODCS (Open Data Contract Standard)

* Fix #18690: Add support of ODCS (Open Data Contract Standard)
2025-11-28 07:29:56 +01:00
Ayush Shah
f025c02326
Fix naming consistency for entity link parsing methods and grammar (#24388) 2025-11-26 12:43:29 +05:30
Sriharsha Chintalapani
abf3f7b7ca
Fix #24447: Add MSSQL SSL support (#24450)
* Add MSSQL SSL support

* Update generated TypeScript types

* Update generated TypeScript types

* fix: mssql ssl params and sidebar doc

* fix: mssql.md file

* fix: mssql ssl manager tests

* refactor: added mssql connection class converter and mssql.md connection argument description

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Keshav Mohta <keshavmohta09@gmail.com>
Co-authored-by: Keshav Mohta <68001229+keshavmohta09@users.noreply.github.com>
2025-11-25 13:06:19 +01:00
Pere Miquel Brull
d833941bf5
FIX - Check ingestion with incoming server version (#24543) 2025-11-25 12:29:49 +01:00
Keshav Mohta
b4c8313960
fix: unstructed containers in manifest metadata config (#24530) 2025-11-25 16:16:27 +05:30
Sriharsha Chintalapani
676cabd0b3
Add includeAggregates option to the search API (#24509)
* Add includeAggregates option to the search API

* Update generated TypeScript types

* Address review comments

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Bhanu Agrawal <bhanuagrawal2018@gmail.com>
2025-11-24 19:38:49 -08:00
Suman Maharana
743ff85ee4
WIP #23073 : Pipeline Observability (#23341)
* init pipeline-profiler cli command

* Fixed issues with the bulk sink

* Update generated TypeScript types

* fix and remove unnecessary code blocks

* fix and remove unnecessary code blocks

* Added get observ data by pipeline id api

* Added APIs for metrics and charts

* remove fallback mechanism

* Build fixes

* mvn build fixes

* Api remove unnecssary changes

* Fix Metrics API

* Fix trends API

* Fixed filtering

* Added sample data

* Added more sample data

* Move to metadata workflow

* removed unused files

* remove unnecesary files

* json2ts

* change to debug logs

* remove pipeline profiler helpers

* Update generated TypeScript types

* Update generated TypeScript types

* created PipelineExecutionIndex

* Fix limit param for pagination

* Update generated TypeScript types

* addressed comments

* linting

* fix sample_data

* Added serviceType in api response

* Add endtime in sample data

* Update generated TypeScript types

* Addressed comments

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Harshit Shah <harshit.shah@getcollate.io>
2025-11-25 08:21:23 +05:30
Sriharsha Chintalapani
d5804a6922
Revert "JSON Schema Upgrade: Draft-07 → 2020-12 (#24150)" (#24510)
* Revert "JSON Schema Upgrade: Draft-07 → 2020-12 (#24150)"

This reverts commit bd62e055d9413a95fe35fd8903af860ce8b0c07d.

* Update generated TypeScript types

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-11-23 19:57:42 -08:00
Sriharsha Chintalapani
bd62e055d9
JSON Schema Upgrade: Draft-07 → 2020-12 (#24150)
* JSON Schema Upgrade: Draft-07 → 2020-12

* Update generated TypeScript types

* Update generated TypeScript types

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-11-23 19:46:21 -08:00
Teddy
3bb7baa427
fix: permission with Create TestCase (#24477)
Added a createTest ops to the table resource to distinguish between
editTests and createTests permission layer
2025-11-21 08:20:54 +01:00
Himanshu Khairajani
9f30de9ebe
Removed supportsQueryRunner flag (#24443)
* removed supportsQueryRunner flag

* Update generated TypeScript types

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2025-11-20 12:06:42 +01:00
sonika-shah
ea3da86336
Fix #17152 Support a view permission for custom properties (#20276)
* Add ViewCustomFields operation

* ui: provide UI support for ViewCustomFields for custom properties

* Update generated TypeScript types

* provide view custom property support for right entity panel

* add unit test cases

* update permission with prioritized permission

* fix tests

* fix unit test

* fix the flay user test

* For custom property requests on entity types, use entity-specific authorization

* remove type checking, since now it will be check by viewCustomField

* fix test

---------

Co-authored-by: Harsh Vador <58542468+harsh-vador@users.noreply.github.com>
Co-authored-by: Harsh Vador <harsh.vador@somaiya.edu>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2025-11-20 15:35:41 +05:30
Pere Miquel Brull
057d2a524f
FIX #24286 - Close streamable logs streams (#24287)
* FIX #24286 - Close streamable logs streams

* FIX #24286 - Close streamable logs streams

* format

* fix tests

* fix endpoints

* test

* test

* fix minio setup for tests

* test

---------

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2025-11-19 12:06:50 +01:00
Mohit Yadav
7f5328f48c
Reapply "Fix Slack Config to be read from UI (#24396)" (#24405)
* Reapply "Fix Slack Config to be read from UI (#24396)"

This reverts commit 437a266ce130eb7b658060bc14ed492aa7d94743.

* Revert schema deletion
2025-11-18 17:15:28 +05:30
Karan Hotchandani
c334689150
feat(ui): domain treeview (#23963)
* initial implementation of domain treeview

* commit progress

* fix: improved the domain treeview UI (#24086)

* fix: improved the domain treeview UI

* fix: Fixed the add button height

* fix: Added search feature in domain tree view

* fix: Implemented new empty states UI for domains Tabs

* fix: added new text in the lang json files

* fix: Fixed the tree view empty state UI

* fix: rename prop name

* fix: extended the error placeholder component with new mui create UI

---------

Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>

* resolve merge conflicts

* PLAYWRIGHT: Domain treeview playwright (#24105)

* fix: Implemented new empty states UI for domains Tabs

* fix: extended the error placeholder component with new mui create UI

* Playwright: Added playwright test for domain treeview

* fix: Immediately display newly added data product in the list without requiring refresh (#24072)

* fix: Immediately display newly added data product in the list without requiring refresh

* Playwright: Added playwright test for data product list

* fix: reverted the skip test

* fix: Fixed minor bugs in domain treeview (#24134)

* fix: fixed domain treeview playwright test (#24138)

* fix: Fixed code smells (#24143)

* fix: Fixed glossary playwright test (#24151)

* Support pagination in domain hierarchy api and add new childrenCount field for domain

* Update generated TypeScript types

* fix total field count in domain hierarchy api

* fix domain/dataProduct filter

* feat: Implemented infinite scrolling in the domain treeview (#24212)

* feat: Implemented infinte scrolling in domain treeview

* fix: Fixed the code smell

* fix: rotate icon on expand and collapse of tree items

* fix: fixed the count mismatch on subdomain add/delete

* fix: removed unwanted field for hierarchy fetch api

* feat: implemented infinte scrolling in navbar domain dropdown

* fix: fixed the search query count bug

* fix: showing the actual children count in treeview

* fix: removed the domain count api from navbar domain dropdown

* feat: added pagination for subdomains in domain treeview

* feat: added pagination in subdomain in navbar domain dropdown

* feat: implemented the filters in domains treeview

* fix: fixed the tags query filter

* fix: hide filter for domain treeview

* fix: assigning single domain to entity

* fix: addressed PR comments

* fix: fixed the domainSelectableTree issue

* minor fix

* fix: fixed entity spec for domain

---------

Co-authored-by: Rohit Jain <60229265+Rohit0301@users.noreply.github.com>
Co-authored-by: sonikashah <sonikashah94@gmail.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: sonika-shah <58761340+sonika-shah@users.noreply.github.com>
Co-authored-by: Rohit0301 <rj03012002@gmail.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2025-11-18 16:35:06 +05:30
mohitdeuex
437a266ce1 Revert "Fix Slack Config to be read from UI (#24396)"
This reverts commit 421df519a6c8a4f5888d82e82c54036e2bdc703c.
2025-11-18 11:36:54 +05:30
Mohit Yadav
421df519a6
Fix Slack Config to be read from UI (#24396)
* Fix Slack Config

* Update generated TypeScript types

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-11-18 11:11:16 +05:30
Rohit Jain
3a9918d23d
Fixes 23497: Added Search and Sort Functionality at Schema Level (#23907)
* Feat: Added search functionality for schema tables and stored procedures

* Fix: memoize the searchProps of the table component

* Fix: fixed the table pagination issue

* Fix: Added search funtionality in service page

* Playwright: Added test for service page search

* Fix: Fixed the falling unit tests

* Fix: Fixed code smells

* fix: Fixed the current page reset issue

* fix: removed the getSearchPlaceholderKey util function

* fix: fixed the merge conflicts

* "fix: Added sorter on name column in all the tables"

* fix: Added search field in data models and api endpoint tab

* fix: Added search field in files and spreadsheets table

* playwright: Added e2e test for table search

* fix: fixed the failed unit test

* add new field service.fullyQualifiedName.keyword in index mapping

* fix: fixed the table search and sort playwright

* fix: fixed the api endpoint schema playwright test

* fix: fixed tha table search and sort playwright

* fix: removed serial from the table search and sort tests

---------

Co-authored-by: sonikashah <sonikashah94@gmail.com>
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
2025-11-18 10:51:56 +05:30
Ram Narayan Balaji
d1d2e69d3d
Fix #24302: Tasks should be assigned to newly patched reviewers, Metadata fields API should return response for tag, classification, Nitpicks removing the default value in the entity schema (#24275)
* Clean the default value of entityStatus

* Adding reviewers should assign Approval Tasks to them

* Adding om comment to the schema and SchemaExtractor

* Test Cases

* revert local fix

* Add schema field extractor for page, Defensive condition for NPEs

* Changed the subdirectory path to data for page

* Reverted the jsonLinters

* Reverted the jsonLinters in worksheet.json

* Added update Reviewers to Metric Repository. Polling in WorkflowDefinitionResourceTest

* Fix the timeouts of the test case

* Increase polling durations

* Increase Polling Time

* Fix Test cases, remove workflow definitions after the test for approval workflows
2025-11-18 10:05:49 +05:30
Mayur Singal
615cb8ec50
Fix #2324: Enable Parallel Execution for Query Runner App (#24256) 2025-11-17 18:42:22 +05:30
Himanshu Khairajani
e857a076e7
Queryrunner clean (#24328)
* config merge draft commit

* fields addition for query-runner

* fields addition for query-runner

* add registry at applications provider

* minor fix

* added password field in form utils

* commit progress

* add delete modal with mui

* supportsQueryRunner flag

* trino test

* Update generated TypeScript types

* add workflow api

* fix tests

---------

Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
2025-11-17 16:05:25 +05:30
Pere Miquel Brull
bad44db3fa
MINOR - Schemas to AI Agents (#24345)
* add agents

* ESResponse

* Update generated TypeScript types

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-11-16 20:08:36 +01:00
Adrià Manero
780a96b20b
Implement permission system for NotificationTemplates (#24301)
* Implement permission system for NotificationTemplate with field-level controls

* Update generated TypeScript types

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-11-14 10:14:38 +01:00
Sriharsha Chintalapani
587c4058ee
Bulk update APIs for Data Assets (#24262)
* Bulk APIs for Data Assets

* Update generated TypeScript types

* Bulk apis enablement on ingestion

* Ingestion status progress

* Update generated TypeScript types

* Bulk APIs for create/update data assets

* Bulk APIs for create/update data assets

* Update generated TypeScript types

* remove python changes

* Update bulk apis for other entities

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-11-14 08:24:28 +01:00
Teddy
dec8a0e9bc
MINOR - bulk create table APIs (#24238)
* Bulk APIs for Data Assets

* Update generated TypeScript types

* Bulk apis enablement on ingestion

* feat: fixed sample data ingestion + removed thread worker

* fix: ran java linting

* chore: align alation tests

* fix: test case ordering

---------

Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-11-13 13:53:12 +01:00
Akash Verma
766fd639bd
Fixes #23102: Add consoleEndpointURL support for S3-compatible services (#23998) 2025-11-12 18:04:31 +05:30
Adrià Manero
25eb9f028e
Implement Handlebars helpers metadata API endpoint (#24271)
* Implement Handlebars helpers metadata API endpoint

* Add cursorOffset and fix Handlebars helper syntax
2025-11-12 12:15:54 +01:00
Keshav Mohta
107a3c4946
Fixes #24132: Airbyte Cloud Support (#24261)
* feat: airbyte cloud support - added apis, refactor ingestion code

* fix: added tite in oneOf json & logLink /

* test: airbyte cloud tests

* test: airbyte cloud test json

* fix: airbyte test checkstyle

* fix: api expires_in instead of 3 minutes and typehinting
2025-11-11 16:24:09 +05:30
Ram Narayan Balaji
5bcf792aa4
Fix: #24100 Implementation for Change Events for Workflow Generated Changes and Manual Task Resolutions (#24108)
* Initial Implementation for Change Events for Workflow Generated Changes and Manual Task Resolutions

* Test case

* Add impersonatedBy to changeEvent schema, changeEvent generations, workflow consumer filtering, always override impersonatedBy even if not null

* Update generated TypeScript types

* Improved debug logging in WorkflowEventConsumer and tests

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-11-11 10:28:39 +05:30
Adrià Manero
9ad6783a99
Enable notification template preview and test send (#24229)
* Add NotificationTemplate sending and rendering endpoints with mock data

* Setup entity fixtures for mock notifications

* Update generated TypeScript types

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-11-10 17:06:26 +01:00
Chirag Madlani
f66c2e6eb0
Feat(ui): support contract tab for other entities (#23079)
* Feat(ui): support contract tab for other entities

* fix the tab being showed in entities along with the next and previous button with the functionality

* modify the contract badge status to all entities in data asset header

* supported topic,dashboardDataModel,ApiEndpoint in schema tab with the json changes

* Update generated TypeScript types

* fix the contract.ts file being deleted

* re-push the missing data in dataContract.json

* supported the contract tab in persona changes and also supported for Chart Entity

* fix the unit test and type error in schema for contract tab

* added playwright test for dataContract for other entities

* fix the sonar test

* added databas and schema contract test along with the previous failure

* added Database and DatabaseSchema contract test and fix other test issue due to merge conflict

* commeted out the tab support for charts now, since BE is still pending on it

* code polish, render schema table on condition with test and schema form default expand all keys

* Update generated TypeScript types

* fix the button props naming

* fix the buttons labels

* modify the playwright and include support for all entities checking

* fix the schema fields for other entities

* added support for fiel, directory, spreadsheet and worksheet and fix some playwright cases

* fix unit and playwright test

* fix some sonar issue

* fix some code smell and minor improvement

* fix unit test

* remove unwanted file

---------

Co-authored-by: Ashish Gupta <ashish@getcollate.io>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-11-10 18:15:12 +05:30
Adrià Manero
15dcfe7e39
Add bidirectional EventSubscription-NotificationTemplate relationship (#24204)
* Add bidirectional EventSubscription-NotificationTemplate relationship

* Update generated TypeScript types

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-11-07 12:08:36 +01:00
Adrià Manero
87b4424ab8
Add change tracking and external recipient support for Thread notifications (#24202)
* Allow notification to external email recipients for Task and Conversation threads

* Implement ChangeEvent changeDescription for thread Entities

* Update generated TypeScript types

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-11-06 16:13:50 +01:00
Ajith Prasad
8e41b1f475
Added FORCE_SECURE_SESSION_COOKIE flag (#24152)
* Added FORCE_SECURE_SESSION_COOKIE flag

* Update generated TypeScript types

* Added force secure session cookie to authentication Configuration

* Update generated TypeScript types

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-11-05 15:48:01 +05:30
Akash Verma
d03ddce814
collibra connector (#24155)
Co-authored-by: Akash Verma <akashverma@Mac.lan>
2025-11-05 13:57:31 +05:30
Keshav Mohta
8ef6c90622
feat: added salesforce oauth (#24154) 2025-11-04 19:29:07 +00:00
harshsoni2024
62cf67d15c
Fix: PowerBI connector to support custom API URL (#24158) 2025-11-04 21:05:19 +05:30
Teddy
e1c91c1e96
CHORE: rewire pipes for AI Application to use CAIP (#24117)
* chore: rewire pipes for AI Application to use CAIP

* Update generated TypeScript types

* chore: added sse client to ometa

* chore: ran python linting

* chore: added application migration

* chore: ran python linting

* chore: move collate route out of openmetadata

* chore: added json and params argument to mock methods

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-11-04 15:50:31 +01:00
Aniket Katkar
e1fa034c5b
Fix(UI): Auth sso form not showing some fields (#23889)
* Update schemas

* Remove the allowedEmailRegistrationDomains, allowedDomains, useRolesFromProvider fields from hidden state

* Refactor the SSO Configuration Form and add tests

* Fix code smells and refactor the code for SSOConfigurationForm

* Fix the code smells

* Remove the custom functions to create patch for SSO configurations

* Add mock for structuredClone

* Update generated TypeScript types

* Empty commit

* Fix the unnecessary cleanup of data before saving

* Update the default values for oidc configs

* Fix unit test

* Remove the unnecessary util function

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-11-04 14:54:01 +05:30
IceS2
73da5b507d
Fix #23642: Implement Ingestion side to return a flag when all values are unique (#23865)
* Implement Ingestion side to return a flag when all values are unique

* Update generated TypeScript types

* feat: Enhance CardinalityDistributionChart to display messages when all values are unique

- Added logic to check if all values are unique for both first day and current day data.
- Implemented a placeholder message when all values are unique, indicating no distribution available.
- Updated tests to cover scenarios for unique values and ensure correct rendering of charts and messages.
- Added localization for the new message in multiple languages.

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2025-11-04 09:47:52 +01:00