13939 Commits

Author SHA1 Message Date
Pranita Fulsundar
033ad183b4
Merge branch 'main' into search-refactoring-1 2025-09-26 12:24:16 +05:30
Pranita
9dbbc077ae fix e2e tests 2025-09-26 12:18:51 +05:30
Eugenio
bb50514a00
FIxes #16983: can't sample data from trino tables with complex types (#23478)
* Update test data for `tests.integration.trino`

This is to create tables with complex data types.

Using raw SQL because creating tables with pandas didn't get the right types for the structs

* Update tests to reproduce the issue

Also included the new tables in the other tests to make sure complex data types do not break anything else

Reference: [issue 16983](https://github.com/open-metadata/OpenMetadata/issues/16983)

* Added `TypeDecorator`s handle `trino.types.NamedRowTuple`

This is because pydantic couldn't figure out how to create python objects when receiving `NamedRowTuple`s, which broke the sampling process.

This makes sure the data we receive from the trino interface is compatible with Pydantic
2025-09-26 08:13:28 +02:00
Shrushti Polekar
cc265f956b
fix profiler view permission aut failure (#23574) 2025-09-26 10:01:48 +05:30
Pranita
5620ce90fd fix tests 2025-09-26 04:38:17 +05:30
Pranita
2eef851724 fix test 2025-09-26 02:00:55 +05:30
Pranita
5261047ef8 refactor all query filtersusing getTermQuery function 2025-09-25 20:47:47 +05:30
Pranita Fulsundar
6448f22dbf
fix search preview test (#23555) 2025-09-25 20:40:41 +05:30
Ashish Gupta
e9333fd439
chore(ui): fix ingestion bot playwright timeout issue (#23547) 2025-09-25 20:36:09 +05:30
sonika-shah
648a8f86de
add entityType.keyword aggregation in searchSettings.json (#23559)
* add searchSettings aggregation in searchSettings.json

* refactor migrations to only update the agg in searchSettings

* fix migrations
2025-09-25 17:04:49 +05:30
Pranita
9a6b286d7b revert dataProduct fqn change 2025-09-25 15:56:01 +05:30
Keshav Mohta
e77b4d6faf
docs: added drive metadata doc & custom drive doc (#23552) 2025-09-25 15:36:38 +05:30
Mayur Singal
787d27f3f7
MINOR: Enable Log streaming for ingestion pipelines (#23551) 2025-09-25 14:35:18 +05:30
Sweta Agarwalla
8eaf4f585d
fix(test): flaky tests (#23212)
* fixed fkaky tests

* fix APIs
2025-09-25 10:51:39 +05:30
Ashish Gupta
68f496a2df
chore(ui): fix lineage cycle playwright test (#23545) 2025-09-25 10:47:01 +05:30
Karan Hotchandani
91067467a7
paginate for find search index app (#23540) 2025-09-25 10:38:11 +05:30
Ashish Gupta
7334f529e8
fix the tags playwright test (#23544) 2025-09-25 10:35:28 +05:30
Sriharsha Chintalapani
4768c00fcf
zero‑downtime reindex (#23515)
* Fix #23514: zero‑downtime reindex feature

* Fix #23514: zero‑downtime reindex feature
2025-09-24 12:01:04 -07:00
Ram Narayan Balaji
532f3e5e4e
Undo entity status migration, show entityStatus by default (#23511)
* Revert Entity Status Migrations as we already have the default value

* Batch Migrations and by default show entityStatus field in the response

* Setting default value of enum in the status.json and fixing test cases for new default enum UNPROCESSED

* Update generated TypeScript types

* DataContract by default has Unprocessed status, Overriden method in the GlossaryTermRepository

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-09-24 18:38:03 +05:30
Aniket Katkar
c6c9eb26e2
Feat: Add drive service (#23018)
* Add the drive service settings option

* Fix the ci error

* Add Directory Details page

* Add Explore page support for new drive assets

* Add Directory Children table

* Update page.json

* Add File details page

* Add spreadsheet details page

* Add Worksheet details page

* Update explore tree name

* Fix the search suggestions not showing for new assets

* Add new assets in missing setting options

* Update service util class base for drive service

* Add version support for directory

* Add version pages for File, Spreadsheet and Worksheet

* Add FQN for worksheet columns

* Add columns table for the worksheet

* Fix the Spreadsheet, Directory and Worksheet version pages not showing children.

* Fix the domain not updating for drive assets

* Fix announcement not working for drive assets

* Add playwright for Directory asset

* Fix the index mappings and failing playwright test for directory

* Add google drive service icon

* Fix the delete and restore functionality for drive assets

* Fix patch tags for worksheet and add tests

* Fix failures

* search indices

* Update service details page for drive service

* Add playwright tests for remaining drive assets

* Fix listing APIs to return when root=true mentioned

* Update API to fetch drive service assets and fix playwright for Worksheet service

* Fix the index mappings

* Add the new fields for advanced search

* Add the playwright tests for drive assets

* fix: drive service test connection

* fix: drive service test connection

* Fix the ServiceDetailsPage tests

* Fix the playwright tests

* Fix the search settings issue for drive assets

* add missing icons, fix search index issue for worksheet, resolve the sonar issues

* Fix the entity permission spec

* Fix FileResourceTest to create GoogleDrive instead of SharePoint to match the type creation in the test

* Work on comments

---------

Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
Co-authored-by: Keshav Mohta <keshavmohta09@gmail.com>
Co-authored-by: Ram Narayan Balaji <ramnarayanb3005@gmail.com>
2025-09-24 13:37:31 +05:30
Adrià Manero
dacd60d535
Fixes #23129: Add system-default notification templates (#23441)
* Setup system provided templates for ChangeEvent notifications

* Setup handlebars helpers for system-default notification templates
2025-09-24 09:56:30 +02:00
Chirag Madlani
8deab28071
feat(ui): support impact analysis for lineage (#23231)
* feat(ui): support impact analysis for lineage

* WIP filters

* Add Node Depth and fix downstream and upstream counts

* integrate search / quick filters with api

* fix api calls

* Fix Listing and remove unnecessary call for root entity

* Fix OS

* support column level lineage for impact analysis

* update

* Add Pagination Apis and Node Depth apis

* Fix Looping infinitely

* Add Validation

* Reduce Response size for lineage

* Add node depth upto

* Add Edge Information

* incorporate new apis

* push queryFilter to fetchNodes

* query_filter -> queryFilter

* add export for impact analysis

* update pagination

* fix query_filter param

* Fix issue on upstream lineage result due to filters

* Fix Filters issue

* Update generated TypeScript types

* update unit tests

* fix tests

* address comments

* support impact analysis for all the tabs

* update icon for column customization

* Fix breaking tests

* update test

* update translation

* Fix Wrong Match for UPSTREAM

* clean console

---------

Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-09-24 12:53:20 +05:30
Pranita Fulsundar
7f661d8648
Merge branch 'main' into search-refactoring-1 2025-09-24 11:23:30 +05:30
Suman Maharana
be51d53464
Fix - Hive Metastore None issue (#23520) 2025-09-24 10:11:29 +05:30
Sriharsha Chintalapani
e77d1940cb
Domain policy must be evaluated during PolicyEvaluator (#23302)
* Domain Only Access Role to be evaluated as part of PolicyEvaluator

* Domain Only Access Role to be evaluated as part of PolicyEvaluator

* Cleanup unnecessary comments

* Add migration fix for domain only policy

* fix playwright domain rbac

* fix hasDomain role issues for TestCaseResourceContext

* allow user to create only with their domain

* move DomainOnlyAccessPolicy migrations to 1.9.10 from 1.9.9

* For resources that don't support domains (like DataInsights), always returns true

* fix adding test case to bundleSuite

* revert supportsDomains changes in RuleEvaluator and handle it in postFiltering steps

* Inherit domains when creating task from test case incident, and skip few entities for domain check + other remaining DQ related domain fixes

* for CreateResourceContext consider assigned domains + inherited domains

* fix permission for table metrics page

* remove SKIP_DOMAIN_CHECK_ENTITY_LIST

* fix test

---------

Co-authored-by: sonika-shah <58761340+sonika-shah@users.noreply.github.com>
Co-authored-by: sonikashah <sonikashah94@gmail.com>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
2025-09-24 09:56:55 +05:30
Mohit Yadav
9921301048
Fix Vulnerability (#23504)
* Fix Vulnerability

* Update database schema

---------

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2025-09-24 08:54:32 +05:30
Ashish Gupta
11226b2b3f
MINOR: fix the add team error placeholder using wrong permission (#23522)
* fix the team error placeholder using wrong permission

* remvoe the unwanted file
2025-09-24 00:41:55 +05:30
Ashish Gupta
1d4aff0154
fix the redirect path of mention knowledge article and breadcrumb (#23519)
* fix the redirect path of mention knowledge article and breadcrumb

* added data-test id here
2025-09-23 23:41:58 +05:30
Mayur Singal
933802a354
MINOR: Support metabase API Key Auth (#23436) 2025-09-23 22:01:10 +05:30
Keshav Mohta
cb26c91442
Revert "Fixes #23356: Databricks OAuth & Azure AD Auth (#23482)" (#23530)
This reverts commit f1afe8f5f114ee58090168fd7ae5d66b38a01ab0.
2025-09-23 17:44:16 +02:00
Teddy
57c5a50d20
ISSUE #23435 - Fix pass / fail count for custom SQL (#23506)
* fix: added logic to compute pass/fail for sql queries with cte, nested queries, and joins

* added logic to correctly compute pass / fail rows

* style: ran python linting

* fix: failing tests

* style: fix linting error

* fix: flawed count logic

* fix: handle case where we don't compute row count
2025-09-23 16:53:51 +02:00
Suman Maharana
79fde4ab02
Minor: improved dbt debug logs (#23509) 2025-09-23 19:52:58 +05:30
Ayush Shah
d94b39f6f5
fix(ssl): Update SSLManager to use dynamic schema registry paths (#23505) 2025-09-23 18:10:18 +05:30
Ram Narayan Balaji
e058c5393e
MigrationFix for duplicate ViewAll in OrganizationPolicy (#23524) 2025-09-23 14:28:41 +02:00
Keshav Mohta
f1afe8f5f1
Fixes #23356: Databricks OAuth & Azure AD Auth (#23482)
* feat: databricks oauth and azure ad auth setup

* refactor: add auth type changes in databricks.md

* fix: test after oauth changes

* refactor: unity catalog connection to databricks connection code
2025-09-23 15:22:50 +05:30
Suman Maharana
1c710ef5e3
Fix Stream logger url (#23491) 2025-09-23 14:35:14 +05:30
Ram Narayan Balaji
3771149fb5
Feat: Add color and iconURL in import and export for glossary (#23477)
* Add color and iconURL in import and export for glossary

* fix tests

* add color and icon url in playwright

---------

Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
2025-09-23 14:32:53 +05:30
Shailesh Parmar
38eeb262a0
update playwright config setting to keep tracing on failure (#23517) 2025-09-23 14:30:46 +05:30
Keshav Mohta
9262040381
fix: handle database native types for create table request during openlineage lineage (#23513) 2025-09-23 10:11:39 +02:00
Suman Maharana
e2b903532e
Fixes - Kafkaconnect lineage & descriptions (#23234)
* Fix Kafkaconnect lineage & descriptions

* fix typos

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* address comments

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* address comms

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
2025-09-23 10:08:37 +02:00
Shrushti Polekar
eebd3bb661
Feat(ui): SSO configuration from UI and Scim bot token generate revoke functionality and Group Mapping in settings page (#21839)
* added scim bot generate revoke token functionality on settings page

* update global setting constant

* minor code refactor

* WIP: SSO Configuration from UI

* Update generated TypeScript types

* Copilot suggestions addressed

* Test Endpoint added

* Added update security configuration test

* added sso configuration rjsf form

* minor  fixes

* Update generated TypeScript types

* update scim component

* Fix Merge Conflicts

* Remove extra comma

* update sso form for oidc client providers

* SAML configuration fixes

* Update generated TypeScript types

* Update generated TypeScript types

* add support for selective schema generation by file name

* fix acces token card issue and array fields ui issue

* Saml registration fix

* Scim configuration saved

* refactor code

* scim config issues fixed

* fix enableSelfSignup

* scim enabling from settings

* Test validation enpoint changes

* fix ldap issues

* minor refactor

* minor updates

* update settings call for scim

* update bot details in scim card

* minor style fixes

* Adding enhanced validators

* update confidential client configurations

* Auth0 validator

* update jwt for saml

* Saml validator changes

* Okta validator fix

* fix saml certificate formatting and select widgets

* remove client type from ui for ldap and saml

* Okta validation rectified

* Google validator improved

* update select component

* fix error messages

* added unit test

* Azure validator rectified

* Validation issues solved for auth0

* add oidc prefix for oidc client fields

* fix type issues

* style fixes for scim token card

* Update cognito validator

* refactor file names

* added e2e tests

* minor fixes

* added content for docs in md files

* implement  new design

* form style updates

* fix doc styles and provider selection styles

* fix provider selection style

* update local file

* group client fields together

* added provider name

* overview tab changes

* update form styles for configure tab

* update toggle styles

* update breadcrumb texts and provider name in text

* minor fix in localization

* minor fix for basic provider

* update breadcrumb styles and minor local file update

* minor fixes

* minor fix for local file

* fix styles for configured form

* minor fixes in styles

* fix redirect issue of my-data for non oidc sso

* fix build issue and refactor code

* update saml and ldap icons

* minor updates in icon

* typo fix

* breadcrumb and style fixes

* fix test

* update patch call

* minor fixes for access token card and code refactor

* refactor code to remove unused files

* added ldap and custom oidc doc content

* fix overview tab issue for scim and enable sso

* Patch issue fixed for authentication Configuration

* Implement unified authentication endpoints across all providers

* Memory leak issue solved

* Mcp md file

* apply spotless

* Added complete flow test for oidc

* refactor css files

* minor style updates

* cancel form functionality

* update placeholders

* update cancel modal

* minor update for saving existing config

* fix minor css issue

* integrate unified api

* remove clientid and callbackurl for confidential client type and added  jwtPrincipalClaimsMapping

* fix breadcrumb issue

* refactor files and folder structure

* minor fix

* refactor code and add disable fields styles and cancel btn functionality for existing sso

* added localization file changes

* Patch operation issue fixed

* Update generated TypeScript types

* update patch call

* patch call update for enable self signup

* remove enable selfsignup from then form since its present in the toggle

* added enable self signup field for non existing sso form

* minor code revert for enabling fields

* Update generated TypeScript types

* Redirect uri, password encoding fixes for basic and ldap

* refactor code and encode password and added /auth/callback in redirecturl

* minor  fixes

* added group mapping

* cancel modal save btn fix and logout fix

* minor fix for save btn functionality for cancel modal

* minor update in localization file

* address pr comments for ssoconfigform and css file names

* address pr comments for sso doc panel

* address pr comments around provider selector

* fix breadcrumb

* update localization file and remove unwanted files

* address pr comments related to basic auth provider

* extracted proxy code into separate func and added dev mode check

* remove unnecessary validate call happening during patch calls

* address pr comment related to tab

* update sso icon

* minor fix

* address parseSchema related pr comment

* address pr comment related to config fields constants

* added default value for callback url

* added default value for response type and clientAuthenticationMethod

* minor fix for callback url

* minor style fix

* Changed response to json for basic and ldap login

* revert unified api changes done for basic login

* made admin principal as required

* fix playwright for llogin test failure

* fix failing unit test

* fix login e2e test

* refresh call

* fix failing unit test

* fix unit test

* fix test

* remove setRefreshToken

* added default values for google

* minor style fixes

* minor text update

* Google credential validation, scope validation

* Discovery uri validation added with Auth0

* Discovery uri check added for okta

* minor style fixes

* minor checkbox fix

* minor required field fix

* minro fix

* AWS cognito validator

* google api depdendency added

* Update generated TypeScript types

* minor fixes

* minor fix for array fields cursor style issue

* Modified saml validator

* Admin principal respected while logging in

* Added tests for validators

* callback url update

* custom oidc validator

* added default values for saml

* custom oidc fix

* Saml validator issue solved

* Custom oidc publickeyurl validation

* validation for prompt

* test fix

* fix test

* TC fixed

* mvn spotless apply

* Addressed review comments

* Static method issue in Security COnfiguration manager fixed

---------

Co-authored-by: aji-aju <ajithprasad770@gmail.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: Ajith Prasad <37380177+aji-aju@users.noreply.github.com>
2025-09-23 13:23:46 +05:30
Karan Hotchandani
0f548a6829
chore(ui): introduce route position for plugin routes (#23512)
* add route position

* rename enum
2025-09-23 12:59:44 +05:30
Ushran Gouhar
15487b0a50
Issues/22729/bug fix avatar initial (#23499)
* fix(ui): fix avatar inital

* Add the fallback value

* Add support for unicode characters
2025-09-23 11:45:31 +05:30
Harshit Shah
862ea6bcbb
chore(ui): Add notification for default persona change (#23502)
* chore(ui): Add notification for default persona change

* add key in params
2025-09-23 10:01:41 +05:30
Ayush Shah
806509b3ad
fix: Update required Node.js version to 22 in prerequisites script (#23507) 2025-09-23 09:56:53 +05:30
IceS2
a630ca2be6
Fixes #23330: Implement Fetch DQ Test Cases by FollowedBy (#23461)
* Implement Fetch DQ Test Cases by FollowedBy

* Update generated TypeScript types

* Fix wrong conflict resolution

* Refactored into Optional

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-09-23 01:08:49 +05:30
Pere Miquel Brull
49bdf1a112
MINOR - Report status for tests that blow up (#23326)
* MINOR - Report status for tests that blow up

* format
2025-09-22 16:34:36 +02:00
Mohit Tilala
d1e60acd2a
[SAP HANA] Prevent exponential processing lineage parsing and use full name for filtering (#23484)
* Prevent exponential processing lineage parsing

* Use full name of views for filtering

* pylint fix - isort
2025-09-22 19:46:34 +05:30
Teddy
71f993a2fc
Minor fix broken 1.9.8 migrations (#23487)
* chore: fix duplicate migrations from 1.9.8

* fix: psql update query
2025-09-22 13:13:25 +00:00
Ashish Gupta
0d0bd5a632
fix the teams flaky playwright test (#23495) 2025-09-22 16:58:51 +05:30