5284 Commits

Author SHA1 Message Date
Shailesh Parmar
7ef9508f0a fix: improve application robustness and UI consistency
- Set default value for plugins in AppRouter to prevent potential errors.
- Add conditional rendering for ProfilerLatestValue to avoid rendering issues when props are undefined.
- Make profilerLatestValueProps optional in ProfilerStateWrapper interface for better flexibility.
- Refactor ColumnProfileTable to remove unused imports and optimize rendering logic.
- Replace Button with Typography for better styling in ColumnProfileTable.
- Update SingleColumnProfile to use Stack for layout consistency and include ColumnSummary when available.
- Enhance CardinalityDistributionChart and DataDistributionHistogram with new styling and layout using MUI components.
- Introduce DataPill styled component for consistent data display.
- Update color constants for improved visual consistency across charts.
- Modify data insight tooltip to conditionally display date in header for better clarity.
2025-09-25 21:29:29 +05:30
Shailesh Parmar
f062908e56 feat(ui): Refactor Table Profiler to enhance test case summary handling and improve data quality metrics display 2025-09-25 11:40:53 +05:30
Shailesh Parmar
77065638a8 Merge remote-tracking branch 'origin/main' into revamp-data-obs-tabs 2025-09-24 20:02:15 +05:30
Shailesh Parmar
a7e82c8834 feat(ui): Enhance Data Observability components with new features, improve layout, and integrate test case result aggregation 2025-09-24 20:01:34 +05:30
Aniket Katkar
c6c9eb26e2
Feat: Add drive service (#23018)
* Add the drive service settings option

* Fix the ci error

* Add Directory Details page

* Add Explore page support for new drive assets

* Add Directory Children table

* Update page.json

* Add File details page

* Add spreadsheet details page

* Add Worksheet details page

* Update explore tree name

* Fix the search suggestions not showing for new assets

* Add new assets in missing setting options

* Update service util class base for drive service

* Add version support for directory

* Add version pages for File, Spreadsheet and Worksheet

* Add FQN for worksheet columns

* Add columns table for the worksheet

* Fix the Spreadsheet, Directory and Worksheet version pages not showing children.

* Fix the domain not updating for drive assets

* Fix announcement not working for drive assets

* Add playwright for Directory asset

* Fix the index mappings and failing playwright test for directory

* Add google drive service icon

* Fix the delete and restore functionality for drive assets

* Fix patch tags for worksheet and add tests

* Fix failures

* search indices

* Update service details page for drive service

* Add playwright tests for remaining drive assets

* Fix listing APIs to return when root=true mentioned

* Update API to fetch drive service assets and fix playwright for Worksheet service

* Fix the index mappings

* Add the new fields for advanced search

* Add the playwright tests for drive assets

* fix: drive service test connection

* fix: drive service test connection

* Fix the ServiceDetailsPage tests

* Fix the playwright tests

* Fix the search settings issue for drive assets

* add missing icons, fix search index issue for worksheet, resolve the sonar issues

* Fix the entity permission spec

* Fix FileResourceTest to create GoogleDrive instead of SharePoint to match the type creation in the test

* Work on comments

---------

Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
Co-authored-by: Keshav Mohta <keshavmohta09@gmail.com>
Co-authored-by: Ram Narayan Balaji <ramnarayanb3005@gmail.com>
2025-09-24 13:37:31 +05:30
Shailesh Parmar
5a6443cfc3 feat(ui): Enhance Profiler components with additional props and improve layout using Grid 2025-09-24 13:04:08 +05:30
Chirag Madlani
8deab28071
feat(ui): support impact analysis for lineage (#23231)
* feat(ui): support impact analysis for lineage

* WIP filters

* Add Node Depth and fix downstream and upstream counts

* integrate search / quick filters with api

* fix api calls

* Fix Listing and remove unnecessary call for root entity

* Fix OS

* support column level lineage for impact analysis

* update

* Add Pagination Apis and Node Depth apis

* Fix Looping infinitely

* Add Validation

* Reduce Response size for lineage

* Add node depth upto

* Add Edge Information

* incorporate new apis

* push queryFilter to fetchNodes

* query_filter -> queryFilter

* add export for impact analysis

* update pagination

* fix query_filter param

* Fix issue on upstream lineage result due to filters

* Fix Filters issue

* Update generated TypeScript types

* update unit tests

* fix tests

* address comments

* support impact analysis for all the tabs

* update icon for column customization

* Fix breaking tests

* update test

* update translation

* Fix Wrong Match for UPSTREAM

* clean console

---------

Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-09-24 12:53:20 +05:30
Sriharsha Chintalapani
e77d1940cb
Domain policy must be evaluated during PolicyEvaluator (#23302)
* Domain Only Access Role to be evaluated as part of PolicyEvaluator

* Domain Only Access Role to be evaluated as part of PolicyEvaluator

* Cleanup unnecessary comments

* Add migration fix for domain only policy

* fix playwright domain rbac

* fix hasDomain role issues for TestCaseResourceContext

* allow user to create only with their domain

* move DomainOnlyAccessPolicy migrations to 1.9.10 from 1.9.9

* For resources that don't support domains (like DataInsights), always returns true

* fix adding test case to bundleSuite

* revert supportsDomains changes in RuleEvaluator and handle it in postFiltering steps

* Inherit domains when creating task from test case incident, and skip few entities for domain check + other remaining DQ related domain fixes

* for CreateResourceContext consider assigned domains + inherited domains

* fix permission for table metrics page

* remove SKIP_DOMAIN_CHECK_ENTITY_LIST

* fix test

---------

Co-authored-by: sonika-shah <58761340+sonika-shah@users.noreply.github.com>
Co-authored-by: sonikashah <sonikashah94@gmail.com>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
2025-09-24 09:56:55 +05:30
Ashish Gupta
11226b2b3f
MINOR: fix the add team error placeholder using wrong permission (#23522)
* fix the team error placeholder using wrong permission

* remvoe the unwanted file
2025-09-24 00:41:55 +05:30
Ashish Gupta
1d4aff0154
fix the redirect path of mention knowledge article and breadcrumb (#23519)
* fix the redirect path of mention knowledge article and breadcrumb

* added data-test id here
2025-09-23 23:41:58 +05:30
Mayur Singal
933802a354
MINOR: Support metabase API Key Auth (#23436) 2025-09-23 22:01:10 +05:30
Keshav Mohta
cb26c91442
Revert "Fixes #23356: Databricks OAuth & Azure AD Auth (#23482)" (#23530)
This reverts commit f1afe8f5f114ee58090168fd7ae5d66b38a01ab0.
2025-09-23 17:44:16 +02:00
Shailesh Parmar
b188cc56b3 feat(ui): Enhance Profiler components with new metrics, improved styling, and additional color constants 2025-09-23 21:05:09 +05:30
Shailesh Parmar
f312629121 feat(ui): Update color constants and enhance Profiler components with new tooltip and chart features 2025-09-23 16:39:08 +05:30
Keshav Mohta
f1afe8f5f1
Fixes #23356: Databricks OAuth & Azure AD Auth (#23482)
* feat: databricks oauth and azure ad auth setup

* refactor: add auth type changes in databricks.md

* fix: test after oauth changes

* refactor: unity catalog connection to databricks connection code
2025-09-23 15:22:50 +05:30
Ram Narayan Balaji
3771149fb5
Feat: Add color and iconURL in import and export for glossary (#23477)
* Add color and iconURL in import and export for glossary

* fix tests

* add color and icon url in playwright

---------

Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
2025-09-23 14:32:53 +05:30
Shailesh Parmar
38eeb262a0
update playwright config setting to keep tracing on failure (#23517) 2025-09-23 14:30:46 +05:30
Shrushti Polekar
eebd3bb661
Feat(ui): SSO configuration from UI and Scim bot token generate revoke functionality and Group Mapping in settings page (#21839)
* added scim bot generate revoke token functionality on settings page

* update global setting constant

* minor code refactor

* WIP: SSO Configuration from UI

* Update generated TypeScript types

* Copilot suggestions addressed

* Test Endpoint added

* Added update security configuration test

* added sso configuration rjsf form

* minor  fixes

* Update generated TypeScript types

* update scim component

* Fix Merge Conflicts

* Remove extra comma

* update sso form for oidc client providers

* SAML configuration fixes

* Update generated TypeScript types

* Update generated TypeScript types

* add support for selective schema generation by file name

* fix acces token card issue and array fields ui issue

* Saml registration fix

* Scim configuration saved

* refactor code

* scim config issues fixed

* fix enableSelfSignup

* scim enabling from settings

* Test validation enpoint changes

* fix ldap issues

* minor refactor

* minor updates

* update settings call for scim

* update bot details in scim card

* minor style fixes

* Adding enhanced validators

* update confidential client configurations

* Auth0 validator

* update jwt for saml

* Saml validator changes

* Okta validator fix

* fix saml certificate formatting and select widgets

* remove client type from ui for ldap and saml

* Okta validation rectified

* Google validator improved

* update select component

* fix error messages

* added unit test

* Azure validator rectified

* Validation issues solved for auth0

* add oidc prefix for oidc client fields

* fix type issues

* style fixes for scim token card

* Update cognito validator

* refactor file names

* added e2e tests

* minor fixes

* added content for docs in md files

* implement  new design

* form style updates

* fix doc styles and provider selection styles

* fix provider selection style

* update local file

* group client fields together

* added provider name

* overview tab changes

* update form styles for configure tab

* update toggle styles

* update breadcrumb texts and provider name in text

* minor fix in localization

* minor fix for basic provider

* update breadcrumb styles and minor local file update

* minor fixes

* minor fix for local file

* fix styles for configured form

* minor fixes in styles

* fix redirect issue of my-data for non oidc sso

* fix build issue and refactor code

* update saml and ldap icons

* minor updates in icon

* typo fix

* breadcrumb and style fixes

* fix test

* update patch call

* minor fixes for access token card and code refactor

* refactor code to remove unused files

* added ldap and custom oidc doc content

* fix overview tab issue for scim and enable sso

* Patch issue fixed for authentication Configuration

* Implement unified authentication endpoints across all providers

* Memory leak issue solved

* Mcp md file

* apply spotless

* Added complete flow test for oidc

* refactor css files

* minor style updates

* cancel form functionality

* update placeholders

* update cancel modal

* minor update for saving existing config

* fix minor css issue

* integrate unified api

* remove clientid and callbackurl for confidential client type and added  jwtPrincipalClaimsMapping

* fix breadcrumb issue

* refactor files and folder structure

* minor fix

* refactor code and add disable fields styles and cancel btn functionality for existing sso

* added localization file changes

* Patch operation issue fixed

* Update generated TypeScript types

* update patch call

* patch call update for enable self signup

* remove enable selfsignup from then form since its present in the toggle

* added enable self signup field for non existing sso form

* minor code revert for enabling fields

* Update generated TypeScript types

* Redirect uri, password encoding fixes for basic and ldap

* refactor code and encode password and added /auth/callback in redirecturl

* minor  fixes

* added group mapping

* cancel modal save btn fix and logout fix

* minor fix for save btn functionality for cancel modal

* minor update in localization file

* address pr comments for ssoconfigform and css file names

* address pr comments for sso doc panel

* address pr comments around provider selector

* fix breadcrumb

* update localization file and remove unwanted files

* address pr comments related to basic auth provider

* extracted proxy code into separate func and added dev mode check

* remove unnecessary validate call happening during patch calls

* address pr comment related to tab

* update sso icon

* minor fix

* address parseSchema related pr comment

* address pr comment related to config fields constants

* added default value for callback url

* added default value for response type and clientAuthenticationMethod

* minor fix for callback url

* minor style fix

* Changed response to json for basic and ldap login

* revert unified api changes done for basic login

* made admin principal as required

* fix playwright for llogin test failure

* fix failing unit test

* fix login e2e test

* refresh call

* fix failing unit test

* fix unit test

* fix test

* remove setRefreshToken

* added default values for google

* minor style fixes

* minor text update

* Google credential validation, scope validation

* Discovery uri validation added with Auth0

* Discovery uri check added for okta

* minor style fixes

* minor checkbox fix

* minor required field fix

* minro fix

* AWS cognito validator

* google api depdendency added

* Update generated TypeScript types

* minor fixes

* minor fix for array fields cursor style issue

* Modified saml validator

* Admin principal respected while logging in

* Added tests for validators

* callback url update

* custom oidc validator

* added default values for saml

* custom oidc fix

* Saml validator issue solved

* Custom oidc publickeyurl validation

* validation for prompt

* test fix

* fix test

* TC fixed

* mvn spotless apply

* Addressed review comments

* Static method issue in Security COnfiguration manager fixed

---------

Co-authored-by: aji-aju <ajithprasad770@gmail.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: Ajith Prasad <37380177+aji-aju@users.noreply.github.com>
2025-09-23 13:23:46 +05:30
Karan Hotchandani
0f548a6829
chore(ui): introduce route position for plugin routes (#23512)
* add route position

* rename enum
2025-09-23 12:59:44 +05:30
Ushran Gouhar
15487b0a50
Issues/22729/bug fix avatar initial (#23499)
* fix(ui): fix avatar inital

* Add the fallback value

* Add support for unicode characters
2025-09-23 11:45:31 +05:30
Shailesh Parmar
69a4b599b9 feat(ui): Enhance ProfilerDetailsCard chart axes styling 2025-09-23 11:14:23 +05:30
Harshit Shah
862ea6bcbb
chore(ui): Add notification for default persona change (#23502)
* chore(ui): Add notification for default persona change

* add key in params
2025-09-23 10:01:41 +05:30
IceS2
a630ca2be6
Fixes #23330: Implement Fetch DQ Test Cases by FollowedBy (#23461)
* Implement Fetch DQ Test Cases by FollowedBy

* Update generated TypeScript types

* Fix wrong conflict resolution

* Refactored into Optional

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-09-23 01:08:49 +05:30
Shailesh Parmar
d4683a2e91 feat(ui): Update Profiler components for improved styling and functionality 2025-09-22 20:45:33 +05:30
Ashish Gupta
0d0bd5a632
fix the teams flaky playwright test (#23495) 2025-09-22 16:58:51 +05:30
Ashish Gupta
6c7b007056
fix the glossary flaky test (#23498) 2025-09-22 16:56:57 +05:30
Shailesh Parmar
3132d61efc remove commented code 2025-09-22 16:08:24 +05:30
Shailesh Parmar
bb1f19cf84 feat(ui): Refactor DataObservabilityTab and SummaryCardV1 for improved styling and layout 2025-09-22 16:07:23 +05:30
Shailesh Parmar
9c5489fcb8 Merge remote-tracking branch 'origin/main' into revamp-data-obs-tabs 2025-09-22 15:25:37 +05:30
Harshit Shah
f6b9755d41
feat(ui): Add data products widget (#23486)
* feat(ui): Add data products widget

* minor fix

* add unit tests and update assets

* add e2e tests

* fix java test

* update footer url
2025-09-22 14:38:29 +05:30
Ram Narayan Balaji
78d71723a0
Add createdBy, createdAt for dataContracts (#23427)
* Add createdBy, createdAt for dataContracts

* Update generated TypeScript types

* Preserve createdBy, createdAt, createdBy marked as string

* Set createdBy, createdAt during prepare method

* Update generated TypeScript types

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2025-09-22 10:49:05 +02:00
Shailesh Parmar
040fd21278 feat: add new SVG icons for add-item, red-circle-with-dash, success-ticket, and yellow-calendar; update SummaryCardV1 to support icon and extra props 2025-09-22 14:07:31 +05:30
Harshit Shah
d8f8d6beb4
Sort data in total data assets widget by count (#23490) 2025-09-22 13:24:31 +05:30
Shrushti Polekar
05c6974f7f
fix test (#23469) 2025-09-22 11:19:43 +05:30
Shailesh Parmar
33977571d9 feat: enhance NoProfilerBanner with improved layout and styling; add SummaryCardV1 component and update translations 2025-09-21 20:31:46 +05:30
Aniket Katkar
2ec118b4db
Fix the AUT flakiness in NotificationAlert and ServiceIngestion specs (#23489) 2025-09-21 20:08:51 +05:30
Ashish Gupta
aaa7969555
fix data contract failing flaky test (#23488) 2025-09-20 16:52:03 +05:30
Ashish Gupta
54f47854f2
Modify the team entity specific permission for create and editUser (#22821)
* modify the team entity specific permission

* cleanup around unused data

* added playwright test in support of owner as team permisison
2025-09-19 20:48:43 +05:30
Shailesh Parmar
cd982d0ddb
playwright: fixed flakiness in add test case, test suite redeployment and incident manager test (#23479) 2025-09-19 17:58:51 +05:30
Ashish Gupta
4ab5bc0723
Data contract revamp (#23358)
* revamp data contract detail view page

* supported localization key

* added the sla section

* revamp the execution history chart styling

* fix the contract header styling and contrainer width

* fix the schema table pagination

* move semantics to a separate component

* fix the icons not rendering properly and minor improvement around sla tab render and re-enabled alert status in the top

* fix unit test

* fix the playwright test and added owner in header back again

* added sla view test

* added unit test for contractQualityCard component

* fix the spacing in execution graph and minor ui fix

* fix the header divider separator from dash to dotted

* modify changes as per comments and fix playwright test

* move the bar to single

* fix the unit and playwright test
2025-09-19 15:08:20 +05:30
Ushran Gouhar
70c39246f8
chore(ui): rename confirm logout variables (#23466) 2025-09-19 12:02:51 +05:30
Shailesh Parmar
70654b4ab3 feat: add TabFilters component and integrate with DataObservabilityTab; update styles and replace no-data icon 2025-09-19 09:58:22 +05:30
Pranita Fulsundar
3176b96c13
fix tier test (#23467) 2025-09-19 08:25:33 +05:30
Ashish Gupta
b031ba732f
fix the flaky OnlineUsers spec (#23458) 2025-09-18 17:02:08 +05:30
Karan Hotchandani
2d8d36c885
chore(ui): fix flaky playwright (#23457)
* fix expand collapse test issue

* fix domain test
2025-09-18 15:41:11 +05:30
Chirag Madlani
075b4ea6d6
chore(test): fix ingestion bot tests (#23439) 2025-09-18 14:59:57 +05:30
Shailesh Parmar
f126fcf032
fix: remove logging for failed ingestion pipelines in ServiceBaseClass (#23451) 2025-09-18 13:08:42 +05:30
Shailesh Parmar
4ac528dd36 feat: add Data Observability Tab component and integrate into TableUtils 2025-09-18 10:30:14 +05:30
Karan Hotchandani
8528625ae9
fix(ui): update breadcrumbs in custom property page (#23432)
* fix: missing entries in custom properties enum

* add tests

* fix unit test warnings
2025-09-17 16:54:49 +05:30
Shailesh Parmar
7ef792db59
fix: Search Filter removal doesn't restore full test case list in edit page of test suite pipeline (#23419)
* fix: Search Filter removal doesn't restore full test case list in edit page of test suite pipeline
Fixes #23405

* fix: enhance search query to include wildcard when filters are applied
2025-09-17 16:42:43 +05:30