14226 Commits

Author SHA1 Message Date
Karan Hotchandani
2de08007b4
feat(ui): Announcements in domains and data products (#24089)
* commit progress

* commit progress

* add playwright

* minor styles adjustments
2025-10-30 19:07:29 +05:30
IceS2
3bdf994928
Feature/dimensionality column max to be between (#24051)
* Initial implementation for Dimensionality on Data Quality Tests

* Fix ColumnValuesToBeUnique and create TestCaseResult API

* Refactor dimension result

* Initial E2E Implementation without Impact Score

* Dimensionality Thin Slice

* Update generated TypeScript types

* Update generated TypeScript types

* Removed useless method to use the one we already had

* Fix Pandas Dimensionality checks

* Remove useless comments

* Implement PR comments, fix Tests

* Improve the code a bit

* Fix imports

* Implement Dimensionality for ColumnMeanToBeBetween

* Removed useless comments and improved minor things

* Implement UnitTests

* Fixes

* Moved import pandas to type checking

* Fix Min/Max being optional

* Fix Unittests

* small fixes

* Fix Unittests

* Fix Issue with counting total rows on mean

* Improve code

* Fix Merge

* Removed unused type

* Fix Tests

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-10-30 14:07:45 +01:00
Adrià Manero
854d396fe7
Fix: ExpressionValidator false positives for identifiers with security keywords (#24061) 2025-10-30 11:35:23 +01:00
Anujkumar Yadav
47840947c4
Fix: Fixed UI component warnings and erros (#23995)
* Fix: Fixed UI component warnings and erros

* nit

* Removed json file
2025-10-30 15:17:00 +05:30
Mayur Singal
72ce2ef160
MINOR: Fivetran Lineage Improvements (#23944)
* MINOR: Fivetran Lineage Improvements

* Fix db service lookup in case of multiple service names provided

* Handle api rate-limits

* Update ts files with connection field description correction

* Update generated TypeScript types

---------

Co-authored-by: Mohit Tilala <tilalamohit123@gmail.com>
Co-authored-by: Mohit Tilala <63147650+mohittilala@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-10-30 13:35:14 +05:30
Chirag Madlani
ef1459aaf0
Fix customize test aut & update nightly workflows (#24077)
* fix(test): separate count for OSS & AUTs

* update report to json

* fix tests
2025-10-30 13:33:06 +05:30
Chirag Madlani
0127ad6db1
fix(ci): support playwright trace for nightly workflow (#24088)
* fix(ci): support playwright trace for nightly workflow

* update compression level
2025-10-30 13:20:58 +05:30
Teddy
8cd23b2490
#20463 - Retention for test case results and profile data (#23988)
* fix: migration

* fix: playwright test DBT -> dbt

* feat: added rentention for profile and dq data

* feat: fix failing tests

* feat: address error in postgres delete sql

* feat: fixed missing parameter in psql query

* fix: added the deletion step in test case

* feat: fixed postgres query for deletion before cutoffs
2025-10-30 08:43:49 +01:00
Harshit Shah
5d92be620a
feat(ui): Add table2.keyColumns parameter for table diff validation (#23792)
* feat(ui): Add table2.keyColumns parameter for table diff validation

* address comments

* support key2 columns for edit test case

* fix failing test
2025-10-30 12:26:01 +05:30
Shailesh Parmar
ade97a81b4
playwright: fixed encoding issue in test, while adding result in testCase (#24087) 2025-10-30 12:15:16 +05:30
Aniket Katkar
68fb6f63ea
Update the rjsf to fix the issue with service form (#24065) 2025-10-30 09:59:31 +05:30
Bhanu Agrawal
c78acbe772
Fix slow or timeout query issue for search (#24082) 2025-10-29 19:50:39 -07:00
Sriharsha Chintalapani
9dea4716e3
Fix lock contention while looking appName, remove appName lookups (#24081) 2025-10-29 15:33:59 -07:00
Mohit Yadav
e470ebd9bc
Move migrations to 1.11.x (#24074) 2025-10-30 01:02:45 +05:30
Mohit Yadav
d77aaabd89
Fix Pytest Failures (#24063)
* Fix Pytest Failures

* Checkstyle failures fix
2025-10-29 17:46:40 +01:00
Chirag Madlani
c2896d896e
feat(ui): pipeline view support for node or edge (#23893)
* feat(ui): pipeline view support for node or edge

* support edge / node view from UI

* update condition

* fix conditions

* update doc and translation

* add tests

* revert lineage spec changes

* Update generated TypeScript types

* Downstream Iteration Fix

* Fix OpenSearch Failures

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
2025-10-29 17:44:38 +05:30
Chirag Madlani
288f5d0ce7
chore(ci): increase machine for nightly playwright (#24070) 2025-10-29 17:37:27 +05:30
Ram Narayan Balaji
c9c5c4754c
Migrations for entity_extension table for dataContract and glossaryTerm entityStatus (#24066) 2025-10-29 17:28:07 +05:30
Keshav Mohta
abe7ddbc13
fix: added database filter during test connection in snowflake (#24000) 2025-10-29 17:13:00 +05:30
Ayush Shah
608d43c16b
fix: handle empty buckets in GCS connection tests (#24048) 2025-10-29 16:45:54 +05:30
Mohit Yadav
c03cc3658a
Fix Migration for 1.10.0 (#24064)
* Fix Migration for 1.10.x

* Fix DROP INDEX for 1.10.0 in Mysql
2025-10-29 16:34:49 +05:30
harshsoni2024
9f5f8d5c13
MINOR: pbi source url fix (#24058) 2025-10-29 16:33:05 +05:30
Keshav Mohta
34adc96fea
fix: added unstructuredFormats in MetadataEntry objects creation (#24023) 2025-10-29 11:09:18 +01:00
Ajith Prasad
a481b33264
Proper error message when bearer token is empty (#23903)
* Proper error message when bearer token is empty

* Refactored the method

---------

Co-authored-by: sonika-shah <58761340+sonika-shah@users.noreply.github.com>
2025-10-29 15:09:28 +05:30
Shailesh Parmar
3760a2d612
Revert "Migrated aggregation methods (#23947)" (#24057)
This reverts commit e52e7ba68837b486c5730faedc6a5aea2f499e13.
2025-10-29 10:10:51 +01:00
sonika-shah
104a2f8204
Fix: Add explicit fqnHash and lineage related mappings with ignore_above 512 to prevent truncation in Elasticsearch indices (#24024)
* Fix: Add explicit fqnHash and lineage related mappings with ignore_above 512 to prevent truncation in Elasticsearch indices

* increase limit for other lineage field mapping

* add missing upstreamLineage in jp, ru,zh index
2025-10-29 14:24:40 +05:30
Ajith Prasad
c610192f18
SSO bugs around ldap, botPrincipals fixed (#24041) 2025-10-29 13:39:20 +05:30
Harshit Shah
53b56903b9
Fix(ui): Activity feed header navigation and all widget's title width (#24002)
* Fix(ui): Widget header navigation and title width

* fix failing test

* fix sonar issue and widget header height
2025-10-29 13:16:06 +05:30
Bhanu Agrawal
e52e7ba688
Migrated aggregation methods (#23947)
* Setup new client for ES/OS

* Migrated createIndex and addIndexAlias methods

* Migrated createAliases method to new ES/OS client

* Migrated updateIndex and deleteIndex methods

* Updated indexExists methods

* refactor: extract index management operations into dedicated manager classes

* Add tests for ElasticSearch and OpenSearch index managers

* chore: fix code style issues"

* Added integeration tests for ES/OS index manager

* Fix log level

* Fixed priority key mapping for test_case_result_index

* fix test to use field name in the query as domains.id not domain.id

* Migrated createEntity and createEntities method

* Fixed failing tests

* Set headers so 8.x client can work with 7.17x or higher server for ES

* Added OpenSearch compatible stemmer configuration

* Fix java code style

* Fixed java checkstyle issue

* Added support for 7.17.x backward compatibility

* Fixed failing tests

* Migrated createTimeSeriesEntity and deleteEntity methods

* Refactor search client architecture with entity management abstraction

* Updated log level to ERROR form WARN

* deleteEntity method impl removed from ES client

* migrated deleteEntityByFields method to new es/os client

* migrated deleteEntityByFQNPrefix method to use new ES/OS client

* deleteEntityByFQNPrefix method removed

* Migrated deleteByScript method to new ES/OS client

* Removed deleteByScript method from SearchClient

* Migrated softDeleteOrRestoreEntity method to new ES/OS client

* Reverted BulkResponse static import

* Migrated softDeleteOrRestoreChildren method to new ES/OS client

* Migrated updateEntity method to new ES/OS client

* Migrated updateChildren method to new ES/OS client

* Removed unused methods

* Migrated getDocByID method to new ES/OS client

* Added info logging

* Fixed parsing issue while passing string doc

* Migrated updateEntityRelationship method to new ES/OS client

* Migrated reindexWithEntityIds method to new ES/OS client

* Added log to show error message for updateEntityRelationship

* Refactored entity manager methods

* Added async client, fixed null obj parsing issue

* Refactoring

* Refactored duplicate methods createEntity and createTimeSeriesEntity

* Added integration tests for ES/OS entity managers

* Updated client availability checks in both index manager classes to use the consistent !isClientAvailable pattern

* Removed comment

* chore: Fix line formatting in Playwright test files

- Adjusted line length in Domains.spec.ts for better readability
- Fixed indentation and formatting in Lineage.spec.ts
- Added missing newline at end of files

* Added new line

* Migrated other index related methods and add tests

* MIgrated updateByFqnPrefix and updateLineage and deleteByRangeQuery methods

* migrated deleteByRangeAndTerm method

* Added integration tests

* Migrated updateColumnsInUpstreamLineage and deleteColumnsInUpstreamLineage methods

* Migrated updateGlossaryTermByFqnPrefix method

* Removed unused method and updated error handling

* Migrated reindexEntities method to new ES/OS client

* Added integration tests for reindexEntities method

* Added interface and impl for generic methods migration

* added default impl

* Migrated deleteDataStream method

* Migrated deleteILMPolicy method

* Migrated deleteIndexTemplate method

* Migrated deleteComponentTemplate emthod

* migrated dettachIlmPolicyFromIndexes method

* migrated removeILMFromComponentTemplate method

* Migrated cluster metric methods

* Removed from ESClient/OSClient to GenericManager

* Migrated getSearchHealthStatus

* Add integration tests

* Migrated buildDIChart and fetchDIChartFields methods

* Migrated listDataInsightChartResult emthod

* Migrated getQueryCostRecords

* Migrated getSchemaEntityRelationship

* Added data insight aggregator tests

* Fixed failing tests

* Migrated aggregate method

* Migrated genericAggregation and aggregate methods

* Fixed failing data insight query

* Updated ref for OS aggregation manager

* Fixed issues with aggregations migration

* Fixed tests
2025-10-28 23:51:00 +05:30
Mohit Yadav
27b5935744
Increase Socket and Connect timeout to 30 secs (#24055) 2025-10-28 23:42:26 +05:30
Shailesh Parmar
17f4820d71
Fix: Update test case naming and improve tooltip formatting in Data Quality components (#24028)
* Fix: Update test case naming and improve tooltip formatting in Data Quality components

* Add localized labels for 'Failed/Aborted Reason' in multiple languages

* fixed failing test
2025-10-28 20:38:42 +05:30
Sriharsha Chintalapani
45efc76ea1
Fix: Search Slowness when painless scripts aggregates for terms and classifications (#24038)
* Fix: Search Slowness when painless scripts aggregates for terms and classifications

* Fix Sql

* Add fields to security service index

---------

Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
2025-10-28 07:18:32 -07:00
Rohit Jain
b94d3be456
Fix: Fixed incorrect re-direction link in mention tab (#24025)
* Fix: Fixed incorrect re-direction link in mention tab

* Fix: minor fix
2025-10-28 19:17:03 +05:30
Pere Miquel Brull
a34f50a6d0
MINOR - Add certification prompts for NLS (#23976)
* MINOR - Add certification prompts for NLS

* add more examples
2025-10-28 14:36:45 +01:00
Ram Narayan Balaji
2712e24f72
Feat# Asset Specific Restrictions based on EntityStatus (#23666)
* Search Query for Tags to restrict tags other than Approved or Unprocessed

* Restrict tag search query in the UI to not show tags other than Approved/UnProcessed

* Fxi Search Queries for Tag Search and use protected for tests

* add activity feed

* Refactored the error message of validation, refactored code

* use generic widgets in data product details

* Update generated TypeScript types

* commit progress

* add activity feed to domains

* commit progress

* add status badge

* commit progress

* Add customizable layout for tag class base

* nit

* Fix data product reviewer fetch

* Add reviewer field in tag page

* Add knowledge center task route for notification

* fix knowledge center page enum

* nit

* Fix tag page unit test

* fix test

* fix expert field visiable issue

* fix expert field

* Fix tag and add domain entity test

* nit

* fix test is for domain add

* fix tags owner test id

* fix tag disabled permission issue

* Add Conversation feature for Data Products

* Update generated TypeScript types

* Merge branch 'main' into entity-specific-restrictions

* nit

* fix glossary integration test

---------

Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Anujkumar Yadav <anujf0510@gmail.com>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2025-10-28 18:54:39 +05:30
Ashish Gupta
a98ce177fc
fix the contract description renderer where content was breaking (#24047) 2025-10-28 18:21:42 +05:30
Ashish Gupta
c903f3b485
#23987: fix contract old schema column not visible on schema form while edit (#24027)
* fix contract old schema column not visible on schem form while edit

* fix the unit test failing

* show column status, represent which column is being failed and passed

* fix the dropdown scrolling with screen and fix sonar issue as well
2025-10-28 17:07:33 +05:30
Chirag Madlani
3fb800cabc
fix(ui): tab name didn't render on persona page (#24018)
* fix(ui): tab name didn't render on persona page

* update getTabLabelFromId to have a override

* fix table failure

* fix error and code smells
2025-10-28 16:55:53 +05:30
dependabot[bot]
5e0e7d4465
Chore(deps): Bump validator (#24039)
Bumps [validator](https://github.com/validatorjs/validator.js) from 13.15.15 to 13.15.20.
- [Release notes](https://github.com/validatorjs/validator.js/releases)
- [Changelog](https://github.com/validatorjs/validator.js/blob/master/CHANGELOG.md)
- [Commits](https://github.com/validatorjs/validator.js/compare/13.15.15...13.15.20)

---
updated-dependencies:
- dependency-name: validator
  dependency-version: 13.15.20
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-10-28 15:53:28 +05:30
dependabot[bot]
44e208f256
chore(deps-dev): bump vite (#23965)
Bumps [vite](https://github.com/vitejs/vite/tree/HEAD/packages/vite) from 7.1.9 to 7.1.11.
- [Release notes](https://github.com/vitejs/vite/releases)
- [Changelog](https://github.com/vitejs/vite/blob/main/packages/vite/CHANGELOG.md)
- [Commits](https://github.com/vitejs/vite/commits/v7.1.11/packages/vite)

---
updated-dependencies:
- dependency-name: vite
  dependency-version: 7.1.11
  dependency-type: direct:development
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2025-10-28 15:07:46 +05:30
Ashish Gupta
2fc4938484
PLAYWRIGHT: fix the auto-pilot failure (#24017) 2025-10-28 10:49:16 +05:30
Harsh Vador
881b7ced12
fix: search props type issue (#24011)
* fix: search props type issue

* fix code smell
2025-10-28 10:14:47 +05:30
Pere Miquel Brull
b3a590fe22
MINOR - Remove flyway (#23179)
* test

* test

* format

* pom

* pom

* format

* Handle migration

* Handle migration

* Handle migration

* fix merge

* bump main

* bump main

* undo unnecessary changes

* simplify checksum for migration

* format

* FIX
2025-10-28 09:11:03 +05:30
Sriharsha Chintalapani
a846d3ad84
Improve Performance, Add Redis as optional cache (#23054)
* MINOR - cache settings YAML

* MINOR - cache settings YAML

* Remove Redis; batch fetch all realtions in one query

* Update generated TypeScript types

* Add advanced configs

* Fix tests

* Fix tests

* release 1.9.5

* fix include

* Fix Indexing strategy, add HikariCP configs

* add HikariCP configs to test config

* Add AWS Aurora related configs

* remove vacuum and relax defaults

* fix includes

* Use index

* Add Latency breakdowns on server side

* Update generated TypeScript types

* Add Latency breakdowns on server side

* Propagate fields properly

* Add Async Search calls

* Add Jetty Metrics

* disable gzip

* AWS JDBC Driver

* add pctile

* Add method to endpoint pctile

* handle patch properly in metrics

* tests

* update metrics

* bump flyway

* fix jetty metric handler

* default to postgres

* default to postgres

* ConnectionType with amazon

* Update connection

* Update connection

* Add Redis Cache support for all entities, CacheWarmupApp

* Fix aurora driver settings

* Fix aurora driver settings

* Fix aurora driver settings

* Fix aurora driver settings

* revert config

* Handle ReadOnly

* update config

* Revert "update config"

This reverts commit 9f5751c356de474b8b79797cbbd9d7650a1bb349.

* Revert "Handle ReadOnly"

This reverts commit e0c906365109ae014e253cdba9e31df935208abb.

* Revert "revert config"

This reverts commit e79c3d2d84051320d4864ddf9638dcc6cdef1980.

* Revert "Fix aurora driver settings"

This reverts commit 463e6ebf4b4e8209a7dbb3bf7818544fa68dca5f.

* Revert "Fix aurora driver settings"

This reverts commit 515d22b0e0d3b979cb2af7b87a977b6d4290e38f.

* Revert "Fix aurora driver settings"

This reverts commit 0a1226e9e1e5fc6e42499560373e26004b410e5e.

* Revert "Fix aurora driver settings"

This reverts commit d959976b1cadaace1a09da0ca3d78df490c5a689.

* Add Redis Cache support for all entities, CacheWarmupApp

* Update generated TypeScript types

* Redis SSL

* redis auth

* Fix cache warmup and lookup if cahce fails

* Fix cache of relations

* try search cache

* fix search cache

* fix cache response

* Revert "fix cache response"

This reverts commit 14602dc8c59c5ee6b9b21e20f6d1e3a01ea865a0.

* Revert "fix search cache"

This reverts commit 8eaa76bd7ef9d635e6a5b6d3cba4262057f9d4cd.

* Revert "try search cache"

This reverts commit 0582a1dc03a4353efb3d635957fd4df5dd626f00.

* clean commits

* clean drops

* clean

* clean

* clean

* remove hosts array for ES

* Update generated TypeScript types

* remove hosts array for ES

* format

* remove hosts array for ES

* Remove Embeddings for Table Index

* metrics improvements

* MINOR - Report status for tests that blow up

* Revert "MINOR - Report status for tests that blow up"

This reverts commit e831ac04e6e79aa04e6ccff259d1c5fc852c6ba3.

* Fix tests

* Address comments

* remove unused code

* fix postgres schema migration

* fix tests and improve caching startegy

* fix tests, making search sync

* Update generated TypeScript types

* Fix Failures due to merge conflicts

* Fix Tag Failures

* Fix Retryable Exception

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
2025-10-28 06:29:31 +05:30
IceS2
5a7d7158a5
Feature/dimensionality column mean to be between (#23984)
* Initial implementation for Dimensionality on Data Quality Tests

* Fix ColumnValuesToBeUnique and create TestCaseResult API

* Refactor dimension result

* Initial E2E Implementation without Impact Score

* Dimensionality Thin Slice

* Update generated TypeScript types

* Update generated TypeScript types

* Removed useless method to use the one we already had

* Fix Pandas Dimensionality checks

* Remove useless comments

* Implement PR comments, fix Tests

* Improve the code a bit

* Fix imports

* Implement Dimensionality for ColumnMeanToBeBetween

* Removed useless comments and improved minor things

* Implement UnitTests

* Fixes

* Moved import pandas to type checking

* Fix Min/Max being optional

* Fix Unittests

* small fixes

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-10-27 18:05:51 +01:00
harshsoni2024
4ec5059a32
Fix: looker local repo config (#24003) 2025-10-27 20:21:11 +05:30
Dhruv Parmar
cbe28bfa1b
feat (UI): Added Pagination for Child Glossary Term (#24010)
* added pagination for child term

* updated colors for child term
2025-10-27 20:18:42 +05:30
Adrià Manero
2f0e83b46d
Improvement: Enhanced notification templates with rich formatting and extended Handlebars helpers (#23989)
* Apply improvements on notification templates

* Implement Handlebars Helpers for notification templates

* Move handlebars implementation to notifications package

* Fix NotificationTemplateResourceTest

---------

Co-authored-by: Teddy <teddy.crepineau@gmail.com>
2025-10-27 13:28:46 +01:00
Keshav Mohta
ba5f8e5bf6
fix: add field label as displayName for table and columns (#23993) 2025-10-27 17:08:02 +05:30
Aniket Katkar
be8d9c6a4b
Fix the flakiness in users.spec.ts (#23956) 2025-10-27 16:35:59 +05:30