14318 Commits

Author SHA1 Message Date
Eugenio
ef8b19142f
Create documentation resources for Data Quality as Code (closes #23800) (#24169)
* Brief documentation of installation requirements

* Minor fix to run tests only defined in OpenMetadata

* Add full example to Data Quality as Code

* Install `griffe2md` and fix docstrings

* Remove local openmetadata reference

* Fix writing, grammar and typos

* Fix test

* Fix formatting
2025-11-11 10:25:42 +00:00
Chirag Madlani
56656d68cd
chore(ui): bump Vite package to resolve vulnerabilities (#24273) 2025-11-11 14:41:04 +05:30
Aniket Katkar
1906a2a2f7
refactor: remove duplicate directory custom property from GlobalSettingsClassBase (#24265) 2025-11-11 13:51:40 +05:30
Mohit Tilala
79f04bda65
Fix workflow python version picking with quotes (#24263) 2025-11-11 13:24:22 +05:30
Adrià Manero
3e5facdb71
Add testCase description to TestCase notifications (#24252) 2025-11-11 08:39:44 +01:00
Ram Narayan Balaji
5bcf792aa4
Fix: #24100 Implementation for Change Events for Workflow Generated Changes and Manual Task Resolutions (#24108)
* Initial Implementation for Change Events for Workflow Generated Changes and Manual Task Resolutions

* Test case

* Add impersonatedBy to changeEvent schema, changeEvent generations, workflow consumer filtering, always override impersonatedBy even if not null

* Update generated TypeScript types

* Improved debug logging in WorkflowEventConsumer and tests

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-11-11 10:28:39 +05:30
Chirag Madlani
8514b967e4
chore(ui): remove checker from vite dev mode due to memory issues (#24247) 2025-11-11 10:25:48 +05:30
Mohit Yadav
301d97be9e
[Fix-24250] issue with big param list in findByIds and Names (#24259)
* Fix issue with big param list in findByIds and Names

* Remove table queries from set fields
2025-11-11 10:19:08 +05:30
IceS2
bbd0ce1334
Implement API to retrieve all dimensional test results for a dimensional column (#24255) 2025-11-11 00:09:28 +01:00
Adrià Manero
9ad6783a99
Enable notification template preview and test send (#24229)
* Add NotificationTemplate sending and rendering endpoints with mock data

* Setup entity fixtures for mock notifications

* Update generated TypeScript types

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-11-10 17:06:26 +01:00
Anujkumar Yadav
679ad3daf8
Fix: Filter out dataProduct and domain from knowledge center data asset selection (#24214) 2025-11-10 21:06:28 +05:30
IceS2
1492539234
Feature/dimensionality column values to be at expected location (#24239)
* Initial implementation for Dimensionality on Data Quality Tests

* Fix ColumnValuesToBeUnique and create TestCaseResult API

* Refactor dimension result

* Initial E2E Implementation without Impact Score

* Dimensionality Thin Slice

* Update generated TypeScript types

* Update generated TypeScript types

* Removed useless method to use the one we already had

* Fix Pandas Dimensionality checks

* Remove useless comments

* Implement PR comments, fix Tests

* Improve the code a bit

* Fix imports

* Implement Dimensionality for ColumnMeanToBeBetween

* Removed useless comments and improved minor things

* Implement UnitTests

* Fixes

* Moved import pandas to type checking

* Fix Min/Max being optional

* Fix Unittests

* small fixes

* Fix Unittests

* Fix Issue with counting total rows on mean

* Improve code

* Fix Merge

* Removed unused type

* Refactor to reduce code repetition and complexity

* Fix conflict

* Rename method

* Refactor some metrics

* Implement Dimensionality to ColumnLengthToBeBetween

* Implement Dimensionality for ColumnMedianToBeBetween in Pandas

* Implement Median Dimensionality for SQL

* Add database tests

* Fix median metric

* Implement Dimensionality SumToBeBetween

* Implement dimensionality for Column Values not In Set

* Implement Dimensionality for ColumnValuestoMatchRegex and ColumnValuesToNotMatchRegex

* Implement NotNull and MissingCount dimensionality

* Implement columnValuesToBeBetween dimensionality

* Fix test

* Implement Pandas Dimensionality for ColumnValueStdDevToBeBetween

* Implement Dimensionality for ColumnValuesStdDevToBeBetween

* Implement dimensionality for column values to be at expected location

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-11-10 15:00:06 +01:00
Keshav Mohta
011e61de69
dep: setuptools version to 78.1.1 (#24206) 2025-11-10 18:43:05 +05:30
Chirag Madlani
f66c2e6eb0
Feat(ui): support contract tab for other entities (#23079)
* Feat(ui): support contract tab for other entities

* fix the tab being showed in entities along with the next and previous button with the functionality

* modify the contract badge status to all entities in data asset header

* supported topic,dashboardDataModel,ApiEndpoint in schema tab with the json changes

* Update generated TypeScript types

* fix the contract.ts file being deleted

* re-push the missing data in dataContract.json

* supported the contract tab in persona changes and also supported for Chart Entity

* fix the unit test and type error in schema for contract tab

* added playwright test for dataContract for other entities

* fix the sonar test

* added databas and schema contract test along with the previous failure

* added Database and DatabaseSchema contract test and fix other test issue due to merge conflict

* commeted out the tab support for charts now, since BE is still pending on it

* code polish, render schema table on condition with test and schema form default expand all keys

* Update generated TypeScript types

* fix the button props naming

* fix the buttons labels

* modify the playwright and include support for all entities checking

* fix the schema fields for other entities

* added support for fiel, directory, spreadsheet and worksheet and fix some playwright cases

* fix unit and playwright test

* fix some sonar issue

* fix some code smell and minor improvement

* fix unit test

* remove unwanted file

---------

Co-authored-by: Ashish Gupta <ashish@getcollate.io>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-11-10 18:15:12 +05:30
IceS2
dddec06143
Feature/dimensionality column values stddev to be between (#24235)
* Initial implementation for Dimensionality on Data Quality Tests

* Fix ColumnValuesToBeUnique and create TestCaseResult API

* Refactor dimension result

* Initial E2E Implementation without Impact Score

* Dimensionality Thin Slice

* Update generated TypeScript types

* Update generated TypeScript types

* Removed useless method to use the one we already had

* Fix Pandas Dimensionality checks

* Remove useless comments

* Implement PR comments, fix Tests

* Improve the code a bit

* Fix imports

* Implement Dimensionality for ColumnMeanToBeBetween

* Removed useless comments and improved minor things

* Implement UnitTests

* Fixes

* Moved import pandas to type checking

* Fix Min/Max being optional

* Fix Unittests

* small fixes

* Fix Unittests

* Fix Issue with counting total rows on mean

* Improve code

* Fix Merge

* Removed unused type

* Refactor to reduce code repetition and complexity

* Fix conflict

* Rename method

* Refactor some metrics

* Implement Dimensionality to ColumnLengthToBeBetween

* Implement Dimensionality for ColumnMedianToBeBetween in Pandas

* Implement Median Dimensionality for SQL

* Add database tests

* Fix median metric

* Implement Dimensionality SumToBeBetween

* Implement dimensionality for Column Values not In Set

* Implement Dimensionality for ColumnValuestoMatchRegex and ColumnValuesToNotMatchRegex

* Implement NotNull and MissingCount dimensionality

* Implement columnValuesToBeBetween dimensionality

* Fix test

* Implement Pandas Dimensionality for ColumnValueStdDevToBeBetween

* Implement Dimensionality for ColumnValuesStdDevToBeBetween

* Fixed tests due to sqlite now supporting stddev

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-11-10 12:13:27 +01:00
Adrià Manero
c56edc3df1
Create ChangeEvents for SSO user operations to enable EventSubscription notifications (#24209) 2025-11-10 11:22:04 +01:00
Eugenio
c885a29a8c
Fix Snowflake and BigQuery CLI e2e tests (#24217)
* Create function to normalize PEM strings

* Normalize PEM strings where needed

Also fix a docstring

* Use ingestion bot when running tests
2025-11-10 10:16:20 +01:00
IceS2
ca5945c5be
Feature/dimensionality column values to be between (#24215)
* Initial implementation for Dimensionality on Data Quality Tests

* Fix ColumnValuesToBeUnique and create TestCaseResult API

* Refactor dimension result

* Initial E2E Implementation without Impact Score

* Dimensionality Thin Slice

* Update generated TypeScript types

* Update generated TypeScript types

* Removed useless method to use the one we already had

* Fix Pandas Dimensionality checks

* Remove useless comments

* Implement PR comments, fix Tests

* Improve the code a bit

* Fix imports

* Implement Dimensionality for ColumnMeanToBeBetween

* Removed useless comments and improved minor things

* Implement UnitTests

* Fixes

* Moved import pandas to type checking

* Fix Min/Max being optional

* Fix Unittests

* small fixes

* Fix Unittests

* Fix Issue with counting total rows on mean

* Improve code

* Fix Merge

* Removed unused type

* Refactor to reduce code repetition and complexity

* Fix conflict

* Rename method

* Refactor some metrics

* Implement Dimensionality to ColumnLengthToBeBetween

* Implement Dimensionality for ColumnMedianToBeBetween in Pandas

* Implement Median Dimensionality for SQL

* Add database tests

* Fix median metric

* Implement Dimensionality SumToBeBetween

* Implement dimensionality for Column Values not In Set

* Implement Dimensionality for ColumnValuestoMatchRegex and ColumnValuesToNotMatchRegex

* Implement NotNull and MissingCount dimensionality

* Implement columnValuesToBeBetween dimensionality

* Fix test

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-11-10 08:03:07 +01:00
Chirag Madlani
727560e88f
fix(test): playwright to create data once instead on each tests (#23756)
* fix(test): playwright to create data once instead on each tests

* fix issue with name conflicts on classes

* sync setup data

* fix customize details page

* fix persistence data issue

* fix test failures

* avoid deleting file

* fix tests

* fix tests with class conflicts

* fix version tests

* fix failing tests

* fix my task failure

* fix failing tests

* fix tests

* revert user list component changes
2025-11-08 12:32:35 +05:30
Ajith Prasad
65f42109e5
Initialize JWT token generator before websocket setup (#24230)
* Initialize JWT token generator before websocket setup

* Added tests for secure socket

* Checkstyle corrected
2025-11-07 20:43:14 -08:00
sonika-shah
c8b759609e
Fix fetchAndSetService for database (#24232)
* Fix fetchAndSetService for service

* add test

* add test
2025-11-08 09:44:01 +05:30
Teddy
f3ef29a117
fix: improve query and minimize snflk <-> OM backand and forth (#24228) 2025-11-07 14:54:37 +01:00
IceS2
4e398d003b
Feature/dimensionality column values to be not null (#24211)
* Initial implementation for Dimensionality on Data Quality Tests

* Fix ColumnValuesToBeUnique and create TestCaseResult API

* Refactor dimension result

* Initial E2E Implementation without Impact Score

* Dimensionality Thin Slice

* Update generated TypeScript types

* Update generated TypeScript types

* Removed useless method to use the one we already had

* Fix Pandas Dimensionality checks

* Remove useless comments

* Implement PR comments, fix Tests

* Improve the code a bit

* Fix imports

* Implement Dimensionality for ColumnMeanToBeBetween

* Removed useless comments and improved minor things

* Implement UnitTests

* Fixes

* Moved import pandas to type checking

* Fix Min/Max being optional

* Fix Unittests

* small fixes

* Fix Unittests

* Fix Issue with counting total rows on mean

* Improve code

* Fix Merge

* Removed unused type

* Refactor to reduce code repetition and complexity

* Fix conflict

* Rename method

* Refactor some metrics

* Implement Dimensionality to ColumnLengthToBeBetween

* Implement Dimensionality for ColumnMedianToBeBetween in Pandas

* Implement Median Dimensionality for SQL

* Add database tests

* Fix median metric

* Implement Dimensionality SumToBeBetween

* Implement dimensionality for Column Values not In Set

* Implement Dimensionality for ColumnValuestoMatchRegex and ColumnValuesToNotMatchRegex

* Implement NotNull and MissingCount dimensionality

* Fix test

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-11-07 14:44:58 +01:00
Ashish Gupta
14e6b7ccc4
fix some flaky playwright test (#24224) 2025-11-07 18:42:43 +05:30
Pere Miquel Brull
2058b45001
FIX - Logs Ingestion Pipeline tests (#24225) 2025-11-07 13:41:27 +01:00
Mohit Tilala
9f6c07cb1c
Upgrade github workflows to use python 3.10 (#24203) 2025-11-07 16:43:04 +05:30
Adrià Manero
15dcfe7e39
Add bidirectional EventSubscription-NotificationTemplate relationship (#24204)
* Add bidirectional EventSubscription-NotificationTemplate relationship

* Update generated TypeScript types

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-11-07 12:08:36 +01:00
Harshit Shah
c8a7ded8b8
fix(test): Should display persona dropdown with pagination (#24221)
* fix(test): Should display persona dropdown with pagination

* minor fix
2025-11-07 15:18:13 +05:30
Sriharsha Chintalapani
cf1a742f24
Enable S3AsyncClient with multi-part upload (#24198)
* Enable S3AsyncClient with multi-part upload

* Enable S3AsyncClient with multi-part upload

* fix

* Update source for debian 11 to 12 (#24219) (#24220)

* Update source for dabian 11 to 12

* tests

* fix

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: miriann-uu <mirian.ugokwe@getcollate.io>
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2025-11-07 10:11:09 +01:00
Ashish Gupta
2bbeace734
PLAYWRIGHT: fix the tag playwright test (#24222)
* fix the tag playwright test

* minor changes
2025-11-07 12:49:44 +05:30
Harsh Vador
a9edab2ece
fix(test): right panel data consumer playwright (#24199)
* (fix)ui: right panel data consumer playwright

* improve panel flow playwright

* fix playwright issue

* fix data consumer owner spec
2025-11-07 11:15:09 +05:30
Harsh Vador
ba09b9c46e
fix(ui): console warnings (#24182)
* fix(ui): console warnings

* fix test warnings

* fix ts

* fix code smells

* fix code smells
2025-11-07 11:08:41 +05:30
Teddy
5923aa2b4e
chore: update french translation (#24210) 2025-11-07 03:49:26 +00:00
Aniket Katkar
df2d5c3492
Fix issue with logs page infinite scroll (#24216)
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2025-11-07 06:22:49 +05:30
miriann-uu
2ad14e40cf
Update source for debian 11 to 12 (#24219)
* Update source for dabian 11 to 12
2025-11-06 18:31:00 -05:00
Pere Miquel Brull
ff9444e233
MINOR - Improving stream log handling (#24207)
* improvements

* improvements

* improvements

* improvements

* logging queue improvs

* improvements

* improvements

* improvements

* format

* improvements

* improvements

* improvements
2025-11-06 18:08:10 +01:00
IceS2
e7eb1f7641
Feature/dimensionality column values to match regex (#24194)
* Initial implementation for Dimensionality on Data Quality Tests

* Fix ColumnValuesToBeUnique and create TestCaseResult API

* Refactor dimension result

* Initial E2E Implementation without Impact Score

* Dimensionality Thin Slice

* Update generated TypeScript types

* Update generated TypeScript types

* Removed useless method to use the one we already had

* Fix Pandas Dimensionality checks

* Remove useless comments

* Implement PR comments, fix Tests

* Improve the code a bit

* Fix imports

* Implement Dimensionality for ColumnMeanToBeBetween

* Removed useless comments and improved minor things

* Implement UnitTests

* Fixes

* Moved import pandas to type checking

* Fix Min/Max being optional

* Fix Unittests

* small fixes

* Fix Unittests

* Fix Issue with counting total rows on mean

* Improve code

* Fix Merge

* Removed unused type

* Refactor to reduce code repetition and complexity

* Fix conflict

* Rename method

* Refactor some metrics

* Implement Dimensionality to ColumnLengthToBeBetween

* Implement Dimensionality for ColumnMedianToBeBetween in Pandas

* Implement Median Dimensionality for SQL

* Add database tests

* Fix median metric

* Implement Dimensionality SumToBeBetween

* Implement dimensionality for Column Values not In Set

* Implement Dimensionality for ColumnValuestoMatchRegex and ColumnValuesToNotMatchRegex

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-11-06 16:32:31 +01:00
Ashish Gupta
36abc4a400
fix user count not displaying in Team page (#24189) 2025-11-06 20:49:12 +05:30
Adrià Manero
87b4424ab8
Add change tracking and external recipient support for Thread notifications (#24202)
* Allow notification to external email recipients for Task and Conversation threads

* Implement ChangeEvent changeDescription for thread Entities

* Update generated TypeScript types

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-11-06 16:13:50 +01:00
Shailesh Parmar
dd8b6481b1
fix: show all the category for cardinality distribution graph (#24098)
* fix: show all the category for cardinality distribution graph

* feat: enhance CardinalityDistributionChart with category selection and custom Y-axis ticks

* fix: update cursor fill color in visualisation charts for better visibility

---------

Co-authored-by: Harsh Vador <58542468+harsh-vador@users.noreply.github.com>
2025-11-06 19:53:37 +05:30
IceS2
4da984cd56
Feature/dimensionality column values to not be in set (#24192)
* Initial implementation for Dimensionality on Data Quality Tests

* Fix ColumnValuesToBeUnique and create TestCaseResult API

* Refactor dimension result

* Initial E2E Implementation without Impact Score

* Dimensionality Thin Slice

* Update generated TypeScript types

* Update generated TypeScript types

* Removed useless method to use the one we already had

* Fix Pandas Dimensionality checks

* Remove useless comments

* Implement PR comments, fix Tests

* Improve the code a bit

* Fix imports

* Implement Dimensionality for ColumnMeanToBeBetween

* Removed useless comments and improved minor things

* Implement UnitTests

* Fixes

* Moved import pandas to type checking

* Fix Min/Max being optional

* Fix Unittests

* small fixes

* Fix Unittests

* Fix Issue with counting total rows on mean

* Improve code

* Fix Merge

* Removed unused type

* Refactor to reduce code repetition and complexity

* Fix conflict

* Rename method

* Refactor some metrics

* Implement Dimensionality to ColumnLengthToBeBetween

* Implement Dimensionality for ColumnMedianToBeBetween in Pandas

* Implement Median Dimensionality for SQL

* Add database tests

* Fix median metric

* Implement Dimensionality SumToBeBetween

* Implement dimensionality for Column Values not In Set

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-11-06 12:12:14 +01:00
Mohit Tilala
fda5480918
Fix playwright pytest (#24197)
* Bump python version to 3.10 in playwright workflow

* Minor change to trigger playwright tests
2025-11-06 14:41:48 +05:30
Pere Miquel Brull
3f323860fa
Fix #19237- Support subscription via python sdk (#24112)
* add domains tests

* FIX #19237 - Support subscriptions via Python SDK

* merge

* format
2025-11-05 18:58:48 +01:00
IceS2
b54ebbd036
Feature/dimensionality column sum between (#24188)
* Initial implementation for Dimensionality on Data Quality Tests

* Fix ColumnValuesToBeUnique and create TestCaseResult API

* Refactor dimension result

* Initial E2E Implementation without Impact Score

* Dimensionality Thin Slice

* Update generated TypeScript types

* Update generated TypeScript types

* Removed useless method to use the one we already had

* Fix Pandas Dimensionality checks

* Remove useless comments

* Implement PR comments, fix Tests

* Improve the code a bit

* Fix imports

* Implement Dimensionality for ColumnMeanToBeBetween

* Removed useless comments and improved minor things

* Implement UnitTests

* Fixes

* Moved import pandas to type checking

* Fix Min/Max being optional

* Fix Unittests

* small fixes

* Fix Unittests

* Fix Issue with counting total rows on mean

* Improve code

* Fix Merge

* Removed unused type

* Refactor to reduce code repetition and complexity

* Fix conflict

* Rename method

* Refactor some metrics

* Implement Dimensionality to ColumnLengthToBeBetween

* Implement Dimensionality for ColumnMedianToBeBetween in Pandas

* Implement Median Dimensionality for SQL

* Add database tests

* Fix median metric

* Implement Dimensionality SumToBeBetween

* Update columnValueLengthsToBeBetween.py

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-11-05 16:37:42 +01:00
Adrià Manero
650197d9c7
Refactor publishers to use Notification Templates engine (#24145) 2025-11-05 15:57:55 +01:00
Adrià Manero
b3238fd654
Remove defaultTemplateChecksum field via 1.11.0 migration (#24160) 2025-11-05 15:57:31 +01:00
Ajith Prasad
6c9aafc83f
Security vulnerability fix for 1.10.5 (#24175) 2025-11-05 18:22:59 +05:30
Pere Miquel Brull
71f1da75e6
FIX #20838 - get_entity_type() does not return correct entity_type (#24110)
* FIX #20838 - get_entity_type() does not return correct entity_type

* fix test
2025-11-05 12:44:27 +01:00
IceS2
a72102071a
Feature/dimensionality column median to be between (#24166)
* Initial implementation for Dimensionality on Data Quality Tests

* Fix ColumnValuesToBeUnique and create TestCaseResult API

* Refactor dimension result

* Initial E2E Implementation without Impact Score

* Dimensionality Thin Slice

* Update generated TypeScript types

* Update generated TypeScript types

* Removed useless method to use the one we already had

* Fix Pandas Dimensionality checks

* Remove useless comments

* Implement PR comments, fix Tests

* Improve the code a bit

* Fix imports

* Implement Dimensionality for ColumnMeanToBeBetween

* Removed useless comments and improved minor things

* Implement UnitTests

* Fixes

* Moved import pandas to type checking

* Fix Min/Max being optional

* Fix Unittests

* small fixes

* Fix Unittests

* Fix Issue with counting total rows on mean

* Improve code

* Fix Merge

* Removed unused type

* Refactor to reduce code repetition and complexity

* Fix conflict

* Rename method

* Refactor some metrics

* Implement Dimensionality to ColumnLengthToBeBetween

* Implement Dimensionality for ColumnMedianToBeBetween in Pandas

* Implement Median Dimensionality for SQL

* Add database tests

* Fix median metric

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-11-05 12:42:58 +01:00
Ajith Prasad
8e41b1f475
Added FORCE_SECURE_SESSION_COOKIE flag (#24152)
* Added FORCE_SECURE_SESSION_COOKIE flag

* Update generated TypeScript types

* Added force secure session cookie to authentication Configuration

* Update generated TypeScript types

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-11-05 15:48:01 +05:30