5 Commits

Author SHA1 Message Date
Eugenio
cb5065cf9f
Clean up recognizers migration data (#24001)
* Remove data placed in the wrong directory

* Update `MigrationUtil` to use data from `piiTagsWithRecognizers`

That way we can also remove duplicate json and have a single source of data

* Update migration queries to use prepared statements

* Minor fix in the `piiTagsWithRecognizers` definitions
2025-10-24 14:55:44 +00:00
IceS2
633152124a
Fixes #23397: Thin Slice for Dimensionality on Data Quality (#23529)
* Initial implementation for Dimensionality on Data Quality Tests

* Fix ColumnValuesToBeUnique and create TestCaseResult API

* Refactor dimension result

* Initial E2E Implementation without Impact Score

* Dimensionality Thin Slice

* Update generated TypeScript types

* Update generated TypeScript types

* Removed useless method to use the one we already had

* Fix Pandas Dimensionality checks

* Remove useless comments

* Implement PR comments, fix Tests

* Improve the code a bit

* Fix imports

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-10-22 15:40:20 +02:00
Sriharsha Chintalapani
34ef13f083
Add Impersonation By Bots (#23712)
* Add Impersonation By Bots

* Update generated TypeScript types

* Fix migrations

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-10-16 19:14:29 -07:00
Eugenio
af0672e4cf
Fixes #22302: add table2.keyColumns parameter for table diff validation (#23667)
* Update `TableDiffParamsSetter` to move data at table level

This means that `key_columns` and `extra_columns` will be defined per table instead of "globally", just like `data_diff` expects

* Update `TableDiffValidator` to use table's `key_columns`

Call `data_diff` and run validations using each table's `key_columns`

* Create migration to update `tableDiff` test definition

* Fix Playwright test
2025-10-08 09:32:00 +02:00
Eugenio
a6ac42371d
Ensure recognizers are created (#23645)
* Add the migration classes and data for recognizers

This is so that we can run a migration that sets `json->recognizers` of `PII.Sensitive` and `PII.NonSensitive` tags from json values.

The issue with normal migrations was that the value of recognizers was too long to be persisted in the server migrations log.

Created a common `migration.utils.v1110.MigrationProcessBase`

* Ensure building automatically with the right parameters

* Update typescript types
2025-10-07 15:13:35 +00:00