12 Commits

Author SHA1 Message Date
Mohit Yadav
c03cc3658a
Fix Migration for 1.10.0 (#24064)
* Fix Migration for 1.10.x

* Fix DROP INDEX for 1.10.0 in Mysql
2025-10-29 16:34:49 +05:30
Sriharsha Chintalapani
a846d3ad84
Improve Performance, Add Redis as optional cache (#23054)
* MINOR - cache settings YAML

* MINOR - cache settings YAML

* Remove Redis; batch fetch all realtions in one query

* Update generated TypeScript types

* Add advanced configs

* Fix tests

* Fix tests

* release 1.9.5

* fix include

* Fix Indexing strategy, add HikariCP configs

* add HikariCP configs to test config

* Add AWS Aurora related configs

* remove vacuum and relax defaults

* fix includes

* Use index

* Add Latency breakdowns on server side

* Update generated TypeScript types

* Add Latency breakdowns on server side

* Propagate fields properly

* Add Async Search calls

* Add Jetty Metrics

* disable gzip

* AWS JDBC Driver

* add pctile

* Add method to endpoint pctile

* handle patch properly in metrics

* tests

* update metrics

* bump flyway

* fix jetty metric handler

* default to postgres

* default to postgres

* ConnectionType with amazon

* Update connection

* Update connection

* Add Redis Cache support for all entities, CacheWarmupApp

* Fix aurora driver settings

* Fix aurora driver settings

* Fix aurora driver settings

* Fix aurora driver settings

* revert config

* Handle ReadOnly

* update config

* Revert "update config"

This reverts commit 9f5751c356de474b8b79797cbbd9d7650a1bb349.

* Revert "Handle ReadOnly"

This reverts commit e0c906365109ae014e253cdba9e31df935208abb.

* Revert "revert config"

This reverts commit e79c3d2d84051320d4864ddf9638dcc6cdef1980.

* Revert "Fix aurora driver settings"

This reverts commit 463e6ebf4b4e8209a7dbb3bf7818544fa68dca5f.

* Revert "Fix aurora driver settings"

This reverts commit 515d22b0e0d3b979cb2af7b87a977b6d4290e38f.

* Revert "Fix aurora driver settings"

This reverts commit 0a1226e9e1e5fc6e42499560373e26004b410e5e.

* Revert "Fix aurora driver settings"

This reverts commit d959976b1cadaace1a09da0ca3d78df490c5a689.

* Add Redis Cache support for all entities, CacheWarmupApp

* Update generated TypeScript types

* Redis SSL

* redis auth

* Fix cache warmup and lookup if cahce fails

* Fix cache of relations

* try search cache

* fix search cache

* fix cache response

* Revert "fix cache response"

This reverts commit 14602dc8c59c5ee6b9b21e20f6d1e3a01ea865a0.

* Revert "fix search cache"

This reverts commit 8eaa76bd7ef9d635e6a5b6d3cba4262057f9d4cd.

* Revert "try search cache"

This reverts commit 0582a1dc03a4353efb3d635957fd4df5dd626f00.

* clean commits

* clean drops

* clean

* clean

* clean

* remove hosts array for ES

* Update generated TypeScript types

* remove hosts array for ES

* format

* remove hosts array for ES

* Remove Embeddings for Table Index

* metrics improvements

* MINOR - Report status for tests that blow up

* Revert "MINOR - Report status for tests that blow up"

This reverts commit e831ac04e6e79aa04e6ccff259d1c5fc852c6ba3.

* Fix tests

* Address comments

* remove unused code

* fix postgres schema migration

* fix tests and improve caching startegy

* fix tests, making search sync

* Update generated TypeScript types

* Fix Failures due to merge conflicts

* Fix Tag Failures

* Fix Retryable Exception

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
2025-10-28 06:29:31 +05:30
Ram Narayan Balaji
5b59b34c1d
App Screenshots Migration (#23722)
* App Screenshots Migration queries

* Replace the png only in the appScreenshots

* Cast json to jsonb for apps_Data_Store in the migration
2025-10-06 18:56:11 +05:30
Keshav Mohta
3d49b6689d
Fixes #23356: Databricks & UnityCatalog OAuth and Azure AD Auth (#23561)
* feat: databricks oauth and azure ad auth setup

* refactor: add auth type changes in databricks.md

* fix: test after oauth changes

* refactor: unity catalog connection to databricks connection code

* feat: added oauth and azure ad for unity catalog

* fix: unitycatalog tests, doc & required type in connection.json

* fix: generated tx files

* fix: exporter databricksConnection file

* refactor: unitycatalog example file

* fix: usage example files

* fix: unity catalog sqlalchemy connection

* fix: unity catalog client headers

* refactor: make common auth.py for dbx and unitycatalog

* fix: auth functions import

* fix: test unity catalog tags as None

* fix: type hinting and sql migration

* fix: migration for postgres
2025-10-03 19:53:19 +05:30
Eugenio
dff2b394d5
Fix classification scoring (#23523)
* Add `reason` property to `TagLabel`

This is to understand what score was used for selecting the entity

* Build `TagLabel`s with `reason`

* Increase `PIIProcessor._tolerance`

This is so we correctly filter out low scores from classifiers while still maintaining the normalization that filters out confusing outcomes.

e.g: an output with scores 0.3, 0.7 and 0.75, would initially filter the 0.3 and then discard the other two because they're both relatively high results.

* Make database and DAO changes needed to persist `TagLabel.reason`

* Update generated TypeScript types

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-10-01 12:11:14 +00:00
Sriharsha Chintalapani
18677afd39
Add support for Tags customizable rules, capturing feedback (#23289)
* Add support for translations in multi lang

* Add Tag Feedback System

* Update generated TypeScript types

* Fix typing issues and add tests to reocgnizer factory

* Updated `TagResourceTest.assertFieldChange` to fix broken test

This is because change description values had been serialized into strings and for some reason the keys ended up in a different order. So instead of performing String comparison, we do Json comparisons

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Eugenio Doñaque <eugenio.donaque@getcollate.io>
2025-09-30 07:17:18 +02:00
sonika-shah
92c30f2a0a
Fix: PostgreSQL migration immutability issue with databaseSchemaHash … (#23606)
* Fix: PostgreSQL migration immutability issue with databaseSchemaHash column

* Fix: PostgreSQL migration immutability issue with databaseSchemaHash column
2025-09-29 17:07:09 +05:30
Sriharsha Chintalapani
ed144ab0e8
Add threat model and incident response (#23603) 2025-09-28 13:17:23 -07:00
Adrià Manero
840f7e2a68
Setup NotificationTemplate CRUD (#23293) 2025-09-16 15:21:11 +02:00
sonika-shah
cc18ba1554
feat: Add configurable filters aggregation for tag source segregation in search (#23363)
* feat: Add configurable filters aggregation for tag source segregation in search

* Update generated TypeScript types

* use script based aggregation

* use script based aggregation

* Update generated TypeScript types

* update aggregations with script

* add migrations to fetch updated searchSettings

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
2025-09-16 15:16:06 +05:30
Ram Narayan Balaji
9fd34c8f89
Feat #20586 Implementation of Custom Metrics Measurement Units (#22876)
* Initial Implementation of Custom Metrics Measurement Units

* Update generated TypeScript types

* Removed Regex patterns and length validations as they are not needed

* Add a new column with index for custom units

* Remove comments in the sql

* update ui and add playwright

* fix metric selector

* fix tests

* address feedbacks

* remove unused field

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
2025-09-11 15:14:38 +05:30
Pere Miquel Brull
abcdc4e3d6
MINOR - Domain Independent DP Rule (#23067)
* MINOR - Domain Independent DP Rule

* handle DP

* Handle DP

* add migration

* improve rule mgmt

* improve rule mgmt

* add test for bulk op

* fix test

* handle in bulk

---------

Co-authored-by: sonika-shah <58761340+sonika-shah@users.noreply.github.com>
2025-08-29 17:28:29 +02:00