2333 Commits

Author SHA1 Message Date
Ram Narayan Balaji
0b56562e2b
Fix: setInheritedFields for spreadsheet, worksheet, file, directory (#23262) 2025-09-04 14:24:01 -07:00
Mohit Yadav
080f0d21fb
Concurrency issues in search (#23249)
* Fix - 23213 : WebSocketManager Issue on concurrent modification

* Await till consumers comelete the job

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2025-09-04 10:25:50 -07:00
Ram Narayan Balaji
be5887eb00
Restore deleted entities will take inherited fields into consideration (#23255)
* Restore deleted entities will take inherited fields into consideration

* dummy commit
2025-09-04 10:09:20 -07:00
Teddy
4537a54717
fix: remove cursor from tcr pagination (#23214) 2025-09-04 16:46:15 +02:00
Pere Miquel Brull
1e48241f51
MINOR - Add Security, SLA and Terms of Use to Data Contract (#23230)
* jsonschema

* MINOR - Add Security, SLA and Terms of Use to Data Contract

* Update generated TypeScript types

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-09-04 11:51:34 +02:00
IceS2
ebc67a9f97
MINOR: Add new WorkflowType and converter (#23090)
* Add new WorkflowType and converter

* Update generated TypeScript types

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-09-04 10:11:35 +02:00
Ram Narayan Balaji
5cb33ce78a
Implementation of Adding Entity Status and Reviewers to assets (#22904)
* Initial Implementation of Adding Status and Reviewers to assets for workflows

* Update generated TypeScript types

* Copilot Review Comments Addressed

* Removed DataProduct Reviewer Inheritance as it is irrelevant

* Commit: Classification has status and reviewers, DataContract uses the same status enums, changed the logic to be APPROVED instead of Active, DataContract can have null status as seen in tests, Changed Workflow to use workflowStatus instead of status as it is contradicting with the approval status, Fixed Tests

* Default for reviewers is null

* Default for reviewers is createSchema

* Addressed CoPilots comments

* Update generated TypeScript types

* Workflow status to workflowStatus in db and migrations

* Revert "Workflow status to workflowStatus in db and migrations"

This reverts commit 676e8789358654bc6f980f855c372f33c22fc40b.

* Changed status to entityStatus in the schema files

* Java Implementation of Default Status, Search Client improvements and Test fixes and new tests

* Adding entityStatus and reviewers in the searchIndex mappings and common attributes

* Data Migration scripts to change the glossaryTerm and dataContract structure

* Update generated TypeScript types

* Fixed zh/spreadsheet index json error

* Fix Postgre migration script

* Changed the entityStatus.json to status.json
Removed the duplicates of entityStatus in the indexMapping
Modified the sample data to take in EntityStatus.Approved instead of ContractStatus.Active

* Update generated TypeScript types

* dummy commit

* Fix UI Build Issues with the New EntityStatus
Fix py tests

* Migrations for all the entities that need entityStatus

* Update generated TypeScript types

* Removed Post Migration scripts

* Fix UI  and py for entityStatus

* Update generated TypeScript types

* Fix: DataContractResourceTest

* Fix UI and py for importing entityStatus

* UI to show and fetch Reviewers

* cleanup

* Removed Overridden SetDefaultStatus in GlossaryTermRepository

* Removed unnecessary validation

* Added entityStatus in search_entity_index_mapping.json

* Fixed DataContractResourceTest

* mvn spotless apply and fix migration scripts

* fix tests

* fix type error

* fix advanced search tests

* Status comparison using enums and supportsStatus to supportsEntityStatus

* mvn spotless apply

* fix merge conflict

* update entity status

* fix tests

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
2025-09-03 12:49:45 +05:30
sonika-shah
b2b61d7b62
Fix Data Product to asset mapping lost after upgrade (#23195) 2025-09-03 08:26:10 +05:30
Mayur Singal
0e3a550c95
MINOR: Fix column lineage validation (#23075) 2025-09-02 22:00:18 +05:30
Adrià Manero
d33ffe40a3
Document current status of ChangeEventScheduler and Race Condition issue (#23198) 2025-09-02 16:10:18 +02:00
Ram Narayan Balaji
f4d8eb027a
Fix Flowable exception in GlossaryTermResourceTest (#23186) 2025-09-02 16:33:24 +05:30
Himanshu Khairajani
b6788677f4
Rename migration files from v195 to v196 (#23194)
Renamed migration classes and utilities to v196 for MySQL and PostgreSQL.

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-authored-by: --global <--global>
Co-authored-by: Claude <noreply@anthropic.com>
2025-09-02 09:25:48 +02:00
Akash Verma
421f345554
Snowplow Connector (#23133)
* Snowplow Connector

* markdown file change

* UI

* ts file

---------

Co-authored-by: Akash Verma <akashverma@Mac.lan>
2025-09-02 11:32:33 +05:30
Pere Miquel Brull
0e5093d366
FIX - Data Product bulk addition with different types (#23188)
* FIX - Data Product bulk addition with different types

* FIX - Data Product bulk addition with different types
2025-09-02 08:02:12 +02:00
Akash Verma
a41d0404c4
Feature: ServiceNow Connector (#23093)
* service now connector files

* updated schema and ui file

---------

Co-authored-by: Akash Verma <akashverma@Mac.lan>
2025-09-02 11:00:23 +05:30
Sriharsha Chintalapani
cb42409999
GlossaryTerm Search endpoint (#23005)
* Glossary Term load issues

* Glossary Term load issues

* Fix #20081: Infinite scroll Pagination support for Glossary Term Table in UI

* Fix #20081: Infinite scroll Pagination support for Glossary Term Table in UI

* fixed glossary infinite scroll

* removed script

* fixed glossary fialing playwright

* fixed expand and collapse for entire hierarchy

* Add search endpoint to support glossary term search

* Add search endpoint to support glossary term search

* fixed fetchAllTerm glitch (#23037)

* resolve conflicts and fix style

* minor prettier fix

* Fix(ui): Infinity Scroll Playwright  (#23088)

* fixed comments

* removed unncessary files

* addressed ui issue

---------

Co-authored-by: Ashish Gupta <ashish@getcollate.io>

* Fix(ui):Infinite Scroll Unit Tests (#23131)

* fixed failing unit tests

* fixed mock type field

* Minor: Move migrations to 1.9.6

* Revert unintended changes in 1.9.5 migration files

* fix build

---------

Co-authored-by: Dhruv Parmar <83108871+dhruvjsx@users.noreply.github.com>
Co-authored-by: sonika-shah <58761340+sonika-shah@users.noreply.github.com>
Co-authored-by: sonikashah <sonikashah94@gmail.com>
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
2025-09-02 09:32:16 +05:30
Mayur Singal
6b65b5d075
MINOR: Fix data insight index for multidomain (#23159) 2025-09-01 13:10:26 +05:30
Mohit Yadav
643618823a
Fix Resource Context - Invalid Entity Type being passed (#23164) 2025-08-30 06:55:27 -07:00
Sriharsha Chintalapani
b32575eb5d
handle persona deletion and relations fetch when entitynotfoundexceptoin is thrown (#23094)
* handle persona deletion and relations fetch when entitynotfoundexceptoin is thrown

* Fix persona deletion

* Add Playwright Tests
2025-08-29 16:15:08 -07:00
Pere Miquel Brull
abcdc4e3d6
MINOR - Domain Independent DP Rule (#23067)
* MINOR - Domain Independent DP Rule

* handle DP

* Handle DP

* add migration

* improve rule mgmt

* improve rule mgmt

* add test for bulk op

* fix test

* handle in bulk

---------

Co-authored-by: sonika-shah <58761340+sonika-shah@users.noreply.github.com>
2025-08-29 17:28:29 +02:00
Chirag Madlani
c41828ece0
chore(BE): update response code for docs & signin page (#23140) 2025-08-29 10:59:22 +05:30
Dmitriy
4ba4bed300
Fixes #22598: Add Russian Language Support for Elasticsearch Search (#22599)
* ISSUE-22598: Add Russian language support for Elasticsearch index mappings

- Add 44 Russian (ru) Elasticsearch mapping files for all entity types
- Update IndexMappingVersionTracker to handle language-specific mappings
- Update generated UI configuration files

* fix Typescript generation

* Add RU to IndexMappingLanguage enum in JSON schema

* fix missing index ,fix typescript, Renamed directory: elasticsearch/RU/ → elasticsearch/ru/ (lowercase) ,Replaced filter: icu_folding → asciifolding (built-in filter that doesn't require plugins)

---------

Co-authored-by: dmitrii.cherkashin <dmitrii.cherkashin@welltory.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
Co-authored-by: sonika-shah <58761340+sonika-shah@users.noreply.github.com>
Co-authored-by: sonikashah <sonikashah94@gmail.com>
2025-08-29 00:13:25 +05:30
Mayur Singal
a382533f25
MINOR: Mask Wherescape MSSQL Password (#23076) 2025-08-28 18:25:43 +05:30
Himanshu Khairajani
8c4cebea13
fix #21555: Automator - Separating terms and tags in action config (#22970)
* Separating terms and tags in action config

* Update generated TypeScript types

* add: migration files for separate tags and terms

* chore: java formatting

* yaml formatting

* Chore: updated the release number

* updated to v194 as per release cycle

* updated to v195 as per release cycle

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: --global <--global>
2025-08-28 10:50:48 +02:00
Pere Miquel Brull
ae76182e3e
MINOR - Rules per Entity endpoint (#23109) 2025-08-28 09:49:51 +02:00
Tomas Montiel Prieto
7197d68aff
Move resultlist util to spec (#23121)
* move resultlist to spec

* move resultlist to spec 2

* update import
2025-08-28 07:49:02 +02:00
Pere Miquel Brull
1b39c9ca17
MINOR - Simplify migration context computing during tests (#23097) 2025-08-27 08:35:55 +02:00
Pere Miquel Brull
14e343c085
MINOR - Add BE validations on entity types for Data Contracts (#23065)
* MINOR - Add BE validations on entity types for Data Contracts

* MINOR - Add BE validations on entity types for Data Contracts

* fix test
2025-08-27 08:34:30 +02:00
Pere Miquel Brull
6b075e3c18
MINOR - Add specific endpoint for log downloads in streaming (#23021)
* MINOR - Add specific endpoint for log downloads in streaming

* Fix unit tests

* Fix unit test

---------

Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
2025-08-27 08:25:38 +02:00
sonika-shah
2ddc61a0ca
Add queryUsage and other fields for bulkQuery Fetching (#23087)
* Add queryUsage and other fields for bulkQuery Fetching

* remove additional comments
2025-08-26 10:10:53 +05:30
Pere Miquel Brull
d054f386c7
MINOR - tag_usage performance (#22950)
* MINOR WIP - tag_usage performance

* Update EntityRepository.java

remove unnecessary call

* update query and indexes

* Merge 1.9.3 migration queries from main branch

- Add performance indexes for tag_usage and entity_relationship tables
- Add entity relationship update for dataContract relations
- Merge queries from both main and tag-usage-perf branches

Co-authored-by: Pere Miquel Brull <pmbrull@users.noreply.github.com>

---------

Co-authored-by: claude[bot] <209825114+claude[bot]@users.noreply.github.com>
Co-authored-by: Pere Miquel Brull <pmbrull@users.noreply.github.com>
2025-08-25 17:45:39 +02:00
sonika-shah
e5286c15b9
Enhancement #22111 : Enable sub-domain access with hasDomain() Rule (#22855)
* Enhancement #22111
: Implement Hierarchical Domain Access for hasDomain() Rule

* improve logic

* add test

* update selector

* modify subdomain creation

---------

Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
2025-08-25 15:52:12 +05:30
IceS2
a2541d25ce
FIXES #20888: Validate EntityLink column existence during test case creation (#22932)
* fix: Validate EntityLink column existence during test case creation

- Update EntityRepository.validateColumn() to use case-insensitive comparison
- Add column existence validation to TestCaseRepository.validateColumnTestCase()
- Prevents test case creation with invalid column references due to case sensitivity

Fixes #20888

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-authored-by: IceS2 <IceS2@users.noreply.github.com>

* small fix

* Add tests

* Fix test

---------

Co-authored-by: claude[bot] <209825114+claude[bot]@users.noreply.github.com>
Co-authored-by: IceS2 <IceS2@users.noreply.github.com>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2025-08-22 16:31:54 +02:00
Pere Miquel Brull
bdf3659b41
MINOR - Data Contract fixes and improvements (#23043)
* fix change event handling for alerts

* contract is deleted when asset is deleted

* add support for custom properties

* Update generated TypeScript types

* handle suite index deletion

* validate owner is not coming back if not requested

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-08-22 12:58:06 +02:00
Adrià Manero
668cf42673
Refactor DatabaseServiceTablesProcessor and simplify getLatestTableProfile logic (#23038)
* fetch latest table profile via DAO in DatabaseServiceTablesProcessor

* remove overload of getLatestTableProfile

* remove overload of getLatestTableProfile
2025-08-22 08:58:34 +02:00
Mohit Yadav
c0d7a574d7
chore(release): Prepare Branch for 1.10.0-SNAPSHOT (#23034)
Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
2025-08-21 21:43:01 +05:30
Copilot
311e9b158b
Fix system default persona preferences validation to allow landing page customization (#22960)
* Initial plan

* Implement system default persona preferences support

- Allow users to set preferences for system default persona even without direct assignment
- Update validation logic in UserRepository.updatePersonaPreferences()
- Add test to verify system default persona preferences functionality
- Maintain validation for non-assigned, non-system-default personas

Co-authored-by: harshach <38649+harshach@users.noreply.github.com>

* Add manual verification tests for system default persona fix

Co-authored-by: harshach <38649+harshach@users.noreply.github.com>

* Clean up temporary files

Co-authored-by: harshach <38649+harshach@users.noreply.github.com>

* Fix tests

---------

Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: harshach <38649+harshach@users.noreply.github.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
2025-08-20 14:58:27 +05:30
IceS2
559341ac49
Add deploy pipeline method to ingestion pipeline repository (#22999)
* Adding deployIngestionPipeline method to the IngestionPipelineRepository

* Add Missing entityspecificUpdate

* Fix updating relationships

* Made updateProcessingEngine protected

* Update updateFrom and  updateTo relationship to be able to just delete a relationship if we update it to null
2025-08-20 10:32:51 +02:00
sonika-shah
1fc766d7b7
Fix Soft Deleted Table don't shows the Columns Data (#22991) 2025-08-19 17:12:27 -07:00
Mohit Yadav
d5dfc458fd
Remove configuration for APIs for auth or authorizer (#23001) 2025-08-19 17:11:43 -07:00
Ajith Prasad
360aaf8d55
Seperate path for rdf config which doesnt need auth (#22995) 2025-08-19 08:54:17 -07:00
sonika-shah
7ae490fc13
Fix incorrect condition in getDomains() method (#22983) 2025-08-19 19:38:39 +05:30
Adrià Manero
1e1a2e70f6
Fix Consistent masking of PII in table column profiling (#22933)
* Refactor PIIMasker getColumnProfile to encapsulate Authorizer PII check

* Refactor PIIMasker getTableProfile to encapsulate Authorizer PII check

* Add tests to check PII Sensitive masking on getTableColumns
2025-08-19 12:05:19 +02:00
Mohit Yadav
5c4e3f365b
Add healthcheck on System Resource (#22974)
* Add healthcheck on System Resource

* Exclude from filtering
2025-08-19 12:55:55 +05:30
Teddy
d58b8a63d6
ISSUE #1753 - Add Row Count to Custom SQL Test (#22697)
* feat: add count rows support for custom SQL

* style: ran python linting

* feat: added logic for partitioned custom sql row count

* migration: partitionExpression parameter

* chore: resolve conflicts
2025-08-19 06:40:49 +02:00
Sriharsha Chintalapani
a6d544a5d8
RDF Ontology, Json LD, DCAT vocabulary support by mapping OM Schemas to RDF (#22852)
* Support for RDF, SPARQL, SQL-TO-SPARQL

* Tests are working

* Add  RDF relations tests

* improve Knowledge Graph UI, tags , glossary term relations

* Lang translations

* Fix level depth querying

* Add semantic search interfaces , integration into search

* cleanup

* Update generated TypeScript types

* Fix styling

* remove duplicated ttl file

* model generator cleanup

* Update OM - DCAT vocab

* Update DataProduct Schema

* Improve JsonLD Translator

* Update generated TypeScript types

* Fix Tests

* Fix java checkstyle

* Add RDF workflows

* fix unit tests

* fix e2e

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2025-08-17 18:36:26 -07:00
Ram Narayan Balaji
a3a26ec29a
Fix: Flowable and Governance Workflow Error Logging for easy identification of errors and resolutions (#22940) 2025-08-15 16:01:34 +05:30
Ram Narayan Balaji
5c76e78ff5
Fix Bug: Match All Tags giving a NPE with the resource doesn't have tags (#22937) 2025-08-14 18:46:39 +05:30
Sriharsha Chintalapani
11ba92a1b1
Fix User Metrics (#22922)
Co-authored-by: Ajith Prasad <37380177+aji-aju@users.noreply.github.com>
2025-08-13 16:30:22 +05:30
Ajith Prasad
c5e2a9b263
Removed lastLoginTime from change Description (#22892) 2025-08-12 17:45:34 +05:30