2341 Commits

Author SHA1 Message Date
sonika-shah
2e7af27c0d
Fix test flakiness in FeedResourceTest (#23300) 2025-09-09 23:40:20 +05:30
Mohit Yadav
450840eb8e
Drop Insights Indexes (#23294) 2025-09-08 17:59:14 +05:30
Chirag Madlani
5b7c569ebf
feat(ui): support custom operator for array object contains (#23248)
* feat(ui): support custom operator for array object contains

* add contains logicOps

* added playwright test and supported contains in tags and glossary as well

* fix sonar issue

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2025-09-08 11:26:37 +02:00
Pere Miquel Brull
4483e183cb
MINOR - Update contract security schema (#23274)
* MINOR - Update contract security schema

* Update generated TypeScript types

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-09-08 10:42:34 +02:00
Pere Miquel Brull
17d5a5d83f
MINOR - Handle chart for Data Contract and add schema validations (#23242)
* test for chart

* MINOR - Handle chart for Data Contract and add schema validations

* MINOR - Handle chart for Data Contract and add schema validations
2025-09-08 10:42:15 +02:00
Teddy
568baab426
ISSUE #2031 - Add App Runner to Application Entity (#23259)
* feat: added exporter app config

* refactor: added entityprofile resource & added backward compatibility to existing API

* feat: added tests to get_profile_data_by_type

* feat: remove non supported event types

* chore: added migrations to 1.9.7

* chore: added application creation readme

* feat: implemented backend support for agent runner for external applications

* chore: move migrations to 1.9.8

* Update generated TypeScript types

* fix: added setIngestionRunner method to serviceEntityInterface interface

* Update generated TypeScript types

* fix: remove service instanceof MetadataService in deploy endpoint

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-09-08 08:04:50 +02:00
Teddy
1ef191a2aa
ISSUE #1534 - Profiler Refactor for Metadata Extraction Application (#23200)
* feat: added exporter app config

* refactor: added entityprofile resource & added backward compatibility to existing API

* feat: added tests to get_profile_data_by_type

* feat: remove non supported event types

* chore: added migrations to 1.9.7

* chore: added application creation readme

* chore: move migrations to 1.9.8

* fix: failing java test

* style: ran java linting
2025-09-05 13:07:04 +02:00
Adrià Manero
571d7ee2eb
Allow Alerts to notify Lineage downstream entities stakeholders (#23218)
* Setup schema and core lineage traversal service for retrieving downstream entities

* Update getTargetsForAlert signature to use SubscriptionDestination

* Modify alert target finder method to support lineage entities analysis

* Rename utility class and method to explore downstream entities of the lineage graph

* Apply style

* Prevent entering on recursion when maxDepth is lower than 0

* Update generated TypeScript types

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-09-05 12:49:37 +02:00
Ram Narayan Balaji
0b56562e2b
Fix: setInheritedFields for spreadsheet, worksheet, file, directory (#23262) 2025-09-04 14:24:01 -07:00
Mohit Yadav
080f0d21fb
Concurrency issues in search (#23249)
* Fix - 23213 : WebSocketManager Issue on concurrent modification

* Await till consumers comelete the job

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2025-09-04 10:25:50 -07:00
Ram Narayan Balaji
be5887eb00
Restore deleted entities will take inherited fields into consideration (#23255)
* Restore deleted entities will take inherited fields into consideration

* dummy commit
2025-09-04 10:09:20 -07:00
Teddy
4537a54717
fix: remove cursor from tcr pagination (#23214) 2025-09-04 16:46:15 +02:00
Pere Miquel Brull
1e48241f51
MINOR - Add Security, SLA and Terms of Use to Data Contract (#23230)
* jsonschema

* MINOR - Add Security, SLA and Terms of Use to Data Contract

* Update generated TypeScript types

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-09-04 11:51:34 +02:00
IceS2
ebc67a9f97
MINOR: Add new WorkflowType and converter (#23090)
* Add new WorkflowType and converter

* Update generated TypeScript types

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-09-04 10:11:35 +02:00
Ram Narayan Balaji
5cb33ce78a
Implementation of Adding Entity Status and Reviewers to assets (#22904)
* Initial Implementation of Adding Status and Reviewers to assets for workflows

* Update generated TypeScript types

* Copilot Review Comments Addressed

* Removed DataProduct Reviewer Inheritance as it is irrelevant

* Commit: Classification has status and reviewers, DataContract uses the same status enums, changed the logic to be APPROVED instead of Active, DataContract can have null status as seen in tests, Changed Workflow to use workflowStatus instead of status as it is contradicting with the approval status, Fixed Tests

* Default for reviewers is null

* Default for reviewers is createSchema

* Addressed CoPilots comments

* Update generated TypeScript types

* Workflow status to workflowStatus in db and migrations

* Revert "Workflow status to workflowStatus in db and migrations"

This reverts commit 676e8789358654bc6f980f855c372f33c22fc40b.

* Changed status to entityStatus in the schema files

* Java Implementation of Default Status, Search Client improvements and Test fixes and new tests

* Adding entityStatus and reviewers in the searchIndex mappings and common attributes

* Data Migration scripts to change the glossaryTerm and dataContract structure

* Update generated TypeScript types

* Fixed zh/spreadsheet index json error

* Fix Postgre migration script

* Changed the entityStatus.json to status.json
Removed the duplicates of entityStatus in the indexMapping
Modified the sample data to take in EntityStatus.Approved instead of ContractStatus.Active

* Update generated TypeScript types

* dummy commit

* Fix UI Build Issues with the New EntityStatus
Fix py tests

* Migrations for all the entities that need entityStatus

* Update generated TypeScript types

* Removed Post Migration scripts

* Fix UI  and py for entityStatus

* Update generated TypeScript types

* Fix: DataContractResourceTest

* Fix UI and py for importing entityStatus

* UI to show and fetch Reviewers

* cleanup

* Removed Overridden SetDefaultStatus in GlossaryTermRepository

* Removed unnecessary validation

* Added entityStatus in search_entity_index_mapping.json

* Fixed DataContractResourceTest

* mvn spotless apply and fix migration scripts

* fix tests

* fix type error

* fix advanced search tests

* Status comparison using enums and supportsStatus to supportsEntityStatus

* mvn spotless apply

* fix merge conflict

* update entity status

* fix tests

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
2025-09-03 12:49:45 +05:30
sonika-shah
b2b61d7b62
Fix Data Product to asset mapping lost after upgrade (#23195) 2025-09-03 08:26:10 +05:30
Mayur Singal
0e3a550c95
MINOR: Fix column lineage validation (#23075) 2025-09-02 22:00:18 +05:30
Adrià Manero
d33ffe40a3
Document current status of ChangeEventScheduler and Race Condition issue (#23198) 2025-09-02 16:10:18 +02:00
Ram Narayan Balaji
f4d8eb027a
Fix Flowable exception in GlossaryTermResourceTest (#23186) 2025-09-02 16:33:24 +05:30
Himanshu Khairajani
b6788677f4
Rename migration files from v195 to v196 (#23194)
Renamed migration classes and utilities to v196 for MySQL and PostgreSQL.

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-authored-by: --global <--global>
Co-authored-by: Claude <noreply@anthropic.com>
2025-09-02 09:25:48 +02:00
Akash Verma
421f345554
Snowplow Connector (#23133)
* Snowplow Connector

* markdown file change

* UI

* ts file

---------

Co-authored-by: Akash Verma <akashverma@Mac.lan>
2025-09-02 11:32:33 +05:30
Pere Miquel Brull
0e5093d366
FIX - Data Product bulk addition with different types (#23188)
* FIX - Data Product bulk addition with different types

* FIX - Data Product bulk addition with different types
2025-09-02 08:02:12 +02:00
Akash Verma
a41d0404c4
Feature: ServiceNow Connector (#23093)
* service now connector files

* updated schema and ui file

---------

Co-authored-by: Akash Verma <akashverma@Mac.lan>
2025-09-02 11:00:23 +05:30
Sriharsha Chintalapani
cb42409999
GlossaryTerm Search endpoint (#23005)
* Glossary Term load issues

* Glossary Term load issues

* Fix #20081: Infinite scroll Pagination support for Glossary Term Table in UI

* Fix #20081: Infinite scroll Pagination support for Glossary Term Table in UI

* fixed glossary infinite scroll

* removed script

* fixed glossary fialing playwright

* fixed expand and collapse for entire hierarchy

* Add search endpoint to support glossary term search

* Add search endpoint to support glossary term search

* fixed fetchAllTerm glitch (#23037)

* resolve conflicts and fix style

* minor prettier fix

* Fix(ui): Infinity Scroll Playwright  (#23088)

* fixed comments

* removed unncessary files

* addressed ui issue

---------

Co-authored-by: Ashish Gupta <ashish@getcollate.io>

* Fix(ui):Infinite Scroll Unit Tests (#23131)

* fixed failing unit tests

* fixed mock type field

* Minor: Move migrations to 1.9.6

* Revert unintended changes in 1.9.5 migration files

* fix build

---------

Co-authored-by: Dhruv Parmar <83108871+dhruvjsx@users.noreply.github.com>
Co-authored-by: sonika-shah <58761340+sonika-shah@users.noreply.github.com>
Co-authored-by: sonikashah <sonikashah94@gmail.com>
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
2025-09-02 09:32:16 +05:30
Mayur Singal
6b65b5d075
MINOR: Fix data insight index for multidomain (#23159) 2025-09-01 13:10:26 +05:30
Mohit Yadav
643618823a
Fix Resource Context - Invalid Entity Type being passed (#23164) 2025-08-30 06:55:27 -07:00
Sriharsha Chintalapani
b32575eb5d
handle persona deletion and relations fetch when entitynotfoundexceptoin is thrown (#23094)
* handle persona deletion and relations fetch when entitynotfoundexceptoin is thrown

* Fix persona deletion

* Add Playwright Tests
2025-08-29 16:15:08 -07:00
Pere Miquel Brull
abcdc4e3d6
MINOR - Domain Independent DP Rule (#23067)
* MINOR - Domain Independent DP Rule

* handle DP

* Handle DP

* add migration

* improve rule mgmt

* improve rule mgmt

* add test for bulk op

* fix test

* handle in bulk

---------

Co-authored-by: sonika-shah <58761340+sonika-shah@users.noreply.github.com>
2025-08-29 17:28:29 +02:00
Chirag Madlani
c41828ece0
chore(BE): update response code for docs & signin page (#23140) 2025-08-29 10:59:22 +05:30
Dmitriy
4ba4bed300
Fixes #22598: Add Russian Language Support for Elasticsearch Search (#22599)
* ISSUE-22598: Add Russian language support for Elasticsearch index mappings

- Add 44 Russian (ru) Elasticsearch mapping files for all entity types
- Update IndexMappingVersionTracker to handle language-specific mappings
- Update generated UI configuration files

* fix Typescript generation

* Add RU to IndexMappingLanguage enum in JSON schema

* fix missing index ,fix typescript, Renamed directory: elasticsearch/RU/ → elasticsearch/ru/ (lowercase) ,Replaced filter: icu_folding → asciifolding (built-in filter that doesn't require plugins)

---------

Co-authored-by: dmitrii.cherkashin <dmitrii.cherkashin@welltory.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
Co-authored-by: sonika-shah <58761340+sonika-shah@users.noreply.github.com>
Co-authored-by: sonikashah <sonikashah94@gmail.com>
2025-08-29 00:13:25 +05:30
Mayur Singal
a382533f25
MINOR: Mask Wherescape MSSQL Password (#23076) 2025-08-28 18:25:43 +05:30
Himanshu Khairajani
8c4cebea13
fix #21555: Automator - Separating terms and tags in action config (#22970)
* Separating terms and tags in action config

* Update generated TypeScript types

* add: migration files for separate tags and terms

* chore: java formatting

* yaml formatting

* Chore: updated the release number

* updated to v194 as per release cycle

* updated to v195 as per release cycle

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: --global <--global>
2025-08-28 10:50:48 +02:00
Pere Miquel Brull
ae76182e3e
MINOR - Rules per Entity endpoint (#23109) 2025-08-28 09:49:51 +02:00
Tomas Montiel Prieto
7197d68aff
Move resultlist util to spec (#23121)
* move resultlist to spec

* move resultlist to spec 2

* update import
2025-08-28 07:49:02 +02:00
Pere Miquel Brull
1b39c9ca17
MINOR - Simplify migration context computing during tests (#23097) 2025-08-27 08:35:55 +02:00
Pere Miquel Brull
14e343c085
MINOR - Add BE validations on entity types for Data Contracts (#23065)
* MINOR - Add BE validations on entity types for Data Contracts

* MINOR - Add BE validations on entity types for Data Contracts

* fix test
2025-08-27 08:34:30 +02:00
Pere Miquel Brull
6b075e3c18
MINOR - Add specific endpoint for log downloads in streaming (#23021)
* MINOR - Add specific endpoint for log downloads in streaming

* Fix unit tests

* Fix unit test

---------

Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
2025-08-27 08:25:38 +02:00
sonika-shah
2ddc61a0ca
Add queryUsage and other fields for bulkQuery Fetching (#23087)
* Add queryUsage and other fields for bulkQuery Fetching

* remove additional comments
2025-08-26 10:10:53 +05:30
Pere Miquel Brull
d054f386c7
MINOR - tag_usage performance (#22950)
* MINOR WIP - tag_usage performance

* Update EntityRepository.java

remove unnecessary call

* update query and indexes

* Merge 1.9.3 migration queries from main branch

- Add performance indexes for tag_usage and entity_relationship tables
- Add entity relationship update for dataContract relations
- Merge queries from both main and tag-usage-perf branches

Co-authored-by: Pere Miquel Brull <pmbrull@users.noreply.github.com>

---------

Co-authored-by: claude[bot] <209825114+claude[bot]@users.noreply.github.com>
Co-authored-by: Pere Miquel Brull <pmbrull@users.noreply.github.com>
2025-08-25 17:45:39 +02:00
sonika-shah
e5286c15b9
Enhancement #22111 : Enable sub-domain access with hasDomain() Rule (#22855)
* Enhancement #22111
: Implement Hierarchical Domain Access for hasDomain() Rule

* improve logic

* add test

* update selector

* modify subdomain creation

---------

Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
2025-08-25 15:52:12 +05:30
IceS2
a2541d25ce
FIXES #20888: Validate EntityLink column existence during test case creation (#22932)
* fix: Validate EntityLink column existence during test case creation

- Update EntityRepository.validateColumn() to use case-insensitive comparison
- Add column existence validation to TestCaseRepository.validateColumnTestCase()
- Prevents test case creation with invalid column references due to case sensitivity

Fixes #20888

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-authored-by: IceS2 <IceS2@users.noreply.github.com>

* small fix

* Add tests

* Fix test

---------

Co-authored-by: claude[bot] <209825114+claude[bot]@users.noreply.github.com>
Co-authored-by: IceS2 <IceS2@users.noreply.github.com>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2025-08-22 16:31:54 +02:00
Pere Miquel Brull
bdf3659b41
MINOR - Data Contract fixes and improvements (#23043)
* fix change event handling for alerts

* contract is deleted when asset is deleted

* add support for custom properties

* Update generated TypeScript types

* handle suite index deletion

* validate owner is not coming back if not requested

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-08-22 12:58:06 +02:00
Adrià Manero
668cf42673
Refactor DatabaseServiceTablesProcessor and simplify getLatestTableProfile logic (#23038)
* fetch latest table profile via DAO in DatabaseServiceTablesProcessor

* remove overload of getLatestTableProfile

* remove overload of getLatestTableProfile
2025-08-22 08:58:34 +02:00
Mohit Yadav
c0d7a574d7
chore(release): Prepare Branch for 1.10.0-SNAPSHOT (#23034)
Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
2025-08-21 21:43:01 +05:30
Copilot
311e9b158b
Fix system default persona preferences validation to allow landing page customization (#22960)
* Initial plan

* Implement system default persona preferences support

- Allow users to set preferences for system default persona even without direct assignment
- Update validation logic in UserRepository.updatePersonaPreferences()
- Add test to verify system default persona preferences functionality
- Maintain validation for non-assigned, non-system-default personas

Co-authored-by: harshach <38649+harshach@users.noreply.github.com>

* Add manual verification tests for system default persona fix

Co-authored-by: harshach <38649+harshach@users.noreply.github.com>

* Clean up temporary files

Co-authored-by: harshach <38649+harshach@users.noreply.github.com>

* Fix tests

---------

Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: harshach <38649+harshach@users.noreply.github.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
2025-08-20 14:58:27 +05:30
IceS2
559341ac49
Add deploy pipeline method to ingestion pipeline repository (#22999)
* Adding deployIngestionPipeline method to the IngestionPipelineRepository

* Add Missing entityspecificUpdate

* Fix updating relationships

* Made updateProcessingEngine protected

* Update updateFrom and  updateTo relationship to be able to just delete a relationship if we update it to null
2025-08-20 10:32:51 +02:00
sonika-shah
1fc766d7b7
Fix Soft Deleted Table don't shows the Columns Data (#22991) 2025-08-19 17:12:27 -07:00
Mohit Yadav
d5dfc458fd
Remove configuration for APIs for auth or authorizer (#23001) 2025-08-19 17:11:43 -07:00
Ajith Prasad
360aaf8d55
Seperate path for rdf config which doesnt need auth (#22995) 2025-08-19 08:54:17 -07:00
sonika-shah
7ae490fc13
Fix incorrect condition in getDomains() method (#22983) 2025-08-19 19:38:39 +05:30