2307 Commits

Author SHA1 Message Date
Himanshu Khairajani
ce3e3ec4c1 fix #21555: Automator - Separating terms and tags in action config (#22970)
* Separating terms and tags in action config

* Update generated TypeScript types

* add: migration files for separate tags and terms

* chore: java formatting

* yaml formatting

* Chore: updated the release number

* updated to v194 as per release cycle

* updated to v195 as per release cycle

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: --global <--global>
2025-09-01 13:42:40 +05:30
Mayur Singal
92f641ce20 MINOR: Fix data insight index for multidomain (#23159)
(cherry picked from commit 6b65b5d075211d63d537e9ee7594e5bb15c0bca9)
2025-09-01 07:42:05 +00:00
github-actions
7dd25276b1 chore(release): Prepare Branch for 1.9.6 2025-09-01 05:46:57 +00:00
Chirag Madlani
3512549097 chore(BE): update response code for docs & signin page (#23140)
(cherry picked from commit c41828ece05cdfbe40734ab480faad4f9eb5d6e7)
2025-08-31 13:00:27 +05:30
Mohit Yadav
e080ab7be0 Fix Resource Context - Invalid Entity Type being passed (#23164)
(cherry picked from commit 643618823a719e84fa5404ff3e7222387bf7157e)
2025-08-30 13:56:50 +00:00
Sriharsha Chintalapani
14db2d9264 handle persona deletion and relations fetch when entitynotfoundexceptoin is thrown (#23094)
* handle persona deletion and relations fetch when entitynotfoundexceptoin is thrown

* Fix persona deletion

* Add Playwright Tests

(cherry picked from commit b32575eb5d3ace7196ac9c3aa4e4325e1d5ddb65)
2025-08-29 23:16:34 +00:00
Mayur Singal
ff65f7f8b8 MINOR: Mask Wherescape MSSQL Password (#23076)
(cherry picked from commit a382533f252c6c7f6280ea0cc8d3bda5ea56b7ad)
2025-08-28 12:57:06 +00:00
Pere Miquel Brull
7cfff762c4 MINOR - Rules per Entity endpoint (#23109)
(cherry picked from commit ae76182e3efd00429c7b354714fd4f72b2a5cec5)
2025-08-28 07:54:03 +00:00
Pere Miquel Brull
378ace104c MINOR - tag_usage performance (#22950)
* MINOR WIP - tag_usage performance

* Update EntityRepository.java

remove unnecessary call

* update query and indexes

* Merge 1.9.3 migration queries from main branch

- Add performance indexes for tag_usage and entity_relationship tables
- Add entity relationship update for dataContract relations
- Merge queries from both main and tag-usage-perf branches

Co-authored-by: Pere Miquel Brull <pmbrull@users.noreply.github.com>

---------

Co-authored-by: claude[bot] <209825114+claude[bot]@users.noreply.github.com>
Co-authored-by: Pere Miquel Brull <pmbrull@users.noreply.github.com>
2025-08-28 07:39:00 +02:00
Pere Miquel Brull
5fefbe3ca1 MINOR - Add specific endpoint for log downloads in streaming (#23021)
* MINOR - Add specific endpoint for log downloads in streaming

* Fix unit tests

* Fix unit test

---------

Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
(cherry picked from commit 6b075e3c1853a4ae8a5e9ad1453a7f17389791ac)
2025-08-27 06:27:02 +00:00
github-actions
dc548189eb chore(release): Prepare Branch for 1.9.5 2025-08-27 06:18:15 +00:00
sonika-shah
a6cbb125df Add queryUsage and other fields for bulkQuery Fetching (#23087)
* Add queryUsage and other fields for bulkQuery Fetching

* remove additional comments

(cherry picked from commit 2ddc61a0ca1140831490e904992d2c46628c8a3e)
2025-08-26 04:42:19 +00:00
github-actions
b94e77761e chore(release): Prepare Branch for 1.9.4 2025-08-25 17:38:11 +00:00
IceS2
4cba57a9bb FIXES #20888: Validate EntityLink column existence during test case creation (#22932)
* fix: Validate EntityLink column existence during test case creation

- Update EntityRepository.validateColumn() to use case-insensitive comparison
- Add column existence validation to TestCaseRepository.validateColumnTestCase()
- Prevents test case creation with invalid column references due to case sensitivity

Fixes #20888

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-authored-by: IceS2 <IceS2@users.noreply.github.com>

* small fix

* Add tests

* Fix test

---------

Co-authored-by: claude[bot] <209825114+claude[bot]@users.noreply.github.com>
Co-authored-by: IceS2 <IceS2@users.noreply.github.com>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
(cherry picked from commit a2541d25ce3e675e652de8772d89dd51e33817af)
2025-08-22 14:34:04 +00:00
Copilot
b048b5a039 Fix system default persona preferences validation to allow landing page customization (#22960)
* Initial plan

* Implement system default persona preferences support

- Allow users to set preferences for system default persona even without direct assignment
- Update validation logic in UserRepository.updatePersonaPreferences()
- Add test to verify system default persona preferences functionality
- Maintain validation for non-assigned, non-system-default personas

Co-authored-by: harshach <38649+harshach@users.noreply.github.com>

* Add manual verification tests for system default persona fix

Co-authored-by: harshach <38649+harshach@users.noreply.github.com>

* Clean up temporary files

Co-authored-by: harshach <38649+harshach@users.noreply.github.com>

* Fix tests

---------

Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: harshach <38649+harshach@users.noreply.github.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
2025-08-22 06:54:44 -07:00
IceS2
0782dc28b6
Add deploy pipeline method to ingestion pipeline repository (#22999)
* Adding deployIngestionPipeline method to the IngestionPipelineRepository

* Add Missing entityspecificUpdate

* Fix updating relationships

* Made updateProcessingEngine protected

* Update updateFrom and  updateTo relationship to be able to just delete a relationship if we update it to null
2025-08-22 11:31:44 +02:00
github-actions
621302b8c7 chore(release): Prepare Branch for 1.9.3 2025-08-22 06:34:54 +00:00
sonika-shah
e3b37dbf7e Cherry pick - Fix Soft Deleted Table don't shows the Columns Data 2025-08-20 10:04:06 +05:30
Mohit Yadav
33bba503bb Remove configuration for APIs for auth or authorizer (#23001)
(cherry picked from commit d5dfc458fdea8535754ca1741a6cb5eefe2bf059)
2025-08-20 00:13:11 +00:00
sonika-shah
1c4e750803 Fix incorrect condition in getDomains() method (#22983)
(cherry picked from commit 7ae490fc1304633ed962fb773faa052aa3a930a9)
2025-08-19 14:11:08 +00:00
Teddy
c69c21d82e ISSUE #1753 - Add Row Count to Custom SQL Test (#22697)
* feat: add count rows support for custom SQL

* style: ran python linting

* feat: added logic for partitioned custom sql row count

* migration: partitionExpression parameter

* chore: resolve conflicts

(cherry picked from commit d58b8a63d675e9bf91a2283a5f37702648cdab7f)
2025-08-19 10:25:15 +02:00
Ariel Schulz
8d98833622 Feature/1 fix and add lineage to exasol connector (#21399)
* Add lineage to Exasol connector

* Update test_connection to return TestConnectionResult

* Add exasol tests & dependencies to tests in setup.py

* Opensearch is required for testing, so add it there

* Modify metadata

* Update documentation for lineage

* Apply formatting changes to code

* Apply make py_format
2025-08-19 13:27:02 +05:30
Mohit Yadav
395203b589 Add healthcheck on System Resource (#22974)
* Add healthcheck on System Resource

* Exclude from filtering

(cherry picked from commit 5c4e3f365b09f889261330aafff23982bc9e4f6f)
2025-08-19 07:27:17 +00:00
Ram Narayan Balaji
274dc0882f Fix Bug: Match All Tags giving a NPE with the resource doesn't have tags (#22937)
(cherry picked from commit 5c76e78ff56964c0a4bba6e783fc1bf62a3ec2a4)
2025-08-18 21:15:17 +05:30
github-actions
d17042a90e chore(release): Prepare Branch for 1.9.2 2025-08-14 16:12:26 +00:00
Sriharsha Chintalapani
76808342f7 Fix User Metrics (#22922)
Co-authored-by: Ajith Prasad <37380177+aji-aju@users.noreply.github.com>
(cherry picked from commit 11ba92a1b109934f4d6ce593ecd7f2837ec9fca3)
2025-08-13 16:48:13 +05:30
Ajith Prasad
ace0729459 Removed lastLoginTime from change Description (#22892)
(cherry picked from commit c5e2a9b2639b8412b8f4475a4a6202169bfcaffc)
2025-08-12 12:17:00 +00:00
Sriharsha Chintalapani
08d03b548b Fix #1093: Add Grafana Support (#22571)
* Fix #1093: Add Grafana Support

* Update generated TypeScript types

* Grafana test fix

* Update

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Akash Verma <akashverma@Mac.lan>
2025-08-12 15:57:54 +05:30
github-actions
e16dd73084 chore(release): Prepare Branch for 1.9.1 2025-08-12 05:09:26 +00:00
Mohit Yadav
7989f156cb Fix Failing Migrations dues to charts (#22850)
(cherry picked from commit 5741bbb653f40c8b6eff620541810f4db3112130)
2025-08-08 18:40:44 +00:00
Pere Miquel Brull
a22f2b4ae2 FIX - Restore existing DC during PUT (#22832)
(cherry picked from commit b430a65e6119fd90f5f7014d22ea4144ad847016)
2025-08-08 05:17:10 +00:00
Aniket Katkar
8a8f803ca0 Fix service insight live update bugs (#22822)
* Fix live update bugs

* support automator status

* fix query search index

* Update the logic to display the AutoPilot status and add playwright test

* Fix tests

---------

Co-authored-by: ulixius9 <mayursingal9@gmail.com>
(cherry picked from commit bce4bcd32fcfd4dcc52caab3c1cb335f04093ea3)
2025-08-08 02:27:19 +00:00
Pere Miquel Brull
0bf8d81b1e FIX - Contract mismatch with existing test suites (#22826)
* FIX - Contract mismatch with existing test suites

* FIX - Contract mismatch with existing test suites

* FIX - Contract mismatch with existing test suites

* format

* format

(cherry picked from commit ec9b0ef03037f878691ad8a60564d5258ded6fc9)
2025-08-07 18:29:57 +00:00
Mohit Yadav
2b1c439224 Fix Vulnerabilities (#22813)
(cherry picked from commit 30b5634522316cb70844a91e13200295e4e8b82e)
2025-08-07 08:31:17 +00:00
Akash Verma
a403879f86 feature: googlesheet connector (#22464)
* feature: googlesheet connector

* updates

* minor change

* java checkstyle

* googledrive files

* fix

* make the google sheets work

* fix directory and files

* remove ui

* update generated types

---------

Co-authored-by: Akash Verma <akashverma@Akashs-MacBook-Pro-2.local>
Co-authored-by: sonika-shah <58761340+sonika-shah@users.noreply.github.com>
Co-authored-by: Akash Verma <akashverma@Mac.lan>
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
2025-08-06 22:53:42 +05:30
Ram Narayan Balaji
b156cf2390 Fix: #19907 Glossary Term Approval Workflow - Trigger Filters - JsonLogic along with Exclude Fields filter (#22437)
* Draft Implementation of Auto approve Glossary Terms - JsonLogicFilter

* Update generated TypeScript types

* Fixed Issues: PassFilter Inversion when jsonLogic is true, Unescaping JsonFilter

* Corrected the Test Expectations and fixed the test

* Fixed the Test for auto approval

* Fixed Java Checkstyle

* Added Entity to the jsonLogic Map for rule application so that other operations on entity is also used in jsonLogic

* Implementation of Code Review Changes
1. Use the Singleton Rule Engine and add Operations
2. Use Migrations and remove the backward Compatibility

* Update generated TypeScript types

* Removed Flowable variable updatedBy

* Update CheckEntityAttributesImpl to use Singleton rule instance

* Final Design: Improved Json Logic Triggers : isChanged, isReviewer, isOwner

* Fixed Issue: Extracting var from isChanged rule

* Fixed Issue: Fixed comment and trigger properties for entityBasedTrigger

* Hybrid approach: Exclude Fields + JsonLogic

* Update generated TypeScript types

* Added a lot of test cases!

* Auto Approve Glossary Terms during creation to avoid forever DRAFT state

* Added nodes for auto approve for reviewers

* Revert starting terms in DRAFT

* Adding Migrations to take the fresh data from the seed config, since our default workflow definitions have been changed.

* Handled Migrations properly for glossary term auto approve nodes

* Fix Merge Conflicts - Updated MigrationUtil, Fixed GlossaryStates test with newly added nodes

* Add Trigger filter to have empty string

* Fix Java checkstyle

* Updated the JsonLogic apply to incorporate RuleEngine changes

* Update the default rule for checkglossaryterm has reviewers node in governance workflow

* add migration logic

* Fix Flaky Optimistic Lock exception in the test case

* add tests

* Fix: 1. Propagate updatedBy from the trigger and make the updatedBy to be a reviewer in case of auto approval by reviewer.
2.  Multiple Workflow Instance Conflicts resolution

* Remove early no conflict return

* revert search provider changes

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: sonika-shah <58761340+sonika-shah@users.noreply.github.com>
(cherry picked from commit 0aa9238a72eaca08427c933457700a3f70325997)
2025-08-06 17:54:12 +05:30
Sriharsha Chintalapani
ba0525cf04 Fix user activity tracking (#22738)
* Fix user activity tracking

* Add Test
2025-08-06 11:10:10 +05:30
sonika-shah
9d3ccf7890 Fix-22668 Glossary term missing from UI in columns search (#22764)
* Fix-22668 Glossary term missing from UI in columns searching

* add test

(cherry picked from commit 730b2ff07eab6c430d46790987a4d083a5815995)
2025-08-06 05:06:58 +00:00
sonika-shah
fc36647863 Minor : missing old pipeline in pipeline widget (#22761)
* Minor : missing old pipeline in pipeline widget

* fix test

(cherry picked from commit 3d3cfbf7906e6167475b4fd079f94c5ae152309b)
2025-08-06 03:37:17 +00:00
Sriharsha Chintalapani
81db639f27 Add more details to search reindex into slack, default the max content to 10mb (#22741)
* Add more details to search reindex into slack, default the max content to 10mb

* Fix for --entities param to work with or with-out quotes

(cherry picked from commit ac3cedff08c905ca0d987622719b7dbacd408d34)
2025-08-05 19:26:56 +00:00
Mayur Singal
923bc68f8f Fix #21361: Live charts for service insights (#21644)
* Fix #21361: Live charts for service insights

* websocket implementation

* Minor refactoring

* update the UI for PlatformInsights and TotalDataAssets widgets.

* Remove unused state and variable

* Implement the live updates logic for Platform insight charts

* Add healthy data assets chart to platform insights

* Add agents widget

* add DI migrations to 190

* Add Agents status widget

* pass collateAgentsList to service insights tab

* Add the styling for CollateAI agents status cards

* add service name in response and stop stream api

* Fix the style variable names

* fix fields bug

* add remaining charts

* add total assets live chart

* pipeline_status_live

* Implement the stop socket connection for service insights live update

* Fix the chart names for live update

* fix services

* fix description

* handle ingestion pipeline status

* Add icons for agents and statuses

* alerts api eslint fix

* Fix the logic to update the agents statuses from websocket response

* Add missing localization keys

* Remove the autopilot status banner

* Fix total data assets widget live updates

* Remove commented code

* Add collate app status

* Update generated TypeScript types

* uncomment the websocketProvider code

* Make changes for live updates for collate AI agents

* Remove unnecessary changes and move util function to util file

* Fix the playwright and add check to prevent the live updates of one service showing for others

---------

Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-08-05 23:07:34 +05:30
Pere Miquel Brull
3e14c8fefc MINOR - Handle removed tests from contract & Add Rule Engine Tests (#22755)
* MINOR - Add Rule Engine Tests

* format

* improve test suite handling

(cherry picked from commit c899732799bb04f585f12dffb77dcf1ab48747b1)
2025-08-05 15:03:12 +00:00
Ram Narayan Balaji
a0050bdeb3 Fix Flakiness of SearchResourceTest (#22728)
(cherry picked from commit e7249d2027d4db15a99b2b4465ca3eb02b0a2e06)
2025-08-05 18:23:41 +05:30
Sriharsha Chintalapani
52fc776919 Bug: Repositories overriding fieldSetters can fail to load tags at entity level (#22622)
* Bug: Repositories overriding fieldSetters can fail to load tags at entity level

* Bug: Repositories overriding fieldSetters can fail to load tags at entity level

* fix build

* Fix Test

* Fix Test

* fix test

---------

Co-authored-by: sonikashah <sonikashah94@gmail.com>
Co-authored-by: sonika-shah <58761340+sonika-shah@users.noreply.github.com>
2025-08-05 16:59:02 +05:30
Ram Narayan Balaji
c725791247 Fix #22623 Fetch entities for import csv should exclude only the fields that are coming from the CSV (#22663)
* Fetch entities for import csv should exclude only the fields that are coming from the CSV

* Updated DocStrings with Comments!

(cherry picked from commit 8d7db583049d8f93e0c1330255a2c43588f6eaff)
2025-08-04 12:44:25 +00:00
github-actions
781d1f4883 chore(release): Prepare Branch for 1.9.0 2025-08-04 07:45:41 +00:00
Pere Miquel Brull
3b0af3f48f
MINOR - Handle OM connection on DC trigger (#22718)
* MINOR - Handle OM connection on DC trigger

* MINOR - Handle OM connection on DC trigger
2025-08-04 06:07:27 +02:00
Karan Hotchandani
eceb75dd17
feat(ui): Add Chart Details Page (#22271)
* feat: Add Chart Details Page and update Dashboard Chart Table

This commit introduces a new dedicated page for displaying chart details, mirroring the functionality of the existing dashboard details page.

Key changes include:
- Creation of  components, tests, and mocks.
- Creation of  component and its interface.
- Creation of  and .
- Renamed  to  to support JSX syntax.
- Updated application routing to include FQN in chart detail URLs.
- Modified  to link chart names to the new chart details page.

* fix tests

* add chart class playwright

* Refactor chart details and constants for improved type support

Updated ChartDetails component and related interfaces to improve type safety and support for Chart as a data asset. Removed custom properties tab and widget from chart details. Added chart entity to data asset types and constants, and updated color schemes for chart visualizations. Adjusted permission handling and tab generation logic for chart details.

* add charts custom properties

* chart page bug fixes (#22490)

* Update generated TypeScript types

* fix tests

* mvn formatting

* add visit page link

* domain migration

* add announcements

* fix test

* Update ChartDetailsUtils.tsx

* fix style issue

* update routes

---------

Co-authored-by: Dhruv Parmar <83108871+dhruvjsx@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2025-08-03 16:20:59 +02:00
Pere Miquel Brull
8607f10d95
MINOR - Add Tests & fix migrations (#22714) 2025-08-03 15:19:54 +02:00
Ram Narayan Balaji
1573470cac
Fix: #20662 Display Name sort for DataAssets (#22620)
* Feature: Display Name sort for DataAssets

* Fix java checkstyle

* Increased time for indexing, might be due to indexing, also adding what all ids intersect

* Introduce table names with randomness for varying search scores, print if there are any overlapping as well - Just a test

---------

Co-authored-by: Pranita Fulsundar <pfulsundar8@gmail.com>
Co-authored-by: sonika-shah <58761340+sonika-shah@users.noreply.github.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
2025-08-03 17:06:35 +05:30