13593 Commits

Author SHA1 Message Date
NadezhdaNovotortseva
4868decc3b fix: airflow ingest get_pipelines_list order_by added (#22909)
* fix: airflow ingest get_pipelines_list order_by added

* code reformatted

---------

Co-authored-by: Надежда Коцюба <nadezhda.kotsyuba@uni.rest>
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
(cherry picked from commit 24e5155ffd01f73143dc05ce1c14956bc9ae70fd)
2025-08-24 19:50:34 +00:00
Oliver Schlüter
3adf6b38b9 Follow-up to #22474: Expose retry_codes parameter in Airflow lineage backend configuration (#22994)
(cherry picked from commit b29deea3dedd0b3044486230377d4474ed04531d)
2025-08-24 19:45:50 +00:00
Ashish Gupta
66dfc9d375 MINOR: fix the knowledge, Glossary/Term page redirect notification link (#21341)
* fix the knowledge page redirect notification link

* fix the feed redirection for glossary

* use entityRef data for displayName if present

(cherry picked from commit 8d4b7c78947678e151ff448a77f63bf2eb00a23d)
2025-08-23 16:33:11 +00:00
Shailesh Parmar
ca8610314d fix: improve test case form loading and structure in AddTestCaseNewFlow (#23068)
(cherry picked from commit 1e5d2c92680a47a4e02b1ad16e8acd0d9aab5d45)
2025-08-23 04:02:16 +00:00
Mohit Yadav
75a2ae5b9f Upgrade Mcp to 0.11.2 (#23049)
* Upgrade Mcp to 0.11.2
Use stateless Mcp Servlet

* Add Test for Load Testing and Improve Search Response

* Fixed Glossary And Patch Test

* Add user tests

* Fix failing load test

(cherry picked from commit 414a0094745bf18922e54b98bec8eda18be9a219)
2025-08-22 17:14:13 +00:00
IceS2
4cba57a9bb FIXES #20888: Validate EntityLink column existence during test case creation (#22932)
* fix: Validate EntityLink column existence during test case creation

- Update EntityRepository.validateColumn() to use case-insensitive comparison
- Add column existence validation to TestCaseRepository.validateColumnTestCase()
- Prevents test case creation with invalid column references due to case sensitivity

Fixes #20888

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-authored-by: IceS2 <IceS2@users.noreply.github.com>

* small fix

* Add tests

* Fix test

---------

Co-authored-by: claude[bot] <209825114+claude[bot]@users.noreply.github.com>
Co-authored-by: IceS2 <IceS2@users.noreply.github.com>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
(cherry picked from commit a2541d25ce3e675e652de8772d89dd51e33817af)
2025-08-22 14:34:04 +00:00
Sriharsha Chintalapani
f57f8c4abb Merge remote-tracking branch 'origin/1.9.3' into 1.9.3 2025-08-22 07:16:29 -07:00
Pranita Fulsundar
21490037fe fix Suggestions.test.tsx (#23058)
(cherry picked from commit 7bf06c5ecd83efb233f093b61dd7fa6cfac7696d)
2025-08-22 13:57:42 +00:00
Copilot
b048b5a039 Fix system default persona preferences validation to allow landing page customization (#22960)
* Initial plan

* Implement system default persona preferences support

- Allow users to set preferences for system default persona even without direct assignment
- Update validation logic in UserRepository.updatePersonaPreferences()
- Add test to verify system default persona preferences functionality
- Maintain validation for non-assigned, non-system-default personas

Co-authored-by: harshach <38649+harshach@users.noreply.github.com>

* Add manual verification tests for system default persona fix

Co-authored-by: harshach <38649+harshach@users.noreply.github.com>

* Clean up temporary files

Co-authored-by: harshach <38649+harshach@users.noreply.github.com>

* Fix tests

---------

Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: harshach <38649+harshach@users.noreply.github.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
2025-08-22 06:54:44 -07:00
Mayur Singal
155241605e
MINOR: Improve Databricks Profiler & Test Connection (#22732) 2025-08-22 17:35:49 +05:30
Keshav Mohta
da67de51cc Fix #18491: ingestion fails for Iceberg tables with nested partition column (#23031)
* fix: ingestion fails for Iceberg tables with nested partition column

* test: added test to cover nested partition column for iceberg

* refactor: used if-else in tablePartition check

* fix: partition_column_name & column_partition_type typo

(cherry picked from commit 2f655daedc1bb82fbb97bec0e42fca15a8bb7863)
2025-08-22 12:01:21 +00:00
Keshav Mohta
ddc9e307be Fixes: Snowflake Tags Ingestion (#23040)
* fix: snowflake tag ingestion error handling

* fix: python checkstyle

(cherry picked from commit 697b318f75ef630907abc2dece428ec67383ab53)
2025-08-22 11:59:55 +00:00
Karan Hotchandani
4c323ab8fb chore(ui): playwright fixes (#23048)
* fix playwright issues in CI

* update timeout

* update timeouts

(cherry picked from commit 7ad16f5623705c286bd683035a64fc34a3e21163)
2025-08-22 10:38:53 +00:00
Ayush Shah
c99edbe290 Fixes #21677: Refactor and enhance the entity name transformation logic (#22695) 2025-08-22 15:49:31 +05:30
IceS2
0782dc28b6
Add deploy pipeline method to ingestion pipeline repository (#22999)
* Adding deployIngestionPipeline method to the IngestionPipelineRepository

* Add Missing entityspecificUpdate

* Fix updating relationships

* Made updateProcessingEngine protected

* Update updateFrom and  updateTo relationship to be able to just delete a relationship if we update it to null
2025-08-22 11:31:44 +02:00
Ashish Gupta
e0f4a59770 fix the ui breaking on contract status button click (#22925)
* fix the ui breaking on contract status button click

* fix the test

* fix dataContract test

---------

Co-authored-by: Pranita <pfulsundar8@gmail.com>
(cherry picked from commit 457a72b170ca582b5bf995b461666999f1eadadd)
2025-08-22 07:12:47 +00:00
Ashish Gupta
af547cdc3f PLAYWRIGHT: fix the bulk action failure due to input field not enable (#23033)
* fix the bulk action failure due to input field not enable

* fix the failure

(cherry picked from commit 3253527e044b0769ef2d4462fe20d3c6828402c7)
2025-08-22 06:53:41 +00:00
github-actions
621302b8c7 chore(release): Prepare Branch for 1.9.3 2025-08-22 06:34:54 +00:00
sonika-shah
f1df209bed Add missing domain migrations for entity version history (#23032) 1.9.2-release 2025-08-21 14:43:24 +05:30
Mohit Yadav
5d790455b0 Improve Performance (#23025)
(cherry picked from commit 837ad7429b38cbaa9d6ae53ab989f71d41bf3e7a)
2025-08-20 20:24:40 +00:00
Shailesh Parmar
a27b28e4f7 unskip: Profiler matrix playwright test (#22990) 2025-08-20 11:16:12 +05:30
Pranita Fulsundar
0def2d9339 fix(ui): UI lag when viewing kafka topics with large nested schemas (#22988)
* fix ui lag for kafka topic for large nested columns

* fix type

---------

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2025-08-20 10:27:59 +05:30
sonika-shah
e3b37dbf7e Cherry pick - Fix Soft Deleted Table don't shows the Columns Data 2025-08-20 10:04:06 +05:30
Mohit Tilala
4f78c1d1b7 Fixes #22112: Snowflake schema tags inheritance (#22979)
* Add schema-level tags and tag inheritance support for snowflake

* Add tests for schema tag inheritance

* Lint fixes

(cherry picked from commit 26fedbaf0eccb774837791df6b3337643c72014d)
2025-08-20 04:24:09 +00:00
Harshit Shah
91a93ad52f Fix pagination for Persona listing (#22975)
* Fix pagination for Persona

* fix failing tests

(cherry picked from commit 3bd3158bee8d79a98b00fc3a26fbf744de01985c)
2025-08-20 00:14:08 +00:00
Mohit Yadav
33bba503bb Remove configuration for APIs for auth or authorizer (#23001)
(cherry picked from commit d5dfc458fdea8535754ca1741a6cb5eefe2bf059)
2025-08-20 00:13:11 +00:00
sonika-shah
1c4e750803 Fix incorrect condition in getDomains() method (#22983)
(cherry picked from commit 7ae490fc1304633ed962fb773faa052aa3a930a9)
2025-08-19 14:11:08 +00:00
Mohit Tilala
3a22bb7b38 Fixes #22238: [SAP HANA] Correction of physical schema mapping and column lookup at each layer of calculation view (#22952)
(cherry picked from commit cc4b3574444fd41a2b46ac5f19666d1e96a18294)
2025-08-19 13:16:38 +00:00
Ashish Gupta
1d43002e23 fix the panel alignement in lineage edit mode full screen (#22984)
(cherry picked from commit b6c521187639cc69cb90fae0f744792aba10cca1)
2025-08-19 10:07:44 +00:00
Keshav Mohta
5bcb68e02d Fix #22340: Execution Time Support for NiFi Connector (#22981)
* feat: added nifi execution history

* doc: added pipeline status in available features

(cherry picked from commit f39f57ddcd44f0b2079f9363469f1d2e0112bc3b)
2025-08-19 08:40:13 +00:00
Teddy
c69c21d82e ISSUE #1753 - Add Row Count to Custom SQL Test (#22697)
* feat: add count rows support for custom SQL

* style: ran python linting

* feat: added logic for partitioned custom sql row count

* migration: partitionExpression parameter

* chore: resolve conflicts

(cherry picked from commit d58b8a63d675e9bf91a2283a5f37702648cdab7f)
2025-08-19 10:25:15 +02:00
Ariel Schulz
8d98833622 Feature/1 fix and add lineage to exasol connector (#21399)
* Add lineage to Exasol connector

* Update test_connection to return TestConnectionResult

* Add exasol tests & dependencies to tests in setup.py

* Opensearch is required for testing, so add it there

* Modify metadata

* Update documentation for lineage

* Apply formatting changes to code

* Apply make py_format
2025-08-19 13:27:02 +05:30
Mohit Yadav
395203b589 Add healthcheck on System Resource (#22974)
* Add healthcheck on System Resource

* Exclude from filtering

(cherry picked from commit 5c4e3f365b09f889261330aafff23982bc9e4f6f)
2025-08-19 07:27:17 +00:00
Shailesh Parmar
f66750d03f fix: issue with redirection from logs view page to data quality page. (#22973)
(cherry picked from commit 7fd03d7ab5ea4023cd9aedf04857defb622d6a22)
2025-08-19 05:23:14 +00:00
Pranita Fulsundar
70d3fb20ef fix test (#22968)
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2025-08-19 10:29:23 +05:30
Shailesh Parmar
5e7e518f30 Upgrade playwright version to 1.51.1 (#22884)
* Upgrade playwright version to 1.54.2 (latest) to support indexedDb storageState (#22879)

* bump playwright version to latest

* update playwright version in workflow files

* update playwright installation step in workflow files to ensure consistent working directory

---------

Co-authored-by: “maulikkotak98” <“maulik.k@deuexsolutions.com”>

* update playwright version to 1.51.1

* fix tests for lineage

* minor refactor and cleanup

* fix lineage tests

---------

Co-authored-by: Maulik Kotak <72746599+maulikkotak98@users.noreply.github.com>
Co-authored-by: “maulikkotak98” <“maulik.k@deuexsolutions.com”>
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
(cherry picked from commit bb9b395243fe166c37d6c7083a1fe01f9223c4b4)
2025-08-18 21:28:04 +05:30
Ram Narayan Balaji
274dc0882f Fix Bug: Match All Tags giving a NPE with the resource doesn't have tags (#22937)
(cherry picked from commit 5c76e78ff56964c0a4bba6e783fc1bf62a3ec2a4)
2025-08-18 21:15:17 +05:30
Ashish Gupta
e07d4dcf07 fix the lineage layers not visible upfront (#22958)
* fix the lineage layers not visible upfront

* fix the platform lineage height, added tooltip on radio buttons and remove the new node styling for the root node

* commented out the lineage view as we will re-design it

* remove unwanted code and fix the playwright removing the table test portion

* fix the sonar test

(cherry picked from commit 0e4aa3e391995cf02379a7c312411d5de43713ad)
2025-08-18 13:59:07 +00:00
github-actions
d17042a90e chore(release): Prepare Branch for 1.9.2 2025-08-14 16:12:26 +00:00
Mayur Singal
288c655436 MINOR: Fix usage failure after cross lineage (#22926)
(cherry picked from commit e74de5df81277bf9f0af94f128c60821d5ab23ca)
1.9.1-release
2025-08-13 16:48:27 +05:30
Sriharsha Chintalapani
76808342f7 Fix User Metrics (#22922)
Co-authored-by: Ajith Prasad <37380177+aji-aju@users.noreply.github.com>
(cherry picked from commit 11ba92a1b109934f4d6ce593ecd7f2837ec9fca3)
2025-08-13 16:48:13 +05:30
Ashish Gupta
6209e568a1 * supported lineage table and some feedback
* supported localization keys

* support view and hide properties

* supported localization keys

* fix the fullscreen sizes

* fix the color of tab icon for internal lineage

* supported base node separate color

* combined some table fields and supported backlink them with the service type logo

* fix the unit test and reverted unwanted change commited

* added empty data table

* fix the select search styling

* minor fixes

* fix the dashboardDataModel entity url being wrong

* fix the placement of view and hide properties

* added playwright to check if lineage table and also verify the data asset metadata tab is not visible after switching to lineage tab

* fix the metric node icon and redirect link

* move the breadcrumb in card header and added loader while fectching data in lineageTable

* minor playwright additon to avoid flakyness

* fix the unit test

* fix the sonar issue

* fix the customize failing test

* remove the view and hide properties from data asset header

(cherry picked from commit 981ffc28abba88030964cc9b560d2c4f77963d83)
2025-08-13 12:32:37 +05:30
harshsoni2024
3db10dc98b precede source table name before pbi table name (#22902) 2025-08-13 10:00:27 +05:30
Pranita Fulsundar
f69e41a212 fix(ui): default persona in user profile (#22906)
* fix default persona

* add tests for different cases

* minor fix

* fix test

* add remove persona test

* remove logic to determin default persona on UI side

* fix test

* minor fix

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
(cherry picked from commit 22be97b7d936ac919983ebb8a5d9bf68c603cdc0)
2025-08-12 20:58:46 +00:00
Ashish Gupta
d64ed2324e fix schema table playwright test (#22918)
(cherry picked from commit a0b05dacf421efcb097c836691a29f871991b082)
2025-08-12 18:33:42 +00:00
Chirag Madlani
05853b832b fix(ui): expand icon after updating column details (#22790)
* fix(ui): expand icon after updating column details

* add tests and fix container schema

* fix tests

(cherry picked from commit 07c3acfdbc21ba6577709301f8dd64e85fa2207c)
2025-08-12 15:17:37 +00:00
Chirag Madlani
c45ee17a4b fix(test): domain tests for support multi domain (#22556)
* fix(test): domain tests for support multi domain

* fix domain tests

* trying to fix patch call

* fix issue with searching and appying data product

* fix test and address comments

(cherry picked from commit 22292567dd2e5cdec3a5622653b9a7ae69d0d809)
2025-08-12 15:17:26 +00:00
Mayur Singal
ddac981b54 Fix #22164: Fix airflow compatibility issue with version 2.2.5 (#22897)
(cherry picked from commit 23959bd21a2a7428b738163dbe35a4198ea34561)
2025-08-12 13:03:45 +00:00
Shailesh Parmar
3a950d9924 Feat: spark UI supporting PR (#22886)
* Feat: spark UI supporting PR

- Added `rootProcessingEngine` to the ingestion workflow data structure.
- Updated `AddIngestion` component to handle the new processing engine field.
- Modified `IngestionWorkflowForm` to include custom fields for the profiler workflow.
- Introduced `INGESTION_RUNNER` entity type in the enum for better categorization.
- Updated multiple language files to include translations for "ingestion-runner".
- Refactored ingestion workflow utility functions to accommodate the new processing engine structure.

* fix: correct class name from 'matric-collapse-footer' to 'matrix-collapse-footer' and adjust styles
2025-08-12 18:32:17 +05:30
Mayur Singal
f4127757c3 FIX #21180: Implement Cross Service Lineage (#22665) 2025-08-12 18:23:36 +05:30