13917 Commits

Author SHA1 Message Date
Pranita Fulsundar
49fd36976c
fix scroll issue for entity search settings (#23283) 2025-09-08 12:04:22 +05:30
Teddy
568baab426
ISSUE #2031 - Add App Runner to Application Entity (#23259)
* feat: added exporter app config

* refactor: added entityprofile resource & added backward compatibility to existing API

* feat: added tests to get_profile_data_by_type

* feat: remove non supported event types

* chore: added migrations to 1.9.7

* chore: added application creation readme

* feat: implemented backend support for agent runner for external applications

* chore: move migrations to 1.9.8

* Update generated TypeScript types

* fix: added setIngestionRunner method to serviceEntityInterface interface

* Update generated TypeScript types

* fix: remove service instanceof MetadataService in deploy endpoint

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-09-08 08:04:50 +02:00
sonika-shah
40ccc35165
Add entityType.keyword field with lowercase normalizer for case-insen… (#23147)
* Add entityType.keyword field with lowercase normalizer for case-insensitive search

* fix(UI): Updated Enum For Search (#23163)

* updated enum

* fixed flaky entitysummerypanel

* fixed failing tests

* fixed failing playwright test

* fixed failing tests

* fixed wait for response for playwright

* fixed api request for playwright

* fixed api call for playwright

* fixed explore tree

* addressed comments

* made filter lowercase to match with dropdown

* fixed failing playwright tests

* fix Users.spec

---------

Co-authored-by: Dhruv Parmar <83108871+dhruvjsx@users.noreply.github.com>
Co-authored-by: Pranita Fulsundar <pfulsundar8@gmail.com>
2025-09-08 09:18:18 +05:30
Ram Narayan Balaji
c24701b797
Added entityStatus and reviewers property in ru index mappings (#23286) 2025-09-08 09:17:44 +05:30
Shailesh Parmar
30f3dd07c6
playwright: fixed failing test case for description box selection. (#23277) 2025-09-07 10:23:52 +05:30
Shailesh Parmar
e78239f139
fix: only newly added test case was only getting selected in pipeline while creating new test case (#23279)
* fix: only newly added test case was getting selected in pipeline while creating new test case

* feat: add functionality to create and validate multiple test cases from table details page

* fix: refactor column selection logic to improve test case flow and reduce flakiness
2025-09-07 10:23:39 +05:30
Ashish Gupta
421985e8ce
restricted to column selection to the first level in nested columns DataContract (#23278)
* restricted to column selection to the first level in nested columns DataContract

* added playwright for it
2025-09-06 18:40:25 +05:30
Harshit Shah
01261f5c48
Redirect to persona page when clicked on default persona (#23141)
* Redirect to persona page when clicked on default persona

* add e2e tests

* fix e2e tests

* address comments

* fix e2e tests

* fix e2e tests
2025-09-06 16:40:05 +05:30
Ashish Gupta
1f65e92c58
change contract update to patch call from put (#23229)
* change contract update to patch call from put

* collapse the card when data is not availbale instead of hiding

* minor fix

* fix the sonar issue and addressed comments

* disabled save button while edit, if not changes detected and added playwright for it

* fix the playwright test due to recent pagination merge
2025-09-06 00:41:28 +05:30
Chirag Madlani
cb5bcdbb9c
fix(ui): pick right mode env production / dev (#23272)
* fix(ui): pick right mode env production / dev

* fix unit tests
2025-09-05 23:06:30 +05:30
Chirag Madlani
b6f9ed4a5b
fix(test): aut failures for bot and persona profile (#23254)
* fix(test): aut failures for bot and persona profile

* fix personaDeleteionUserprofile

* fix data contract aut failure

* rever unwanted changes
2025-09-05 21:22:39 +05:30
Harshit Shah
a5f6e9d13b
Allow multi assets selection for curated assets (#23084)
* Allow multi assets selection for curated assets

* fix failing test

* update empty widget icon sizes

* fix failing tests

* add certification filter

* fix failing unit test

* address comments

* fix e2e test

* add curated assets e2e tests

* minor fix

* Fix curated assets issue and add unit tests

* fix failing unit tests

* add e2e tests

* fix e2e test

* fix failing tests

* minor fix

* address comments

* minor fix
2025-09-05 17:24:50 +05:30
Teddy
1ef191a2aa
ISSUE #1534 - Profiler Refactor for Metadata Extraction Application (#23200)
* feat: added exporter app config

* refactor: added entityprofile resource & added backward compatibility to existing API

* feat: added tests to get_profile_data_by_type

* feat: remove non supported event types

* chore: added migrations to 1.9.7

* chore: added application creation readme

* chore: move migrations to 1.9.8

* fix: failing java test

* style: ran java linting
2025-09-05 13:07:04 +02:00
Adrià Manero
571d7ee2eb
Allow Alerts to notify Lineage downstream entities stakeholders (#23218)
* Setup schema and core lineage traversal service for retrieving downstream entities

* Update getTargetsForAlert signature to use SubscriptionDestination

* Modify alert target finder method to support lineage entities analysis

* Rename utility class and method to explore downstream entities of the lineage graph

* Apply style

* Prevent entering on recursion when maxDepth is lower than 0

* Update generated TypeScript types

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-09-05 12:49:37 +02:00
Keshav Mohta
103857f90c
Fixes #23010 #: BigQuery Project Selection In Profiler & AutoClassification Workflow (#23233)
* fix: added code for separate engine and session for each project in rofiler and classification and refactor billing project approach

* fix: added entity.database check, bigquery sampling tests

* fix: system metrics logic when bigquery billing project is provided
2025-09-05 14:09:14 +05:30
Marat Khambelov
972afc375a
ISSUE-23207: Date formatters work according to the chosen language (#23258) 2025-09-05 12:48:39 +05:30
Ashish Gupta
13bf23939f
fix contract schema pagination key selection not persisting (#23250)
* fix contract schema pagination key selection not persisting

* fix the unit test

* added playwrigt for it
2025-09-05 12:46:35 +05:30
Ashish Gupta
999af800b3
fix contract status button not visible in persona having contract tab (#23237)
* fix contract status button not visible in persona having contract tab

* supported playwright test for the same

* fix the unit test failing
2025-09-05 10:21:13 +05:30
Sriharsha Chintalapani
1f4186b661
Add missing tier mapping (#23263) 2025-09-04 14:24:17 -07:00
Ram Narayan Balaji
0b56562e2b
Fix: setInheritedFields for spreadsheet, worksheet, file, directory (#23262) 2025-09-04 14:24:01 -07:00
Mohit Tilala
d926ed9dad
[Snowflake] Handle cases when stream source is not retrievable (#23245) 2025-09-05 00:27:31 +05:30
Mohit Yadav
080f0d21fb
Concurrency issues in search (#23249)
* Fix - 23213 : WebSocketManager Issue on concurrent modification

* Await till consumers comelete the job

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2025-09-04 10:25:50 -07:00
Shailesh Parmar
2fb41687d2
Fix #23232 Users with Data Product edit permission unable to upload images due to missing Domain resource permission (#23257)
Fixes
2025-09-04 10:25:35 -07:00
Ram Narayan Balaji
be5887eb00
Restore deleted entities will take inherited fields into consideration (#23255)
* Restore deleted entities will take inherited fields into consideration

* dummy commit
2025-09-04 10:09:20 -07:00
Mohit Tilala
9b2b4d2452
[Lineage] Fix cross services lineage changes of service_names to missed methods (#23240)
* Fix cross db changes of service_names to missed methods

* Handle string value passed to service_names
2025-09-04 20:38:05 +05:30
Dhruv Parmar
70d9a1182e
fix(ui): Flaky ServiceEntity And Entity Playwright (#23162)
* fix flaky serviceEntity and entity

* added new testid

* fix domain list flakyness

* fix flaky user as owner in unsorted list

* addressed comments

* fixed flaky tests from entity spec

* removed unwanted code

* removed unwanted code

* added playwright config file for debugging cl issue

* removed playwright file
2025-09-04 20:20:05 +05:30
Teddy
4537a54717
fix: remove cursor from tcr pagination (#23214) 2025-09-04 16:46:15 +02:00
Pere Miquel Brull
1e48241f51
MINOR - Add Security, SLA and Terms of Use to Data Contract (#23230)
* jsonschema

* MINOR - Add Security, SLA and Terms of Use to Data Contract

* Update generated TypeScript types

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-09-04 11:51:34 +02:00
Shailesh Parmar
7961a583f5
feat: Added documentation panel for test case form (#23085)
* feat: add TestCaseForm documentation and enhance TestCaseForm component layout

* Refactor TestCaseForm and related components for improved structure and styling

- Updated IDs in TestCaseForm for consistency
- Enhanced styling in TestCaseFormV1 for better layout
- Added onClick handler to SelectionCardGroup for improved interactivity
- Improved ServiceDocPanel to handle markdown loading state

* Enhance TestCaseForm and related components with detailed test definitions and improved styling

* Enhance ServiceDocPanel with EntitySummaryPanel integration and add styling for embedded documentation

* Refactor TestCaseForm and EditTestCaseModalV1 components for improved field handling and integrate ServiceDocPanel for enhanced documentation display

* Add display name section to TestCaseForm and enhance EditTestCaseModalV1 styling

* Enhance EditTestCaseModalV1 and TestCaseFormV1 tests with ServiceDocPanel integration and improved field focus handling

* Enhance ServiceDocPanel tests with improved rendering, markdown fetching, and active field highlighting

* Refactor test case selectors in DataQuality and TestCases specs for improved stability and visibility checks

* fixed failing test

* Fix selectors in DataQualityAndProfiler tests for consistency

* fixed test case
2025-09-04 14:02:54 +05:30
IceS2
ebc67a9f97
MINOR: Add new WorkflowType and converter (#23090)
* Add new WorkflowType and converter

* Update generated TypeScript types

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-09-04 10:11:35 +02:00
Akash Verma
8dd69af269
fix(snowplow) : json-changes (#23217)
* none

* snowplow-json-change

---------

Co-authored-by: Akash Verma <akashverma@Mac.lan>
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2025-09-04 09:34:25 +05:30
Johannes Schnepel
db61f01058
fix missing input sanitization of suggestions query (#23145)
Co-authored-by: Johannes Schnepel <johannes.schnepel@infoteam.de>
2025-09-03 18:55:38 +05:30
Ashish Gupta
f825ce2c26
fix the unit test for the DataContract (#23216) 2025-09-03 17:37:04 +05:30
Ram Narayan Balaji
c97078a3fe
SERVER_ENABLE_VIRTUAL_THREAD is marked false (#23219) 2025-09-03 15:55:04 +05:30
Nithin Teekaramanaa
9dbce9b9e9
Update user_mixin.py (#23167) 2025-09-03 11:28:39 +02:00
Mohit Tilala
f2fd8a9107
Fixes #22452: [Snowflake] Add custom host support for View in Snowflake source url (#23209) 2025-09-03 14:13:03 +05:30
Aniket Katkar
44a39ed475
Chore(UI): Fix advanced search playwright flakiness (#23176)
* Fix the flakiness in advanced search spec

* Add applications docs

* Fix the selection confirmation not working in case of custom property

* Fix the DataContract spec failure

* Fix the errors
2025-09-03 13:30:37 +05:30
celtiaml
e925e14edb
Fixes ISSUE-22200: Fix Spanish translations (#23165)
* Fix Spanish translations

* Fix remaining Spanish translations

* resolve conflict

* revert unwanted removed

---------

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2025-09-03 13:01:49 +05:30
Ram Narayan Balaji
5cb33ce78a
Implementation of Adding Entity Status and Reviewers to assets (#22904)
* Initial Implementation of Adding Status and Reviewers to assets for workflows

* Update generated TypeScript types

* Copilot Review Comments Addressed

* Removed DataProduct Reviewer Inheritance as it is irrelevant

* Commit: Classification has status and reviewers, DataContract uses the same status enums, changed the logic to be APPROVED instead of Active, DataContract can have null status as seen in tests, Changed Workflow to use workflowStatus instead of status as it is contradicting with the approval status, Fixed Tests

* Default for reviewers is null

* Default for reviewers is createSchema

* Addressed CoPilots comments

* Update generated TypeScript types

* Workflow status to workflowStatus in db and migrations

* Revert "Workflow status to workflowStatus in db and migrations"

This reverts commit 676e8789358654bc6f980f855c372f33c22fc40b.

* Changed status to entityStatus in the schema files

* Java Implementation of Default Status, Search Client improvements and Test fixes and new tests

* Adding entityStatus and reviewers in the searchIndex mappings and common attributes

* Data Migration scripts to change the glossaryTerm and dataContract structure

* Update generated TypeScript types

* Fixed zh/spreadsheet index json error

* Fix Postgre migration script

* Changed the entityStatus.json to status.json
Removed the duplicates of entityStatus in the indexMapping
Modified the sample data to take in EntityStatus.Approved instead of ContractStatus.Active

* Update generated TypeScript types

* dummy commit

* Fix UI Build Issues with the New EntityStatus
Fix py tests

* Migrations for all the entities that need entityStatus

* Update generated TypeScript types

* Removed Post Migration scripts

* Fix UI  and py for entityStatus

* Update generated TypeScript types

* Fix: DataContractResourceTest

* Fix UI and py for importing entityStatus

* UI to show and fetch Reviewers

* cleanup

* Removed Overridden SetDefaultStatus in GlossaryTermRepository

* Removed unnecessary validation

* Added entityStatus in search_entity_index_mapping.json

* Fixed DataContractResourceTest

* mvn spotless apply and fix migration scripts

* fix tests

* fix type error

* fix advanced search tests

* Status comparison using enums and supportsStatus to supportsEntityStatus

* mvn spotless apply

* fix merge conflict

* update entity status

* fix tests

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
2025-09-03 12:49:45 +05:30
Sweta Agarwalla
5625260237
fix(test): tag spec flakiness (#23190)
* fix tag spec flakiness

* fix explore filter order
2025-09-03 12:48:01 +05:30
Ashish Gupta
9aa194d877
chore(ui): fix the flaky test around metric spec (#23181)
* fix the flaky test around metric and customize landing

* reverted the customize test

* reverted the unwanted changes
2025-09-03 12:19:27 +05:30
Mohit Tilala
04a3639e47
Fixes #21895 #22363 #22369: Lineage improvements with multiprocessing, stored procedure level temp table processing and lineage filtering with db & schema (#22371)
* MINOR: Improve UDF Lineage Processing & Better Logging Time & MultiProcessing (#20848)

* Fix multiprocessing with better memory management and Airflow 2+ compatibility

* Add support for both multiprocessing and multithreading for relevant platforms

* Handle conflicting cross-db lineage changes of service_name parameter change

* Handle stored proc queries without caching all and increase the thread timeout times to cover 100% lineage

* Fix `get_table_query` inheritance and pylint

* Remove  mocks from db_utils tests

* Better db_utils test and fix the service_names parameter in case of schema_fallback

---------

Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
2025-09-03 11:26:14 +05:30
Karan Hotchandani
6b1184d203
fix search settings playwright (#23201) 2025-09-03 10:39:37 +05:30
sonika-shah
b2b61d7b62
Fix Data Product to asset mapping lost after upgrade (#23195) 2025-09-03 08:26:10 +05:30
satish
dbb44a49d3
Update API proxy path (#23153)
Co-authored-by: Satish <satish@Satishs-MacBook-Pro.local>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2025-09-02 23:46:15 +05:30
Mayur Singal
0e3a550c95
MINOR: Fix column lineage validation (#23075) 2025-09-02 22:00:18 +05:30
Suman Maharana
20e18d4f9f
Add ssl support to hive (#22831)
* Add ssl support to hive

* Added missing ts files

* Added version to pure transport

* Added Tests

* fix tests add missing files
2025-09-02 20:13:30 +05:30
Adrià Manero
d33ffe40a3
Document current status of ChangeEventScheduler and Race Condition issue (#23198) 2025-09-02 16:10:18 +02:00
Chirag Madlani
841a03566e
feat(ui): support add edit for semantic rules (#23092)
* feat(ui): support add edit for semantic rules

* support QueryBuilder with tree change

* Update generated TypeScript types

* update querybuilder widget and add tests

* fix conflicts for tree rendering

* add validation for sematic rules

* fix unit tests and address comment

* fix data contract tests

* add unit tests for contract components

* fix styling and add tests

* address comments

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-09-02 18:45:44 +05:30
Mayur Singal
08ee62a198
MINOR: Add Unstructured Formats Support to GCS Storage Connector (#23158) 2025-09-02 18:22:39 +05:30