4809 Commits

Author SHA1 Message Date
Shailesh Parmar
14b6bd3e6f
Add unit-test coverage and loading state improvement (#20423) 2025-03-26 13:44:10 +05:30
IceS2
8c7774e6ae
Fix LongRunning Steps Retriggering Endlessly (#20421) 2025-03-26 08:39:08 +01:00
Sweta Agarwalla
a2804a8933
Update field changes (#20425)
* update field changes

* fix sonar issue
2025-03-26 10:22:06 +05:30
Mohit Yadav
7e731648ab
Add Data Product Lineage (#20400)
* Add Data Product Lineage

* Migrate Data Products

* add null check for entity

* add data product layer

* Add index specific conditions

* add tests

* update nlp icon

* Add missing conditions

---------

Co-authored-by: karanh37 <karanh37@gmail.com>
2025-03-26 10:02:00 +05:30
Chirag Madlani
3245b2d98e
Entity page redeisgn (#20384)
* initial commit

* support new layout for Table details page

* update tab design for detail pages

* support search withing table

* modify table desing as per mocks

* fix filtering layout

* improvement around some tables as per design

* modify more table as per new design

* minor fix around table padding in top

* modify the pagination for the number antd pagination one

* have changes the description rendere to richTextEditorPreviewNew one for handling 2 line description in table

* updated owner render in tables

* fix unit test failure

* finish layout update for entity page

* fix unit tests

* make the table header fix

* fix container tests

* update styles

* fix the unit test and table css issue

* minor revert

* update

* address comments

* fix unit test

* fix some playwright test

* fix playwright tests

* fix container spec

* fix table spec

* fix playwright tests

* fix playwright tests

* fix playwright tests

* minor clean up around tables

---------

Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2025-03-26 01:49:12 +05:30
Aniket Katkar
f3e90827d6
Improvements: Implement the workflow status based placeholders for platform insight widget (#20369)
* Implement the workflow status based placeholders for PlatformInsights widget

* Add the workflow status banner

* feat(ui): enhance ingestion components with collate agent functionality

- Added support for loading and displaying collate agents in the Ingestion component.
- Updated Ingestion interface to include new props for collate agent management.
- Implemented loading state for ingestion runs and collate agents in IngestionListTable and IngestionRecentRuns components.
- Integrated pagination handling for collate agents in ServiceDetailsPage.
- Improved rendering of pipeline types in IngestionListTable utility functions.

* feat(ui): enhance Ingestion component with agent counts display

- Added agentCounts prop to Ingestion component to display counts for collate agents and metadata.
- Updated Ingestion interface to include agentCounts.
- Modified ServiceDetailsPage to compute and pass agentCounts to Ingestion.
- Improved rendering of sub-tab options in Ingestion component to utilize agent counts.

* feat(ui): update SVG assets and enhance error handling in Service Insights

- Modified existing SVG assets for improved rendering and added new icons: key-hand, no-tier, and security-safe.
- Enhanced AssetsTabs component to utilize updated placeholder icons for no data scenarios.
- Updated TotalDataAssetsWidget to display a custom error placeholder when no records are found.
- Introduced a new utility function to determine the appropriate placeholder icon based on chart type.
- Added a new CSS class for text color styling.

* feat(ui): add refresh functionality to Ingestion component

- Introduced a refresh button in the Ingestion component to reload the agents list.
- Updated Ingestion interface to include a new prop for the refresh function.
- Enhanced ServiceDetailsPage to implement the refresh logic for different agent types.
- Added styling for the refresh button icon in the associated LESS file.

* localization changes

* feat(ui): refactor ingestion components for improved status handling and styling

- Moved query parameter definitions into relevant functions for better encapsulation in IngestionListTable and IngestionRecentRuns components.
- Updated styling for ingestion status badges to enhance visual clarity and consistency.
- Introduced new color variables for improved theming in LESS files.
- Added a delay mechanism for fetching pipeline status in MetadataAgentsWidget to account for service response times.

* Fix the duplicate variables

* Fix the less variable

* Add large table icon and update placeholder icons in Service Insights

- Introduced a new SVG icon for large tables.
- Updated placeholder icons in AssetsTabs and TotalDataAssetsWidget components to use the new icon.
- Changed the color class for placeholder icons from 'text-grey-8' to 'text-grey-14'.
- Refactored the getServiceInsightsWidgetPlaceholderIcon function to accept additional parameters for customization.

* Implement the placeholder messages for service insight widgets

* add the remaining widget descriptions for service insights

* Fix the unit tests

* localization changes

* Fix the app status not showing properly on the external apps logs page

* add createdBy field in test case results

* Fixed sonar issues

---------

Co-authored-by: ulixius9 <mayursingal9@gmail.com>
2025-03-26 00:12:27 +05:30
Sweta Agarwalla
fd3f2a2a78
fix alert issues (#20416) 2025-03-26 00:11:59 +05:30
Shrushti Polekar
1c9268d913
Minor: Links for entity card on Activity Feed (#20415)
* added entity links for entity cards

* address pr comments
2025-03-25 21:39:45 +05:30
Shrushti Polekar
6773e015fa
Fix : Delete user playwright test (#20399)
* fix delete user playwright test

* alert fix for failing test
2025-03-25 21:33:31 +05:30
Shrushti Polekar
801788072e
Minor: Update TagsViewer to show read more and less tags in Summary Cards (#20401)
* update TagsViewer to show read more

* fix failing unit test
2025-03-25 18:49:33 +05:30
Shrushti Polekar
b69f1ace24
fix approve reject btn styles (#20409) 2025-03-25 18:48:48 +05:30
Pranita Fulsundar
007580318b
fix: added service icon (#20414) 2025-03-25 17:36:28 +05:30
Sriharsha Chintalapani
ccd5f12daa
Fix #20200: Import/Export recursively at Database Service, Database, … (#20201)
* Fix #20200: Import/Export recursively at Database Service, Database, Schema

* Recursive import/ export - Fixed errors

* Recursive import - Column not getting updated fixed

* Bug fix - Error message when data length not given for varchar

* Recursive import: Flag added, parsing errors solved

* recursive import: fixed bugs and tests

* added recursive flag for bulk/edit import/export and created entity type filter for easy access

* dismiss the loading state if, dry run fails and websocket doesn't have error in it

* Recursive false for bulk edit

* Recursive import: db service level

* Recursive import: fixed tests

* Recursive import: bug fix

* Recursive import: fixed bug

* support recursive validation and skip bulkImport playright spec and fix some bulk edit playwright test

* Recursive import: bugs

* Recursive import: nested entity bug

* Data type made mandatory for column

---------

Co-authored-by: aji-aju <ajithprasad770@gmail.com>
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2025-03-25 17:21:43 +05:30
Aniket Katkar
4b3ce930aa
I worked on fixing the faulty JSON schema and missing UI types (#20407) 2025-03-25 14:46:07 +05:30
IceS2
254420bbb1
MINOR: Update Default Configurations (#20398)
* Update Default Configurations

* Update Airflow Default Scheduling

* Update Airflow Default Scheduling
2025-03-25 09:53:01 +01:00
Pranita Fulsundar
fc2133dd82
fix(ui): new settings card layout and new icons (#20393)
* fix: setting card layout and new icons

* style: icon container height and width

* remove unnecessary icons

* fix height of card
2025-03-25 12:10:16 +05:30
dependabot[bot]
c0f819058d
Chore(deps): Bump @babel/runtime-corejs3 (#20196)
Bumps [@babel/runtime-corejs3](https://github.com/babel/babel/tree/HEAD/packages/babel-runtime-corejs3) from 7.15.3 to 7.26.10.
- [Release notes](https://github.com/babel/babel/releases)
- [Changelog](https://github.com/babel/babel/blob/main/CHANGELOG.md)
- [Commits](https://github.com/babel/babel/commits/v7.26.10/packages/babel-runtime-corejs3)

---
updated-dependencies:
- dependency-name: "@babel/runtime-corejs3"
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2025-03-25 10:19:36 +05:30
Ayush Shah
a9d6b5760d
Fixes #18346: feat(BigQuery) Enhance project ID discovery and ADC support (#20085)
* Refactor SQL column processing and enhance BigQuery project ID handling

* Introduced a new `process_column` function in `sql_column_handler.py` to streamline column processing logic.
* Updated `BigquerySource` to improve project ID retrieval from service connections, ensuring compatibility with various credential types.
* Added handling for nested columns in BigQuery schema processing.
* Enhanced error handling and logging for better debugging during project ID setup.

* Add support for GCP Application Default Credentials in BigQuery ingestion

* Enhanced `BigquerySource` to include handling for GCP Application Default Credentials (ADC).
* Updated JSON schema for GCP credentials to define `gcpADC` and its properties.
* Improved logging for credential setup in `set_google_credentials` function.
* Added comments and TODOs for future enhancements related to project ID fetching from the resource manager.

* Update .gitignore to include cursor rules files

* Added .cursorrules and .cursor/ to the .gitignore to prevent tracking of cursor rule files in the repository.
* This change helps maintain a cleaner repository by excluding unnecessary files from version control.

* refactor: Bigquery Credentials to allow multiple project ids

* fix: Handle unknown array data types in SQL column processing
2025-03-24 15:31:10 -07:00
Sriharsha Chintalapani
a510ac0a27
Update en-us.json (#20203) 2025-03-24 22:10:19 +05:30
Shailesh Parmar
81f0f08be2
Feat: assets upload supporting PR (#20385)
* Feat: added support for assets upload

* updated ui for file attachment

* combine extention

* refactore fileNodeView

* fixed failing unit test
2025-03-24 22:01:34 +05:30
IceS2
deca9f9574
Fix Workflow State not Updating on Exception (#20395) 2025-03-24 09:26:05 -07:00
Chirag Madlani
e91f8a262f
fix: openmetadata-ui/src/main/resources/ui/package.json & openmetadata-ui/src/main/resources/ui/yarn.lock to reduce vulnerabilities (#20391)
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JS-AXIOS-9403194

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
2025-03-24 09:25:05 -07:00
Dhruv Parmar
52e07cf2c3
Redesign : certificates and source URL (#20368)
* Redesigned certificate || source url

* updated extrainfolabel

* updated extrainfolabel

* fixed metricHeaderInfo|| gave consistent spacing

* fixed test cases

* fixed metric text overflow

* fixed tests

* fixed comments

* fixed sonar cases
2025-03-24 20:52:39 +05:30
Karan Hotchandani
30239bdf05
fix - application configurations for reverse metadata (#20320)
* fix query builder state for custom properties

* update the app run records for external apps

* fix styling of status

* add zoom and pan for minimap

* fix sonar error
2025-03-24 18:44:41 +05:30
Gyowanny P. Queiroz
6e3c276478
Ingestion agent updates (#20240)
* updated for ingestion agent

* update playwright

* update for connection tab

* update test

* Update mappers with ingestionAgent

* Docs: 1.6.6 Release Updation (#20234)

* Docs: 1.6.6 Release Updation

* Docs: Docker and python version Updation

---------

Co-authored-by: Rounak Dhillon <rounakdhillon@Rounaks-MacBook-Air.local>

* DOCS - Airflow Base URL for lineage backend (#20255)

* FIX #20250 - Suggestions to handle mutually exclusive tags (#20251)

* UI improvements

* Update ingestionAgent relationship on service entity updater

* Sweta - UI improvements

* updated UI elements

* updated as per comments

* minor fixes

* update test

* remove agent from create pipeline

* remove agent from create pipeline

* remove agent from create pipeline

---------

Co-authored-by: Sweta Agarwalla <swetaagarwalla13@gmail.com>
Co-authored-by: Rounak Dhillon <162090200+RounakDhillon@users.noreply.github.com>
Co-authored-by: Rounak Dhillon <rounakdhillon@Rounaks-MacBook-Air.local>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2025-03-24 14:11:52 +01:00
Shrushti Polekar
1c467d0ee1
error placeholder bg fix (#20394) 2025-03-24 18:32:15 +05:30
Teddy
5a3fc2cfa4
feat: add created by for test case entities (#20304)
* feat: add created by for test case entities

* migration: createdBy sql migration
2025-03-24 13:13:01 +01:00
sonika-shah
3684a2661b
Add Announcement Count to Feed Count API (#19600)
* Add Announcement Count to Feed Count API

* add inactive and active announcement count
2025-03-24 17:37:44 +05:30
Chirag Madlani
d0f4080e37
fix(test): customize navigation playwright (#20388) 2025-03-24 14:54:43 +05:30
Sweta Agarwalla
b35ee783b2
Alert Updates (#20360)
* addressed comments

* updated alert reset condition

* update alert styles

* update inline alert styles

* fix inline alert test

* minor updates

* remove icons

* update theme colors
2025-03-24 10:22:45 +05:30
Shrushti Polekar
6e8fe6ff8f
Feat : Notification Update for glossary term approval (#20382)
* update notification for glossary term approval

* address pr comment

* fix sonar cloud failure

* minor fix

* playwright test

* playwright fix
2025-03-23 22:26:28 +05:30
Pranita Fulsundar
a70017d430
feat: glossary table having approve and reject task actions (#20269)
* feat: approve and reject action for glossaryTerm

* fix: getTaskData logic and status icons

* fix: tests

* fix: approve/reject button style and test cases

* update position of status filter

* style: update color variables

* remove extra fetchTasks call

* fix: logic of update glossaryTerm after status change

* fix: updateGlossaryTermStatus function

* fix: update glossary term status
2025-03-23 20:40:30 +05:30
Shrushti Polekar
2fe5d7e865
Landing page activity feed ui revamp (#20265)
* landing page activity feed ui update

* fix failing unit test

* feeds widget drawer update

* entity name update

* strong formatting issue fix

* fix diff view issue for task card

* fix feedspanel issue for incident manager

* minor activity feed tab css updates

* minor fix

* incident manager css fix

* assignee issue fix

* fix sonarcube issues

* failing test fix

* failing test fix and minor fix

* css fixes for header links

* owners feed card update

* localization file updates

* fix user.spec test failures

* task tab more btn action

* minor tab fix

* chip bg color update

* minor css fix

* three panel layout update for glossary term tab

* address pr comments

* address pr comments

* address pr comments

* address pr comment

* diff view fix

* resolve conflict

* minor change

* playwright failure fix

* fix playwright failure

---------

Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2025-03-23 12:13:56 +05:30
Chirag Madlani
4a1b0dfa45
feat(ui): persona fix for governance and navigation (#20355)
* feat(ui): persona fix for governance and navigation page

* minor update

* fix tests for governance

* fix data asset playwright

* fix transition

* fix navigation with switch

* fix tests

* update navigationItem json schema

* fix type generation

* fix styling

* support custom navigation

* skip observability alert

* fix unit tests

* update tests

* fix columns popup

* fix tests for left side bar

* fix tests

* fix tests
2025-03-22 14:20:07 +05:30
Ashish Gupta
5a8be4b2e7
MINOR: fix the display not render in lineage drawer (#20381)
* fix the display not render in lineage drawer

* minor optimization
2025-03-22 14:00:43 +05:30
Chirag Madlani
aa5f655e79
feat(ui): update navbar and leftsider bar with new design change (#20354)
* feat(ui): update new layout globally

* update

* update left side bar and nav bar

* update search bar design

* update layout

* update style

* update layout

* add nlp suggestion changes

* fix conflict

* add nlp search query

* update query

* fix styling

* update styling

* remove home

* fix logo

* close submenu upon selection

* fix selected styling for submenu

* fix notification condition and icon

* fix tests

* address comments

* fix left sidebar tests

* Add Aggregations

* fix domain selection issue

* update nlp search in explore page

* Synced ES / OS

* update code to remove _nlq request to es/os

* NLP Search: Improve LLM Prompt

* Remove unnecessary methods in IndexMapping and cleanup SearchRepository warnings; Update LLM search prompt

* Clean up code and pass search config for NLQService

* add nlp query logic on search

* Fix prompt in searchSettings

* Add api to check nlq if enabled

* fix minor feedbacks

* update api calls on explore

* remove from classbase

* add explore redesign

* fix tests

* Add caching for NLQ searches and support filters

* Improve the NLQ prompt; add custom properties

* pass nlq PR only

* update alias to use data asset

* fix tests

* fix explore styles

* fix domain tests

* Cache NLQ query only if we return results

* Add prompts for no tags, no description

* make nlq service protected

* fix domains

* fix null query on es aggregation endpoint

* remove domain

* fix tests

* fix conflicts

---------

Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
2025-03-21 23:59:19 +05:30
Shrushti Polekar
33924fbc94
Bug fix for user profile page for Mentions Tab rendering and Diff View issue (#20351)
* bug fix for user profile page

* removed index from key
2025-03-21 23:31:40 +05:30
Shrushti Polekar
d60fd97e17
fix comment editor issue (#20362) 2025-03-21 22:52:40 +05:30
Chirag Madlani
fc30e69442
fix(ui): potential fix for okta login, clear state for avoid login errors (#20379)
* fix(ui): okta login clear state for avoid errors

* add fallback option
2025-03-21 20:35:15 +05:30
Pranita Fulsundar
d317081460
fix(ui): fixes for search settings with ranking (#20359)
* fix: styles, search preview call and entityType for field value boost

* style: settings cards layout

* style: settings cards icon size

* fix: global searchSettings get call

* feat: add field value boost for entity page

* fix: add matching fields behaviour

* fix: save term boost for global settings

* test: add unit tests and playwright tests

* style: setting item card layout

* fix: playwright test

* minor: display factor inside fieldvalueboost

* minor: addressed pr comments
2025-03-21 19:03:12 +05:30
Chirag Madlani
03f0aa37f4
feat(ui): Lineage export as PNG (#20092)
* feat(ui): allow export as pdf from element directly

* supported lineage export as pdf

* added header in pdf file of entity name

* move the export logic in the export provider and have export type selector in modal

* added playwright test for export pdf

* added png export, and convet lineage pdf export to png

* minor optimization

* remove pdf lib and modify code to extend further and added loading state

* fix sonar issue

---------

Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2025-03-21 15:12:19 +05:30
Aniket Katkar
a7305b22cd
Playwright: Fix the AUT failures occurring due to entity header and service agents default tab changes (#20361) 2025-03-20 21:53:17 +05:30
Chirag Madlani
304f97f3dd
Revert "feat(ui): update navbar and leftsider bar with new design change (#20…" (#20353)
This reverts commit 5531930ccc6a395948e9b534582a68558d2d0cc7.
2025-03-19 20:01:57 +05:30
Chirag Madlani
5531930ccc
feat(ui): update navbar and leftsider bar with new design change (#20267)
* feat(ui): update new layout globally

* update

* update left side bar and nav bar

* update search bar design

* update layout

* update style

* update layout

* add nlp suggestion changes

* fix conflict

* add nlp search query

* update query

* fix styling

* update styling

* remove home

* fix logo

* close submenu upon selection

* fix selected styling for submenu

* fix notification condition and icon

* fix tests

* address comments

* fix left sidebar tests

---------

Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
2025-03-19 19:52:11 +05:30
Sweta Agarwalla
cd4892b7c0
update yarn.lock to fix the issue from --frozen-lockfile (#20352) 2025-03-19 13:00:07 +00:00
Dhruv Parmar
092cb94fb8
MINOR : Fixed Header component (#20340)
* fixed header displayname ||vote buttons || edit buttons

* replaced hashcode with varibalenames

* style changes

* fixed displayname

* minor changes

---------

Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
2025-03-19 12:38:33 +00:00
Imri Paran
76c92d8498
ci: create a junit test report for CI (#20257)
- include the junit for UI in the test report in github actions
- this will solve the false positive for "publish test report" and reduce feedback loop for getting failing tests
2025-03-19 10:29:39 +01:00
Teddy
52382d2737
ISSUE #19185 -- Allow user to choose non random sample (#20299)
* feat: allow user to turn off rnadomized sample

* style: ran python linting

* fix: models default value for randomizedSample

* style: ran linting

* doc: move config to advanced
2025-03-19 08:42:00 +01:00
Pranita Fulsundar
7451e1a0f8
feat(ui): search settings with ranking config (#20331)
* feat: search settings with ranking config

* fix: test case for search preview
2025-03-19 06:43:09 +00:00
Mohit Yadav
d4631d6d1c
Add Post Call for Aggregate (#20220)
* Add Post Call for Aggregate

* update aggregation calls to post for lineage

* add platform lineage view

* add unit tests

* cleanup

* update platform lineage page

* add icon for other entities

* cleanup

* Add Lineage Migration

* Move fetch all service to common class

* Add view for service or domain

* remove source field

* add validation for inputs

* add platform lineage page

* fix tests

* Checkstyle fix

* fix tests

* resolved conflicts

* fix pytest

---------

Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: sonikashah <sonikashah94@gmail.com>
2025-03-19 12:07:05 +05:30