4793 Commits

Author SHA1 Message Date
Pere Miquel Brull
467534c088
Revert "Fixes 20063: Allowing to trigger an app with a payload (#20056)" (#20155)
This reverts commit 9642c7353813be7a450bba4148d5b4eb751b1c33.
2025-03-10 06:59:29 +01:00
Mohit Yadav
e9ab9dc985
Lineage Improvements (#19639)
* - typo update

* - Update lineage model and api

(cherry picked from commit c5cce2b0c7c1be7ba654bfc2677da0d05215a895)

* - Adding patch

* - spotless fix

* Add Migration For createdAt , createdBy, updatedAt and updatedBy

* Moved classes from Elastic Client to Lineage Graph Builder

* Update to use correct depth

* remove toCondition

* Fix Downstream Lineage

* moved not so cool things here and there

* spotless-failures

* call with direction

* add upstream depth with + 1 for 0th node

* Fix Exports

* Fix Exports from and size

* parse lineage in ui

* Add per entity pagination

* Added per entity pagination

* Fix Async Export

* Fix Java Merges

* Fix merge conflict

* Fix missing upstream nodes

* lineage ui initial commit

* Fix Pagination for upstream

* Fix Values

* fix load more loading

* cleanup

* fix loading of nodes

* fix load more

* Fix Direction Values

* update expand collapse logic

* Fix Deletion Issue

* Fix Pipeline Lineage

* show pipeline as a node

* Use Fqn Hash to find entities is es for lineage

* update lineage

* Add Lineage for Pipeline to look for as edge and node

* Layer and size conditions for upstream and downstream

* Add include source fields in lineage request

* redesign controls component

* add lineage fixes

* fix tests

* Fix node

* Fix Some Failing Test on Lineage

* Java Spotless Fix and added missing relation check on migration

* Missing conflict changes

* fix conflicts

* added missing keys

* update tests

* Add Service Information in service indexes

* Add Domain Lineage

* Add domain lineages

* fix tests

* Fix Metric Entity Service Error

* Maintain Asset Count for entities adding service and domain lineage

* Update to Doc Id and add details to search

* Cleanup Service and Domain automatically

* fix types

* Update review comments

* fix icon sizes

* Update Services Index wit upstream lineage

* add service view

* Fix Service Name missingFix Service Name resolution in LineageRepository

Update the method to correctly retrieve the service name for the "fromEntity" by specifying the FIELD_SERVICE path. This resolves an issue where the service name was not properly populated.

* - Add docUniqueId to lineage data and update related queries
- Added lenient Object Mapper for search index to entities mapping

* - Fix LineageResourceTest failing due to changes on Lineage Storage

* - Update Lineage Details

---------

Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
2025-03-10 10:09:29 +05:30
Ashish Gupta
11d8e93088
fix error populating on suggestion more button click (#20135) 2025-03-07 21:40:26 +05:30
Aniket Katkar
95fdc7adc4
Fix the service insights card background color (#20146) 2025-03-07 21:39:42 +05:30
d-czaj
b52ccc3c0e
Added a lot of translations (#20021) 2025-03-07 16:07:22 +00:00
IceS2
9642c73538
Fixes 20063: Allowing to trigger an app with a payload (#20056)
* Allowing to trigger an app with a payload

* added option to pass custom payload to triggered job

* feat(apps): add custom config to trigger

- added custom config for app triggers

* added handling for configuration validation on apps

* - removed `oneOf` from app configuration scheme
- generated ts files for apps

* added CONFIG_OVERRIDE_KEY

* format

* fixed app config key

* format

* format

* fixed python app runner to work with new schema

---------

Co-authored-by: sushi30 <imri.paran@gmail.com>
2025-03-07 21:17:05 +05:30
Aniket Katkar
24e67e8608
Epic: Day 1 service (#19914)
* Add the Platform Insights for the service details page

* Add new localization translations

* Fix the styling

* Add Data Quality widget in the service details page insights tab

* Remove the unused localization keys

* Fix the border radius

* Update the border color

* Add Total Data Assets widget

* localization changes

* Fix the Tier insights chart

* Add Tier and PII Distribution charts

* Localization changes

* Fix the calls for special fqn

* Limit the DataQualityWidget only to the DB services

* Add the MostUsedAssetsWidget

* Add missing loaders to the widgets

* Localization changes

* Update the API call for most used assets

* Add most expensive queries widget

* Localization changes

* Move the widgets logic to classBase for better customization

* Fix the font size

* add charts backend

* fix initialisation

* fix migration

* pii chart

* Add assets_with_tier DI system chart

* Fix the service insights charts

* localization changes

* spotless

* filter to be regex instead of literal compare

* Fix stylings for Most Used Assets widget

* Fix Unit tests

* Remove the New widgets

* Delete unused utils

* Fix the ServiceEntity tests

* Move SystemChartType to enum file

* Worked on comments

* Refactor ServiceInsightsTab and TotalDataAssetsWidget for improved code organization

* Refactor PlatformInsightsWidget and improve type safety

- Added PlatformInsightsWidgetProps interface for better type definition
- Updated PlatformInsightsWidget component to use the new interface
- Simplified component props typing
- Minor code cleanup in TotalDataAssetsWidget
- Updated Fqn utility method with a more precise regex replacement

* Refactor ServiceInsightsTab to use serviceDetails prop and remove Fqn utility method

- Updated ServiceInsightsTab to accept serviceDetails prop instead of using useFqn hook
- Removed Fqn.getNameWithoutQuotes method
- Updated PlatformInsightsWidget and TotalDataAssetsWidget to use serviceName prop
- Added ServiceInsightWidgetCommonProps interface for shared prop typing
- Simplified service name handling across components

* Refactor ServiceInsightsTabUtils to use local i18n import

- Updated import for internationalization to use local i18next utility
- Removed direct import of 't' from 'i18next'
- Imported i18n from local utility and destructured 't' method

* Improve type safety in TotalDataAssetsWidget component

- Added Readonly type to ServiceInsightWidgetCommonProps prop interface
- Enhanced type safety for component props

* add postgres migrations

---------

Co-authored-by: ulixius9 <mayursingal9@gmail.com>
2025-03-07 18:40:10 +05:30
Shailesh Parmar
c65a504ffd
fix #19869: Other columns are not visible when testSuite name is large (#20121) 2025-03-07 12:37:04 +05:30
Shrushti Polekar
70183eb11d
Fix : User profile page revamp UI fixes (#19975)
* ui fixes

* ui fixes for placeholders

* minor fix

* placeholder updates for activity and task tab

* placeholder component fixes

* minor fix

* bug fix for task action permission and css fix

* feed card width issue fix

* loader issue

* glossary page issue fix

* localization file changes

* entity icon and popover card on hover

* fix RichTextEditorIssue

* minor fix

* fix avatar

* fix avatar

* chip component fix

* alignment issue fix

* minor fix

* emoji tooltip fix

* action req btn fix

* avatar group dropdown and loaders

* test updates

* minor fixes

* minor fixes

* minor fix

* css fix

* minor fix

* playwright test cases for user details

* minor fix

* minor css fix

* minor css fix

* minor css fix

* minor fix

* minor fix

* edit persona domain team ui fixes

* minor fix

* minor fix

* fix the extra api call for feed fecthing fix due to in view

* diffview view more issue fix

* loader and popover issue fix

* popover for comment headers

* localization changes

* localization file changes

* minor fix

* minor fix

* disbale task filter for mentions subtab

* refactor code

* ui fixes

* address pr comments

* bg color changes and adddress pr comments

* minor fix

* design change

* task tab details design change

* task tab card changes

* style changes

* style change for testcase failure

* profile changes

* remove wrong playwright test

---------

Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2025-03-07 01:08:44 +05:30
Mayur Singal
c1592b54c5
Capture Query Cost (#19991) 2025-03-06 19:49:59 +05:30
Ashish Gupta
2704ed1900
fix wrong suggestion count being fetched on table change (#20091) 2025-03-06 18:53:07 +05:30
Ashish Gupta
f29bad1c1c
fix the application re-loading on profile page team or role changes (#20108) 2025-03-06 18:24:44 +05:30
Suman Maharana
137f86c00d
Day1 - Pipeline Usage (#19960) 2025-03-06 18:19:42 +05:30
Chirag Madlani
28a69eaa27
chore(ui): add loggedInAPI to show actual error instead generic one (#20110) 2025-03-06 17:32:43 +05:30
Ayush Shah
064b43f2e0
MINOR: Modify from Profiler to Auto Classification for sample data (#20101)
* Docs: Modify from Profiler to Auto Classification Documentation Link

* Docs: Import AUTO_CLASSIFICATION_DOCS constant for documentation link
2025-03-06 15:33:30 +05:30
Ashish Gupta
50025a68a0
#19879: support column customization in service pages (#20072)
* supported column customization for tables

* remaning localization changes

* added unit test and some code optimization

* file import fix

* fix the column re-ordering

* code optimization

* updated playwright test for the glossary table customization

* change the functionality to passing the default and static colum to Table and not in the colums object

* fix the issue for columns not visible due to the filter condition

* support column customization in service pages

* minor leftover

* changes done as per comments

* fix sonar issue

* fix unit test
2025-03-06 11:27:50 +05:30
Chirag Madlani
a65b4b4200
chore(ui): fix package.json with deps (#20083)
* chore(ui): fix package.json with deps

* fix resolutions

* revert dompurify resolution
2025-03-06 10:44:57 +05:30
Ashish Gupta
d8255b42d7
#19879: supported column customization for tables (#20049)
* supported column customization for tables

* remaning localization changes

* added unit test and some code optimization

* file import fix

* fix the column re-ordering

* code optimization

* updated playwright test for the glossary table customization

* change the functionality to passing the default and static colum to Table and not in the colums object

* fix the issue for columns not visible due to the filter condition

* changes done as per comments
2025-03-05 17:14:05 +05:30
Chirag Madlani
1d65c9e656
[Snyk] Fix for 2 vulnerabilities (#19825)
* fix: openmetadata-ui/src/main/resources/ui/package.json & openmetadata-ui/src/main/resources/ui/yarn.lock to reduce vulnerabilities

The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JS-JSONPATHPLUS-8719585
- https://snyk.io/vuln/SNYK-JS-DOMPURIFY-8722251

* fix the sonar issue

---------

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2025-03-05 16:25:36 +05:30
Karan Hotchandani
d805ec9590
fix search query for non admin pages (#20078) 2025-03-05 15:37:40 +05:30
Shailesh Parmar
47d285abe5
playwright: fixed flakiness in incident manager test (#20057) 2025-03-05 15:37:30 +05:30
Pere Miquel Brull
55d7e50441
MINOR - Add and remove data products Actions in Automator (#19948)
* MINOR - Add and remove Data Product assets in Automator config

* MINOR - Add and remove Data Product assets in Automator config

* domain mixin

* build ref

* build ref

* create types

* fix tests

* fix conflicts

---------

Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
2025-03-05 07:11:17 +01:00
Sweta Agarwalla
ff63ec55bc
update block editor url to open when clicked (#20068) 2025-03-05 11:13:09 +05:30
Karan Hotchandani
fb1283b8a7
fix external app logs (#20066) 2025-03-05 11:04:03 +05:30
Ashish Gupta
9e13ff6be8
fix the user spec failure for the dataConsumer user permission (#20055) 2025-03-04 08:46:01 +05:30
Imri Paran
4ada5b7bbf
Fixes 1048: Added changeSummary for tables (#19887)
* feat: add changeContext to changeDescription

* rev: unintended changes

* rev: unintended changes

* feat: implemented change summary field

- implemented ChangeSummarizer which handles change summaries based on tracked fields and list of fields changes.
- added a changeSummary field to table entity which captures change metadata like user, time and source
- added the changeSource as a field to updater. maybe breaks things in collate.

* use additional properties instead of existingJavaType otherwise types dont get created in java.

* added getUpdater(T original, T updated, Operation operation) to not break collate

* updated API docs

* - fixed null access of changeSummary
- added changeSummary to table index

* fix: PR comments

- added changeSummary as nested field in changeDescription
- removed unneeded migrations
- added changeSummary to table search index

* reverted table.json and TestUtils.java

* reverts
2025-03-03 16:35:23 +01:00
Aniket Katkar
0307d20877
Fix the EntityDataConsumer test flakiness (#20045) 2025-03-03 20:38:19 +05:30
Ashish Gupta
338bb9e4ff
fix tour.spec AUT failure (#20053) 2025-03-03 20:22:23 +05:30
Sweta Agarwalla
8d46bca952
Update page title (#20035)
* update page title

* update title

* update titles

* updated locales

* update titles

* update locales

* update mocks for DocumentTitle

* update keys

* update key

* update test

* fix sonar issue
2025-03-03 14:51:32 +05:30
Ashish Gupta
fe7ce3d11a
#18876: fix the wrong suggestion count being displayed on description (#19483)
* fix the wrong suggestion count being displayed on description

* added button to generate all the suggestions

* minor placement of button change

* added some unit test

* added playwright test for it

* minor changes

* change the button design
2025-03-03 11:56:15 +05:30
Aniket Katkar
a058579aaf
Fix the generated types (#20042) 2025-03-02 16:18:18 +05:30
Chirag Madlani
fa6da999ec
[Snyk] Security upgrade axios from 1.7.4 to 1.7.8 (#19927)
* fix: openmetadata-ui/src/main/resources/ui/package.json & openmetadata-ui/src/main/resources/ui/yarn.lock to reduce vulnerabilities

The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JS-AXIOS-6671926

* Update the axios version to 1.7.9 since 1.7.8 was messing up with type validations in multiple files

---------

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
2025-03-02 16:17:39 +05:30
Ashish Gupta
f59252cd52
#19881: supported bulk import in OSS (#19982)
* supported bulk import in OSS

* remove duplicate file and fix sonar issue

* fix playwright and sonar issue

* remove the constant file from bulk import

* remove the src file method reference from the playwright folder

* fix the file name
2025-03-02 16:14:19 +05:30
Chirag Madlani
30a8d64959
feat(ui): support /logout path to perform logout from api redirect (#20040) 2025-03-02 15:52:50 +05:30
Chirag Madlani
9331a526ea
fix(ui): tour page issue clicking on tour from welcome screen (#20038)
* fix(ui): tour page issue clicking on tour from welcome screen

* fix infinite login for unauthenticated router

* improve tour tests
2025-03-02 13:00:33 +05:30
Karan Hotchandani
1cbbe9a7c0
fix generated types (#20033)
* fix generated types

* fix path

* fix unit tests
2025-02-28 15:55:40 +00:00
Gyowanny P. Queiroz
fc90a13e08
GEN-2891 - Add ingestion agent relationship to service entities (#19946)
* GEN-2891 - Add ingestion agent relationship to service entities

* Revert relationship storing

* Centralize ingestion entity relationship logic

* Add default implementation

* Change relationship type
2025-02-28 09:35:33 -03:00
Chirag Madlani
36f939af5f
fix(ui): #20017 remove duplicate activity feed providers (#20018)
* fix(ui): #20017 remove duplicate activity feed providers

* fix unit tests

* fix incident manager
2025-02-28 16:57:05 +05:30
Dhruv Parmar
810a33e4d0
Fixes #19860: Added Diagnostic tab to display diagnostic information || Added Sync offset button (#19980)
* fixed: pagination for deleted users

* fixed test cases

* fixed comments

* used admin token to authenticate

* feature: added Diagnostic info tab

* fixed comments

* fixed github comments

* fixed github comments

* fixed github comments

* fixed playwright cases

* fixed playwright cases

---------

Co-authored-by: Dhruv parmar <dhruv@Dhruvs-MacBook-Air.local>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
2025-02-28 15:54:25 +05:30
Ashish Gupta
fb1ca6848c
fix aut playwrigth failure (#19987)
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2025-02-28 00:23:46 +05:30
Keshav Mohta
7e52310480
Refactor: Reverse Ingestion Pipeline (#19988)
* refact: removed serviceId and added service

* fix: required in reverse ingestion

* fix: types
2025-02-27 15:29:42 +01:00
Chirag Madlani
ab7666b8fe
Feat persona table page (#18550)
* support table details customization page

* update widget preview

* fix schema tab

* fix issue around save layout across tabs

* fix unit tests

* fix tab label with customized one

* misc fixes for persona edit

* update

* update topic with persona changes

* support dashboard data model

* support data assets with customization

* support pipeline with customize page

* fix console errors

* fix tests

* fix sonar cloud issues

* update code for data assets

* remove fqn prop as

* create generic tabs

* update

* support customization for domain page

* update

* fix errors

* fix tests

* update

* fix detail pages

* fix playwright tests

* fix unit tests

* fix unit tests

* update generic tab

* update

* fix tests

* fix tests

* fix data test id for tags and glossary terms

* fix version pages

* fix unit test

* update page enum with api collection

* update custom property to use generic provider

* fix api collection & endpoint

* fix apiCollection and apiEndpoint customization

* fix container test and fix sonar

* fix tests

* fix delete playwright

* support metric entity

* add metric as page type to customization

* fix container unit tests

* fix metric tests

* fix ml model customization

* fix test for mlmodel page

* fix Metric details tests

* fix tests

* fix test for database schema version page

* reset max failure for playwright

* improve icons

* address comments

* update translation

* update as per comments

* update localization

* update function signature

* update file names and fix imports

* address comments

* support tags and glossary to domain

* fix failing tests

* option to show hide task handlers
2025-02-27 15:43:58 +05:30
Shailesh Parmar
a0954ae33c
Minor: Added Whats new content for 1.6.5 (#19996) 2025-02-26 20:31:07 +01:00
IceS2
7e64bfa888
MINOR: Update Data Insights Configurations to enable more fine control management (#19884)
* Update Data Insights Configurations to enable more fine control management

* Update Data Insights Configurations to enable more fine control management

* Hide one configuration from DataInsights App
2025-02-26 16:17:18 +05:30
Karan Hotchandani
9568817cf1
Fix #19950: Add Tags/Glossary Term support for Domains & Data Products (#19969)
* Fix #19950: Add Tags/Glossary Term support for Domains & Data Products

* add tags and glossary terms to domain and data product

* fix snakeyaml dependency

* Fix search filtering for domain/dataProduct

* fix showing of domain on tags page

* fix merge conflicts

* addressed comments

---------

Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
2025-02-26 14:46:58 +05:30
Ashish Gupta
df00d2f392
#19850: fix the scroll issue for action button in Glossary import (#19965)
* fix the scroll issue for action button in Glossary import

* minor translation fix

* fix sonar issue
2025-02-25 19:38:55 +05:30
Keshav Mohta
df193bd0c4
Feature: Reverse Metadata Ingestion (#19723) 2025-02-25 18:41:08 +05:30
Chirag Madlani
450b6df9cd
fix(ui): service type filter for multiple selections (#19941)
* fix(ui): service type filter for multiple selections

* fix tests

* remove import

* revert other changes

* added test for service type filter

* improve code
2025-02-25 17:05:54 +05:30
dntjr8096
6484ccd36d
Add ko-kr language support (#19923)
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2025-02-25 13:16:04 +05:30
Jorge Gustavo Rocha
4c70110690
Use the correct non english guide in services if it exists (#19957) 2025-02-25 11:12:18 +05:30