1020 Commits

Author SHA1 Message Date
Pranita Fulsundar
680537cd70
feat(ui): revamp landing page (#21691)
* fix: minor style for customisation pages

* feat(ui): customisation of landing page (#21692)

* add customise header section

* fix react grid layout for widgets

* fix widget height and refactor code

* fix tests

* address pr comments and added unit test

* fix unit test

* fix spacing issues and addressed pr comments

* feat(ui): customise home page banner (#21793)

* add structure for customise home modal

* feat: customise banner background color

* refactor css

* add unit tests

* fix color change functionality

* minor fix

* refactor code

* minor refector

* feat(ui): new layout for home page (#21901)

* update new layout for home page

* add unit tests

* feat(ui): widgets selection modal (#21974)

* add selection widgets to modal

* implement add widgets functionality

* fix placeholderWidgetKey for addWidget

* fix handleApply call

* fix erros after merging to main for react upgrade

* add tests

* refactor css for widget card

* fix tests

* add images for widgets

* add localisation

* fix test

* Add json files for new landing page (#22116)

* chore(ci): improve e2e runners with conditions (#22084)

* MINOR: Fix pytest 3.9 (#22085)

* feat: add support for DBX system metrics (#22044)

* feat: add support for DBX system metrics

* feat: add support for DBX system metrics

* fix: added WRITE back

* fix: failing test cases

* fix: failing test

* Doc: Meta Description Updation (#22074)

* Doc: 404 Images Fixing (#22083)

* Doc: Version change along with 404 Error Fixing (#22053)

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>

* Minor: Fix the token expiry options order (#22049)

* Fix the token expiry options order

* Improve the logic and fix playwright tests

* fix sonar cloud issue

* Fix the type error

* Feature #20137 Move Glossary Terms to any level including other glossaries (#21867)

* allow changing of glossary term

* Draft ES Index Update for Glossary term move

* ES Upates in a more faster one shot bulk update

* Remove validations on Parent Glossary Hierarchy and Include Circular Glossary Term Validations

* Introduced a new PUT api for glossaryTerms move operation

* Optimised moveGlossaryTerm

* Added Transaction Scope in moveAndStore in updater

* Remove Consolidate and revert changes for move operation

* Improved Change Description and Versioning for move operation

* Improvise request payload to have only parent and optimise the flow

* Implement async functionality of Glossary Terms move

* mvn spotless:apply

* MoveGlossaryTermChannel, Get only the required fields

* Fix: Update Parent for Glossary Term during Bulk Import

* allow glossary term to be moved across glossaries

* update locales

* move socket listening to hierarchy dialog

* Added fqn to move message for the websocket response

* fix tests

* add glossary tests

* cleanup

* fix tests

* Refactor code: Resolve Conflicts

* fix tests

* fix permissions

* cleanup

* Update generated TypeScript types

* Abstraction Logic in place of instanceOf logic for bulkImportExportGlossary to update the parent

* Update generated TypeScript types

---------

Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>

* update the snapshots url for ossrh migration (#22090)

* Update README and Ingestion Framework Documentation (#22080)

* Add my task json for new landing page

* update description

* add domain.json

* fix test

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
Co-authored-by: Teddy <teddy.crepineau@gmail.com>
Co-authored-by: Rounak Dhillon <162090200+RounakDhillon@users.noreply.github.com>
Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
Co-authored-by: Ram Narayan Balaji <81347100+yan-3005@users.noreply.github.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: sonika-shah <58761340+sonika-shah@users.noreply.github.com>
Co-authored-by: Ayush Shah <ayush@getcollate.io>

* feat(ui): Add support to create curated assets widget  (#21870)

* feat(ui): Add support to create curated assets widget

* revert settings.json

* fix: minor style for customisation pages

* feat(ui): customisation of landing page (#21692)

* add customise header section

* fix react grid layout for widgets

* fix widget height and refactor code

* fix tests

* address pr comments and added unit test

* fix unit test

* fix spacing issues and addressed pr comments

* fix locale

* update icons and styles

* fix view more

* fix footer

* add unit tests and minor fixes

* add curatedAssets.json

* format json file

* address comments

* address comments

* remove unnecessary indentation and fix locale

* minor fix

* address comments

* update json

* remove unnecessary changes

* update imports

* add sort and size options

* add unit test

* fix test

* revert test changes

* fix unit tests

* Fix failing test

* fix sonar nullish operator issue

* address feedback

---------

Co-authored-by: Pranita <pfulsundar8@gmail.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>

* feat(ui): create widgets with new layout having sizes small and medium (#22082)

* fix customise home modal for home page

* redesign widget

* fix following widget

* data assets widget

* fix conflicting styles

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>

* Remove global search bar and add functionality to new search bar (#22156)

* Remove global search bar and add functionality to new search bar

* add unit tests

* Add support for My Task widget (#22161)

* Add support for My Task widget

* address comments

* minor fix

* fix failing tests

* Hide non configured curated asset from my data page (#22209)

* Hide non configured curated asset from my data page

* address comments

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>

* Disable save button and fix UI discrepencies (#22152)

* Disable save button and miscellaneous changes

* fix ui

* Fix failing test

* address comments

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>

* add persona preference to uiCustomisation

* Add support to update persona preferences for the user (#22235)

* Add support to update persona preferences for the user

* add loader

* add success toast

* Fix failing unit test

* Update generated TypeScript types

* Support background update by admin for customized landing page (#22301)

* Fix failing e2e tests (#22248)

* Fix failing e2e tests

* fix activity feed tests

* fix failing e2e tests

* fix EntityDataSteward and Entity tests

* fix failing tests

* Fix metric tests

* Fix lineage and my data page

* update uuid

* Add support for domains widget (#22318)

* Add support for domains widget

* code cleanup

* minor fix

* fix failing test

* address comments

* update .less file

* import t from utils

---------

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>

* Update curated assets widget for full size (#22343)

* Fix customize search functionality (#22349)

* Fix customize search functionality

* update-my-task-icon

* fix failing tests

* Redesign Data Assets widget (#22353)

* Redesign Data Assets widget

* remove comments

* add footer and its unit tests

* Add new announcement widget (#22373)

* Add new announcement widget

* fix badge color

* fix styles

* address comments

* fix failing test

* minor fix

* fix css

* fix color variable

* Fix KPI and Total Data Assets widgets (#22359)

* fix dropdown styles

* fix minor styles

* remove recently viewed widget

* fix kpi widget and added tests

* fix total data assets widget and add tests

* minor style fix

* remove kpi filters

* fix total data assets chart colors

* add filters for total data assets

* fix kpi widget styles

* minor style fix

* addressed pr comments

* Feat(UI): Added Feed , Assets Following and My data widget (#22375)

* added feeds widget

* addressed comments

* fixed padding

* addressed comments and added new tests

* addressed comments and added new tests

* removed unncessary slice condition

* added sorting for follwing and my data widget

* fixed truncate and overflow edge condtions

* fixed sonar test

* remove unwanted options

* Fix UI cosmetic issues (#22439)

* fix: failing e2e tests (#22427)

* fix Entity.spec

* fix metric tests from Entity.spec

* minor fix

* minor fix

* Fix CSS for data assets, KPI and total data assets widget (#22458)

* Fix failing e2e tests (#22396)

* Fix failing e2e tests

* Fix tour and data quality tests

* Fix description suggestion

* fix customMetric tests

* fix tests

* fix tests

* fix navbar and bulk import tests

* Fix entity service tests

* Fix ExploreQuickFilters.spec.ts

* fix metric tests

* update config

* minor fix

* Fix domain rbac

* Fix test

* fix unit test

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>

* fix tests

* Fix failing E2E tests (#22462)

* Fix failing E2E tests

* Fix service entity tests

* fix tests

* fix kpi widget test id

* fix schema definition and frequently joined tests

* fix domains.spec

* fix tests

* fix tests and address ui feedbacks

* fix unit tests

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: Harshit Shah <dinkushah169@gmail.com>
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
Co-authored-by: Teddy <teddy.crepineau@gmail.com>
Co-authored-by: Rounak Dhillon <162090200+RounakDhillon@users.noreply.github.com>
Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
Co-authored-by: Ram Narayan Balaji <81347100+yan-3005@users.noreply.github.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: sonika-shah <58761340+sonika-shah@users.noreply.github.com>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
Co-authored-by: Dhruv Parmar <83108871+dhruvjsx@users.noreply.github.com>
2025-07-19 17:59:14 +05:30
Sriharsha Chintalapani
1c092ea743
Fix #22403: Smart Reindex (#22404)
* Fix #22403: Smart Reindex

* Update generated TypeScript types

* Docs: Artifacts Removal (#22442)

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>

* Docs: Meta Tags Updation (#22444)

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>

* Fixes #22363 #22369: Stored procedure temp table processing and lineage filtering with db & schema (#22416)

* Process temp table graph in stored procedure processor and add db/schema filtering on lineage

* Add tests for stored procedure lineage processing

* Fix tests and py_format

* Fix the filters and log stored proc query count info

* Playwright Update: Bulk Import (#22436)

Co-authored-by: Satish <satish@Satishs-MacBook-Pro.local>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>

* Docs: Databrick Features Updation (#22448)

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>

* Docs: Meta Updation (#22451)

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>
Co-authored-by: Prajwal214 <167504578+Prajwal214@users.noreply.github.com>

* Docs: 18.4 to 1.8.6 Release Updation (#22455)

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>

* fix the flaky glossary bulk edit failure (#22446)

* Move schema changes to 1.8.7

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: Rounak Dhillon <162090200+RounakDhillon@users.noreply.github.com>
Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>
Co-authored-by: Mohit Tilala <63147650+mohittilala@users.noreply.github.com>
Co-authored-by: satish <satishmwaghela@gmail.com>
Co-authored-by: Satish <satish@Satishs-MacBook-Pro.local>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: Prajwal214 <167504578+Prajwal214@users.noreply.github.com>
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2025-07-18 21:53:43 -07:00
Suman Maharana
9838278ac4
Add: Schema and Database Mark Deletion (#22088)
* Added Schema and Database Mark Deletion

* removed unnecessary changes

* fixed marked deleted databases

* Added to all db connectors

* Added generated types

* Added tests
2025-07-15 16:26:46 +02:00
Mohit Yadav
860694e0af
Fix Null Columns (#22365) 2025-07-15 06:10:45 -07:00
Suman Maharana
f73b3bc643
Add: missing supportsMetadataExtraction flag in connectors (#22296)
* Add: missing supportsMetadataExtraction flag in connectors

* addressed comments

* generate types
2025-07-15 08:34:56 +02:00
Akash Verma
6f42921c88
feature: thoughtspot connector (#22266)
* feature: thoughtspot connector

* java and ts files

* java checkstyle

* rm java files

* ui changes

* java files

* minor changes

---------

Co-authored-by: Akash Verma <akashverma@Akashs-MacBook-Pro-2.local>
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
Co-authored-by: Keshav Mohta <68001229+keshavmohta09@users.noreply.github.com>
2025-07-15 07:59:10 +02:00
zuohuan
acb7e4dcef
Fix #22244 - Fix issues in zh language search index mapping (#22295)
Co-authored-by: zuohuan <zuohua12@163.com>
2025-07-15 09:31:12 +05:30
Sriharsha Chintalapani
58cd7daf7e
Add drive as service (#22159)
* Fix #22157: Add Drive Service Support to OpenMetadata

* Fix #22157: Add Drive Service Support to OpenMetadata

* Update generated TypeScript types

* Fix tests

* Update generated TypeScript types

* Fix tests

* Tests are passing

* Tests are passing

* Update generated TypeScript types

* Address comments

* Update generated TypeScript types

* Add sample data and ingestion for drives, directories, spreadsheets, worksheets, files

* Fix postgres migrations

* Fix postgres tests, optimize queries

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2025-07-11 10:00:54 -07:00
Mohit Tilala
a6c0261728
Add lineage stored procedure and view filter pattern support (#22223)
* Add lineage stored procedure and view filter pattern support

* Update generated TypeScript types

* Add tests for lineage filter pattern

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2025-07-08 16:32:25 -07:00
Keshav Mohta
6e40f976e7
Fix #20145: Implemented Prefix For Dashboard Service (#21585)
* feat: implemented microstrategy lineage & dbServicePrefix

* feat: added dbServicePrefixes support in other dashboards

* fix: test_metabase and powerbi extra code remove

* fix: python checkstyle

* refactor: added prefix support for other connectors - superset, tableau, etc

* refactor: added migration for prefix change and fix dbServicePrefixes field description

* refactor: added prefix changes in superset db source

* doc: add prefix in tableau doc

* fix: typescript files and postgres migration for prefix

* fix: moved migration in 1.8.2

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2025-07-08 18:54:35 +02:00
Mohit Yadav
0b2321e976
Added Session Age for Cookies (#22166)
* - Added Session Age for Cookies

* Make OIDC Session Expiry Configurable

* Update generated TypeScript types

* Updated Docker Files

* Update Session to 7 days

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-07-08 15:07:52 +05:30
harshsoni2024
718642541c
MINOR: pbi display table name from source (#22191)
* pbi display table name from source

* Update generated TypeScript types

* log correction

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-07-08 07:26:38 +02:00
Sriharsha Chintalapani
d21c0b0f2e
Add DataContract status result API; add reviewers for data contract (#22176)
* Add DataContract status result API; add reviewers for data contract

* Update generated TypeScript types

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2025-07-07 18:30:21 +02:00
Himanshu Khairajani
d12d93e0ea
Feat #21783: Add Json Schema Attribute in Automator for Domain Lineage Propagation. #21784 (#22010)
* Feat #21783: Add Json Schema Attribute in Automator for Domain Lineage Propagation. (#21784)

Automator - Domain Lineage Propagation

* UI Feat: Domain Propagation Changes

* UI Feat: Domain Propagation Changes

* UI Feat: Domain Propagation Changes

* Update generated TypeScript types

* Update generated TypeScript types

---------

Co-authored-by: --global <--global>
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-07-07 16:36:37 +02:00
Aniket Katkar
f5d8b093d5
Fix#1633: Add filterJsonTree to the automatorAppConfig (#22098)
* Add filterJsonTree to the automatorAppConfig

* Update generated TypeScript types

* add comment

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-07-07 12:29:25 +05:30
Sriharsha Chintalapani
cec7dd31ad
Fix #21662: Optional Redis Write-Through Cache for Database Queries (#21667)
* Fix #21662: Optional Redis Write-Through Cache for Database Queries

* Fix #21662: Optional Redis Write-Through Cache for Database Queries

* Fix #21662: Optional Redis Write-Through Cache for Database Queries

* Add lazy load, add test profile

* Fix stylecheck

* Fix tests, sonar comments

* Fix tests, sonar comments

---------

Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
2025-07-04 23:21:20 -07:00
Sriharsha Chintalapani
d2cff8ff52
Fix #21908: Add Persona configuration per User (#21909)
* Fix #21908: Add Persona configuration per User

* Add default persona, add tests for User defaultPersona

* Add default persona, add tests for User defaultPersona

* Fix tests
2025-07-03 14:15:07 +05:30
Sriharsha Chintalapani
0162f42a1d
Fix #20621: User Status Tracking in the System (#21911)
* Fix #20621: User Status Tracking in the System

* Fix #20621: User Status Tracking in the System

* Fix #20621: Add Playwright tests

* Update generated TypeScript types

* fix import

* remove unused imports and fix broken ui for settings user page

* revert path  change for PersonaDetailsPage

* fix unit tests

* fix tests

* Add separate api for last login time

* update last login time api

* remove last login time patch

* remove updateLoginTime

---------

Co-authored-by: shrushti2000 <shrushtipolekar@gmail.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: sonikashah <sonikashah94@gmail.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
2025-07-02 14:37:36 -07:00
sonika-shah
5a124873e1
add name tag in pom.xml of all modules (#22104) 2025-07-02 22:48:11 +05:30
Ram Narayan Balaji
b82b4f23e5
Feature #20137 Move Glossary Terms to any level including other glossaries (#21867)
* allow changing of glossary term

* Draft ES Index Update for Glossary term move

* ES Upates in a more faster one shot bulk update

* Remove validations on Parent Glossary Hierarchy and Include Circular Glossary Term Validations

* Introduced a new PUT api for glossaryTerms move operation

* Optimised moveGlossaryTerm

* Added Transaction Scope in moveAndStore in updater

* Remove Consolidate and revert changes for move operation

* Improved Change Description and Versioning for move operation

* Improvise request payload to have only parent and optimise the flow

* Implement async functionality of Glossary Terms move

* mvn spotless:apply

* MoveGlossaryTermChannel, Get only the required fields

* Fix: Update Parent for Glossary Term during Bulk Import

* allow glossary term to be moved across glossaries

* update locales

* move socket listening to hierarchy dialog

* Added fqn to move message for the websocket response

* fix tests

* add glossary tests

* cleanup

* fix tests

* Refactor code: Resolve Conflicts

* fix tests

* fix permissions

* cleanup

* Update generated TypeScript types

* Abstraction Logic in place of instanceOf logic for bulkImportExportGlossary to update the parent

* Update generated TypeScript types

---------

Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
2025-07-02 15:44:01 +05:30
Akash Verma
bd25c6123e
feature:ssas-connector (#22028)
* feature:ssas-connector

* ui and ts files

* ui errors

* minor change

---------

Co-authored-by: Akash Verma <akashverma@Akashs-MacBook-Pro-2.local>
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
2025-07-01 15:51:58 +05:30
Teddy
ccdaa8d132
feat: add write dml (#22046) 2025-06-30 16:39:05 -07:00
Sriharsha Chintalapani
db8e2fa548
Improve indexing auto tune based on heap mem, parse custer metrics for new versions of OpenSearch (#21931)
* Improve indexing auto tune based on heap mem, parse custer metrics for new versions of OpenSearch

* Use native bulk processors

* lower the batch size, add composite index for app_runs table

* while updated secrets, if there is entityNotFoundException ignore and move on

* Fix deadlock

* Fix deadlock

* Fix gzip headers

* remove unnecessary code to check compression, batch sizes etc..

* Improved performance

* Improved performance

* fix merge error

* fix styling

* fix tests

* Fix build issues

* improve queue size recommendations

* put max limits on threads

* fix checkstyle
2025-06-30 07:40:25 -07:00
harshsoni2024
d50e155b1b
add parquet alternate filetypes in table fileformat (#22027) 2025-06-30 14:23:51 +05:30
Suman Maharana
e36e5da26e
Added Databricks pipeline Lineage (#22014) 2025-06-30 10:41:22 +05:30
Shailesh Parmar
62ab5689d2
Feat: add support of adding tags in test case form (#22007)
* Feat: add support of adding tags in test case form

* fix: don't override test case tags with entity tags

* feat: enhance test case form to support glossary terms and improve tag handling

* feat: implement tags and glossary terms functionality in test case forms and enhance related tests

* fixed failing unit test

* feat: add tier tag filtering and preservation in test case forms and related tests

* feat: add tags to addTestCaseAction

---------

Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
2025-06-28 21:55:01 +02:00
sonika-shah
5d733b490c
Minor Fix : query_cost_record_search_index Search exception for elasticsearch instance (#21985)
* Fix : query_cost_record_search_index Search exception for elasticsearch instance

* add sample query to cover test scenarios

* update mapping and fix test
2025-06-28 11:22:34 +05:30
Teddy
d36878409a
MINOR: Extracted indexMapping into spec module (#21882)
* feat: added endpoint to programatically retrieve index mapping

* feat: added endpoint to programatically retrieve index mapping

* refactor: extracted JsonUtils from server sub module

* refactor: move IndexMapping to spec

* style: ran java linting

* refactor: moved IndexMapping to singleton class

* fix: JsonUtils import

* style: ran java linting

* fix: init indexmapper in operations

* fix: moved ES index json files to spec

* style: ran java linting

---------

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2025-06-27 14:47:36 +02:00
IceS2
94cf3e0fd6
MINOR: Extend profile workflow config to allow engine configuration (#21840)
* Update Profile Workflow to allow engine configuration

* Add ui generated schemas

* Add Repository Override mechanism based on annotations

* Implement logic to use the ProcessingEngine configuration

* Update SparkEngine to use remote and not master
2025-06-26 19:11:26 +05:30
Mohit Yadav
2c696bb1e2
Remove Default: null from columns and let json to pojo handle (#21934)
* Remove Default: null from columns and let json to pojo handle

* Remove Setting table columns to null

* Fix Failing Tests

---------

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2025-06-25 21:53:32 +05:30
Karan Hotchandani
631c6f58fe
Feat(ui): add owners field in tags and classification (#21757)
* add owners field in classification

* fix tests

* add owners field in tags page

* Tag Inherits owners from classification

* Added loadTags.ts for owners field

* add owners for tags page

* fix tests

* review comments

* add owners field in create form

* fix domain test

---------

Co-authored-by: Ram Narayan Balaji <ramnarayanb3005@gmail.com>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
2025-06-18 16:52:53 +05:30
harshsoni2024
a09a696358
MINOR: Tableau proxy url for sourceurl (#21799) 2025-06-18 10:52:08 +05:30
Karan Hotchandani
2689676b9a
Feat(ui): add and edit certifications from asset page (#21758)
* Feat(ui): add and edit certifications from asset page (#21344)

* added styling to certification

* added tests

* changed icons for certificatie popup

---------

Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>

* #19529 Improvise import to include certification for Assets (Database, DatabaseSchema, DatabaseService), Introduce EDIT_CERTIFICATION policy and Fix Elastic Search Indexes on Certification (#21564)

* #19529 - Adding certification field in json schema for databaseService.json, databaseServiceCsvDocumentation.json for bulk import facility, Implemented bulk import for non-recursive databaseService import async

* #19529 -Bulk async import - databaseSchema entity

* #19529 -Bulk async import - database entity

* #19529 - Initial Implementation of Search Indexes for Certificate during bulk Import

* #19529 - Edit Certification Policy Implementation, Attaching it to DataStewards and DataConsumers, also adding it to Migration

* #19529 - Updated ElasticSearch Index mapping name

* #19529 - Updated the CSV indices for recursive import

* #19529 - Single Test working as expected but not as a test suite.

* #19529 - Fixed DatabaseSchemaResourceTest

* #19529 - Fixed DatabaseResource Test for exportImportCSV

* #19529 - Fixed DatabaseServiceResource Test for exportImportCSV

* #19529 - Updated and Improvised ElasticSearch Certification functionality

* #19529 - Added postgres migration as well along with mysql migration

* #19529 - Removed migration scripts from v160 and placed it at v180, Included mappings for database_service in zh and jp,
Applied mvn spotless:apply

* #19529 - Adding certification field in json schema for databaseService.json, databaseServiceCsvDocumentation.json for bulk import facility, Implemented bulk import for non-recursive databaseService import async

* #19529 -Bulk async import - databaseSchema entity

* #19529 -Bulk async import - database entity

* #19529 - Initial Implementation of Search Indexes for Certificate during bulk Import

* #19529 - Edit Certification Policy Implementation, Attaching it to DataStewards and DataConsumers, also adding it to Migration

* #19529 - Updated ElasticSearch Index mapping name

* #19529 - Updated the CSV indices for recursive import

* #19529 - Single Test working as expected but not as a test suite.

* #19529 - Fixed DatabaseSchemaResourceTest

* #19529 - Fixed DatabaseResource Test for exportImportCSV

* #19529 - Fixed DatabaseServiceResource Test for exportImportCSV

* #19529 - Updated and Improvised ElasticSearch Certification functionality

* #19529 - Added postgres migration as well along with mysql migration

* #19529 - Removed migration scripts from v160 and placed it at v180, Included mappings for database_service in zh and jp,
Applied mvn spotless:apply

* Applied mvn spotless:apply

* Reused the Existing UPDATE_CERTIFICATION_SCRIPT for ElasticSearch Indexing

* Added field certification in the static String FIELDS

* fix playwright test around bulk action

* #19529 - Persisting Null or empty in the bulk import for certification

* #19529 - Persisting Null or empty in the bulk import for certification - Moved the if block to the top

* mvn spotless:apply

* Reverted an unimportant file

* mvn spotless:apply

* #19529 - Persisting the field Certification in clearFIeldsInternal

* typescript files for edit_certification

* Revert "typescript files for edit_certification"

This reverts commit f5e5514a98008cbd0b62d7cb21fefe61659e97cb.

* typescript files for edit_certification

* mvn:spotless:apply

* Removed correction

* needed typescript file for edit_certification

* Removed Unnecessary Comments

* Improved Test Cases - Added DATA_ASSET_SEARCH alias instead of GLOBAL_ALIAS

* Fixed csv values in order

---------

Co-authored-by: Ashish Gupta <ashish@getcollate.io>
Co-authored-by: System Administrator <root@192.168.1.4>
Co-authored-by: sonika-shah <58761340+sonika-shah@users.noreply.github.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>

* update certification component

* Fixed Certification Indexes

* Fixed Missing Certification Label for DBSchema

* add certification changes

* fix test errors

* Remove Certification field and mapping from database service asset

* Removed certification from schema and fixed test

* fix tests

---------

Co-authored-by: Dhruv Parmar <83108871+dhruvjsx@users.noreply.github.com>
Co-authored-by: Ram Narayan Balaji <81347100+yan-3005@users.noreply.github.com>
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
Co-authored-by: System Administrator <root@192.168.1.4>
Co-authored-by: sonika-shah <58761340+sonika-shah@users.noreply.github.com>
Co-authored-by: Ram Narayan Balaji <ramnarayanb3005@gmail.com>
2025-06-17 11:28:07 +05:30
sonika-shah
4143308f96
Fix #1681 - Deleted Filter in Automations Not Working as Expected (#21760)
* Fix #1681 - Deleted Filter in Automations Not Working as Expected

* Revert "Fix #1681 - Deleted Filter in Automations Not Working as Expected"

This reverts commit d941ad440b6c5bcb66d4ac8bb31c321fb23cbcfc.

* Set deleted param in /search/query API to type Boolean to allow default null values

* fix AUT test failures related to user search in settings/users page

* fix AUT test failures related to user search in settings/users page

* Make `deleted` param optional for search API call in explore page

* Fix the deleted users showing on the user listing page after user search

* Fix playwright tests

* Fix playwright tests

---------

Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
2025-06-16 12:02:19 -07:00
Sriharsha Chintalapani
074329418f
Fix #17244: Pagination for columns in UI (#21508) 2025-06-15 21:30:31 +05:30
Mohit Yadav
5b6e25999e
Disabled bot creating activity feeds (#21773)
* - Disabled bot creating feeds

* - nit
2025-06-14 19:21:00 +05:30
Sriharsha Chintalapani
7d07222635
Fix #21668: Add Auto Tune to conifgure Search Index Application Parameters (#21669)
* Fix #21668: Add Auto Tune to conifgure Search Index Application Parameters

* add auto tune param in app json

* add test

* use virtual threads

* Fix Failing Test

---------

Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
2025-06-13 09:23:22 -07:00
Ram Narayan Balaji
580880e8c1
#17584 Improve Bulk add assets API in Tags, GlossaryTerms (#21673)
* Fix: Remove operations and glossaryTags from bulk asset add api

* Fix: Improved the test case

* addTagToAssets schema - Removed operations field in the payload

* Replacing the request payload for validating tags in the UI

* UI changes for add and remove assets to glossary term

* Using getByName and Entity.GLOSSARY

---------

Co-authored-by: sonika-shah <58761340+sonika-shah@users.noreply.github.com>
2025-06-13 16:04:05 +05:30
Ajith Prasad
023abfda1d
Scim Interface and resource in OM (#21512)
* SCIM interface

* removed unwanted code

* remove SCIM registration in OM

* reverted scim configuration settings, as it is not needed

* Added security context to create user

* Added scimusername in user jsons

* added externalid, scimUsername in createUser

* Added security context on create and update groups

* Added jakarta imports

* Authorization added

* Added role, policy and bot for SCIM
2025-06-13 13:12:41 +05:30
Keshav Mohta
cd24c0a69a
Feature: Microstrategy Lineage (#21678) 2025-06-13 08:28:29 +05:30
Mohit Tilala
2803e62f0b
Add missing Data space type in qlikcloud (#21698)
* Add missing `Data` space type in qlikcloud

* Fix broken json files
2025-06-12 14:49:10 -07:00
Sriharsha Chintalapani
8bb055fc9e
Fix #21506: Upgrade to Java 21 (#21507)
* Fix #21506: Upgrade to Java 21

* Fix #1655: Upgrade to Java 21
2025-06-11 22:06:08 -07:00
Teddy
c09a8b27ae
ISSUE #16676 - Add Tag to CreateTestCase (#21366)
* refactor: removed testSuite field from CreateTestCase

BREAKING CHANGE: when creating a test case, testsuite is now derived from entityLink (fetch or created)

* feat: allow setting tags when creating a test case

* style: ran linters

* fix: compiling error

* fix: failing test case

* fix: failing tests

* removed testSuite from required filed

* fixed ui side

* style: ran java linting

* deprecation: remove testSuite param from ingestion

* fix: remove test suite filed

* fix: remove test_suite field

---------

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2025-06-11 09:59:08 +02:00
Ram Narayan Balaji
febd195bfd
#16279 Update Classification Schema to include Governance Fields - Schema and Java Implementation (#21636)
* Update Classification Schema to include Governance Fields

* Removed Tags, Reviewers, Domain from Classification as they are needed and corrected tests

* Added Permission check for owners in Classification Resource Test

* Added LoadTags.ts generated from createClassificationSchema.json

* Only have my schema changes in the typescript files, ignore other changes.

---------

Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
2025-06-10 07:06:20 -07:00
Ram Narayan Balaji
d065d85e0a
Revert "Fix: #17584 Improve Glossary Bulk Asset Upload APIs (#21652)" (#21672)
This reverts commit 5b30aa94e2e018eb4c486d14424a5d34b2877979.
2025-06-10 11:36:42 +05:30
Ram Narayan Balaji
5b30aa94e2
Fix: #17584 Improve Glossary Bulk Asset Upload APIs (#21652)
* Fix: Remove operations and glossaryTags from bulk asset add api

* Fix: Improved the test case

* addTagToAssets schema - Removed operations field in the payload

---------

Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
2025-06-10 11:09:07 +05:30
Mohit Yadav
d1ea459a81
Queries not tableQueries (#21670) 2025-06-10 10:08:42 +05:30
Mohit Yadav
dc25350ea2
MCP Core Items Improvements (#21643)
* Search Util fix and added tableQueries

* some json input fix

* Add team and user

* WIP : Add Streamable HTTP

* - Add proper tools/list schema and tools/call

* - auth filter exact match

* - Add Tools Class to dynamically build tools

* Add Origin Validation Mandate

* Refactor MCP Stream

* comment

* Cleanups

* Typo

* Typo
2025-06-10 09:42:24 +05:30
Mayur Singal
53817c2182
Minor: Make trino query table configurable (#21665) 2025-06-09 16:03:57 -07:00
Ayush Shah
e2aaf322b7
Enhance S3 Connection Schema: Add default values for container filter pattern (#21659) 2025-06-09 21:18:57 +05:30