1532 Commits

Author SHA1 Message Date
Imri Paran
eeca51cb9a GEN-1793: fix app config from resource (#18228)
* fix: app config from resource

* removed useless logging
2024-10-25 17:21:41 +02:00
Imri Paran
a2ffa0814f MNIOR: feat(apps): support config file (#17872)
* feat(apps): support config file

- added support for app config files
- removed AppPrivateConfig from the OpenMetadata server configuration

* use dorpwizard utility classes for resolving environment variables in the config

* moved fields to class level

* format
2024-10-25 17:21:20 +02:00
Pere Miquel Brull
517e6ea0cc FIX - App Extension migration JSONB (#18219) 2024-10-25 17:15:39 +02:00
Pere Miquel Brull
c1c8448c1d FIX - App Extension Migration (#18176) 2024-10-25 17:15:34 +02:00
Pere Miquel Brull
30a526844f MINOR - Add App Limits (#18072)
* App Limits - Prep extension

* App Limits - Prep extension

* App Limits - Allow to search by name

* App Limits - Allow to search by name

* fix postgres sql

* comments
2024-10-25 17:15:03 +02:00
Pere Miquel Brull
bba91b9569 GEN-1234 - Clean up suggestions when a user is deleted (#17988)
* GEN-1234 - Clean up suggestions when a user is deleted

* add method

* add method

* fix postgres query
2024-10-25 15:51:46 +02:00
github-actions
ae1b8c4927 chore(release): Prepare Branch for 1.5.9 2024-10-25 05:14:05 +00:00
Sriharsha Chintalapani
2c610c2de3 Add Azure Token Base Authentication (#18387)
* Add azure token based auth

* Add Azure Token Base Authentication

* Update azure-auth.md

* Update azure-auth.md

* feat: Add `azure-identity-extensions` library for passwordless database connection

---------

Co-authored-by: Ayush Shah <ayush@getcollate.io>
Co-authored-by: Akash-Jain <15995028+akash-jain-10@users.noreply.github.com>
(cherry picked from commit d8f5398efb75c6a76033c2bbf37b7eca4c44a9d2)
2024-10-24 11:54:33 +02:00
Mayur Singal
d5028e9397 MINOR: Fix web analytic activity being reset (#18344) 2024-10-24 11:14:11 +05:30
Mayur Singal
edc7de7405 MINOR: Not Include Soft Deleted Assets in DI (#18383) 2024-10-24 11:13:24 +05:30
Mayur Singal
e4003efdf9 MINOR: Fix LocationPath Index (#18364) 2024-10-23 13:12:28 +05:30
Mayur Singal
5801e6c380 MINOR: Add location path to table entity (#18307) 2024-10-23 13:12:18 +05:30
sonika-shah
0741788744 Fix #18334 - Fix issues in zh language search index mapping (#18335) 2024-10-23 08:56:01 +05:30
Mohit Yadav
7d42926960 FIx Failing Test Case (#17945)
* FIx Failing Test Case

* Update dependency version

(cherry picked from commit 512946df15f189be142a50c838e05f4ba83ceaa5)
2024-10-21 14:00:23 +02:00
Teddy
bf47ae3545 MINOR - live index on test suite creation (#18317)
* fix: live index on test suite creation

* fix: make live indexing use entityInterface

(cherry picked from commit 781989e5bca4e3bfdc3cfec73f0456e35a7db71f)
2024-10-21 12:50:26 +02:00
github-actions
b2d2839801 chore(release): Prepare Branch for 1.5.8 2024-10-17 20:44:45 +00:00
Teddy
fca782cc50 MINOR: added testSuite field back to lineage response (#18313)
* fix: added testSuite field back to lineage response

* style: fix style
2024-10-17 21:32:14 +05:30
Mohit Yadav
93c444cfa2 [GEN-1704] Remove Table Details from Import/Export at table level (#18093)
* [GEN-1704] Remove Table Details from Import/Export at table level, and only add columns

* Fix Tests
2024-10-17 16:16:46 +05:30
sonika-shah
be1cefe59e Minor : increase MAX_AGGREGATE_SIZE in search (#18299) 2024-10-17 05:37:56 +05:30
sonika-shah
9dbe7e3376
Minor : Fix exception in search due to exception in database.displayName and databaseSchema.aggregation (#18290) 2024-10-16 13:44:41 -07:00
sonika-shah
231cef6490 feat: add Import/export support for table type custom property in glossary (#18262)
* import/export support for table type custom property

* remove logs

* Add backend tests

* ui: add custom type property parsing

* print rows in the order of columns defined in config

* ui: handle special chars pasring for custom property import/export

* ui:improve table type property parsing

* ui:fix sql input styling

* ui: improve the parsing for table type property

* ui: fix parsing for markdown, string and sqlQuery properties

* ui: fix parsing for table type property

* ui: fix unit test

* fix backend tests

* remove unwanted comments

* ui: add playwright test for table type import/export part1

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
(cherry picked from commit 30497528bcf6f5da692fbbdbc8e88bfddb635e0a)
2024-10-16 15:45:37 +05:30
sonika-shah
f10de7f4d2 GEN-1662 : Fix - on dashboard soft delete, chart should not be visible (#18283) 2024-10-16 14:34:34 +05:30
Imri Paran
5f93b05d8b MINOR: add column case sensitivity parameter (#18115)
* fix(data-quality): table diff

- added handling for case-insensitive columns
- added handling for different numeric types (int/float/Decimal)
- added handling of boolean test case parameters

* add migrations for table diff

* add migrations for table diff

* removed cross type diff for now. it appears to be flaky

* fixed migrations

* use casefold() instead of lower()

* - implemented utils.get_test_case_param_value
- fixed params for case sensitive column

* handle bool test case parameters

* format

* testing

* format

* list -> List

* list -> List

* - change caseSensitiveColumns default to fase
- added migration to stay backward compatible

* - removed migration files
- updated logging message for table diff migration

* changed bool test case parameters default to always be false

* format

* docs: data diff

- added the caseSensitiveColumns parameter

requires: https://github.com/open-metadata/OpenMetadata/pull/18115

* fixed test_get_bool_test_case_param

(cherry picked from commit be82086e2542d2d176ac66e0bf11100646448b4f)
2024-10-15 16:41:43 +02:00
sonika-shah
dfb7a3ce9d GEN-1836: Table custom property enhancements (#18239) 2024-10-15 12:56:17 +05:30
sonika-shah
1252698869 Feature : Add table-type custom property (#18135) 2024-10-15 12:54:40 +05:30
Teddy
17d68ddd0c GEN 1654 - Fix Alerts for Test Suites (#18222)
* fix: test suite alerts

* fix: return testSuites field for test suite alerts

* style: ran java linting

(cherry picked from commit add22b5d285a8a2d00928b734db4d6a848cc0e27)
2024-10-14 16:28:08 +02:00
Teddy
3ce343c640 MINOR - Reduce lineage response size (#18080)
* fix import issue

* fix: reduce response size and exclude fields in search client source

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
(cherry picked from commit 751bceb76367f72f18bc404bf396c566ab5187c8)
2024-10-14 16:19:05 +02:00
Sriharsha Chintalapani
86507159b2 Minor: Add deleteEntityByFQNPrefix (#18243) 2024-10-13 09:23:37 -07:00
sonika-shah
5d8546c135 Minor : fix term references validation msg on glossary import (#18058)
(cherry picked from commit f6b6874f5707d960c4a0317bd020e66d3b01c31c)
2024-10-07 13:11:34 +05:30
Sachin Chaurasiya
f86527dc79 Feature: Allow Custom Property Update in Glossary Bulk Import/export (#17919) 2024-10-07 13:11:13 +05:30
sonika-shah
e320a1b516 Add new ‘enumWithDescriptions’ Custom Property to allow adding Enum Keys with Description (#17777)
* Add new ‘metaEnum’ Custom Property to allow adding Enum Keys with Description

* replace JsonNodeFactory method with JsonUtils

* rename property from metaEnum to enumWithDescriptions, and other method optimizations

* ui: add support for creating enumWithDescription property

* minor locale changes

* ui: add edit support for created enumWithDescription property

* Refactor enum description field layout in AddCustomProperty and EditCustomPropertyModal

* add support for adding values to enumWithDescription custom property type

* Refactor custom property input IDs in AddCustomProperty and EditCustomPropertyModal components

* Refactor custom property table rendering logic and UI components

* Refactor custom property table rendering logic and UI components

* Refactor custom property table rendering logic and UI components

* add basic card layout

* Refactor CustomPropertyTable component to improve UI and functionality

* update playwright test part 1

* Refactor PropertyValue component to conditionally render right panel styles

* fix: entity reference property update

* Refactor CustomPropertyTable component to conditionally render right panel styles

* fix: flaky test

* Refactor CustomPropertyTable test to use updated test IDs and remove unnecessary code

* fix flaky test

* improve the playwright test

* add more test

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
(cherry picked from commit 1b029d2bf2793c6a4f016c91a4634c490462d7f4)
2024-10-07 13:04:17 +05:30
Ayush Shah
a5bac9690c fix: Empty Connection Overwrite Logic (#18122) 2024-10-07 10:33:00 +05:30
Mohit Yadav
c172173b88 Fix performance issue (#18128)
* Fix ClassGraph

* Use CONST

(cherry picked from commit 7ae81272b3a0ccd330bf0bfa7ca479ea35a6784c)
2024-10-05 23:26:01 +05:30
github-actions
6a36355d3e chore(release): Prepare Branch for 1.5.7 2024-10-03 15:01:32 +00:00
sonika-shah
b003e1d600
fix: Handle NullPointerException when adding custom properties to ensure loop continues for other schemas of the same type for addToRegistry (#18088) 2024-10-03 13:25:46 +05:30
Sachin Chaurasiya
1886132f41 Revert "Add new ‘enumWithDescriptions’ Custom Property to allow adding Enum Keys with Description (#17777)"
This reverts commit 237aec114f1804b584dbfdbab5b7b80dcdbbb728.
2024-10-03 12:04:10 +05:30
Sachin Chaurasiya
9caf9ed157 Revert "Feature: Allow Custom Property Update in Glossary Bulk Import/export (#17919)"
This reverts commit afd9267f668caa639968092b53fd9a7526018bed.
2024-10-03 12:03:12 +05:30
Sachin Chaurasiya
08edb3d155 Revert "Minor : fix term references validation msg on glossary import (#18058)"
This reverts commit 5b4458e251a77a45d0d5d2d7be69d55641250390.
2024-10-03 11:40:11 +05:30
sonika-shah
5b4458e251 Minor : fix term references validation msg on glossary import (#18058) 2024-10-01 14:36:56 +05:30
Mohit Yadav
426d292548 Fix Ops (#18061)
(cherry picked from commit 66cd00c56868ddc54260655e8c4b363e23296b86)
2024-10-01 12:33:13 +05:30
Ashish Gupta
afd9267f66 Feature: Allow Custom Property Update in Glossary Bulk Import/export (#17919)
* fix import issue

* Feat : Allow Custom Property Update in Bulk Upload

* Feat : Allow Custom Property Update in Bulk Upload

* supported editable imports in glossary page

* added remaning localizaion keys

* update logic of fieldToExtensionStrings to use csvparser

* update json and partialStatus condition

* fix tests for partialSuccess status change

* supported customProperty editable field

* fix error in custom property edit modal on new line empty custom property

* added entity type from root to support other bulk import entity as well

* fix the quote removing due to the regex in the string type

* Add backend tests , and error msg improvements

* GlossaryStatus header change

* fix unit test and dry run in case of synonyms having quotes in it

* Remove extension column in CSVs for all entities except glossaryTerm

* added editor for reviewers

* unit test around csv utils

* added escape for string too, in case of semicolon comes

* added playwright test without extension and supported relatedTerm as editable

* added unit test around csv util logic

* resolve conflicts

* Backend - add support for enumWithDescriptions in bulk import

* add tests and other error handling improvements related to enumWithDescriptions

* fix the custom property modal header and render the layout as per right panel in entities

* parese enumWithDescription for the customProperty modal while editable

* fix description data in enumWithDescription one

* fix: Handle NullPointerException when adding custom properties to ensure loop continues for other schemas of the same type for addToRegistry

* added extension playwrigth test and fix enumWithDescription object failure

* descrease the size of extension  modal

* remove additional comments

* fix the escape in parent key

* improve custom property layout

* improve ui for inline properties

* fix description, glossary and relatedTerm escape char issue

* fix some customProperty ui changes

* fix sonar issue

* minor layout changes

* minor label improvements for entity ref and list

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
(cherry picked from commit 1d727d57bd6d770f2f0ad3d0ebff63279b8a271f)
2024-10-01 00:33:30 +05:30
Mohit Yadav
384cba9bab [Search] Indexing Fixes (#18048)
* Fix OpenSearch Content Size Issue
entity content is too long [204857600] for the configured buffer limit [104857600]

* Change Type to Long

* Add Payload Size to take dynamic entry

* Migrations for 1.5.6

* Mark Stale Entries Stopped

* Format checkstyle

* Fix failure

---------

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
(cherry picked from commit f1ae49e1a0fc560b3a611acb855ec5d465deff5c)
2024-09-30 23:40:27 +05:30
Mayur Singal
d83e3a6de8 MINOR: DI Missing Dashboard Description Status (#18018) 2024-09-30 11:06:42 +05:30
sonika-shah
d8ba0eba2b Fix #18035 - getting type null exception on user feed (#18036) 2024-09-29 19:39:30 +05:30
sonika-shah
9c74964f85 Fix #18039 - Fix incorrect @Schema implementations in Swagger annotations (#18040) 2024-09-29 19:34:24 +05:30
sonika-shah
237aec114f Add new ‘enumWithDescriptions’ Custom Property to allow adding Enum Keys with Description (#17777)
* Add new ‘metaEnum’ Custom Property to allow adding Enum Keys with Description

* replace JsonNodeFactory method with JsonUtils

* rename property from metaEnum to enumWithDescriptions, and other method optimizations

* ui: add support for creating enumWithDescription property

* minor locale changes

* ui: add edit support for created enumWithDescription property

* Refactor enum description field layout in AddCustomProperty and EditCustomPropertyModal

* add support for adding values to enumWithDescription custom property type

* Refactor custom property input IDs in AddCustomProperty and EditCustomPropertyModal components

* Refactor custom property table rendering logic and UI components

* Refactor custom property table rendering logic and UI components

* Refactor custom property table rendering logic and UI components

* add basic card layout

* Refactor CustomPropertyTable component to improve UI and functionality

* update playwright test part 1

* Refactor PropertyValue component to conditionally render right panel styles

* fix: entity reference property update

* Refactor CustomPropertyTable component to conditionally render right panel styles

* fix: flaky test

* Refactor CustomPropertyTable test to use updated test IDs and remove unnecessary code

* fix flaky test

* improve the playwright test

* add more test

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
(cherry picked from commit 1b029d2bf2793c6a4f016c91a4634c490462d7f4)
2024-09-29 00:58:54 +05:30
sonika-shah
83de4a17b5 GEN-1434: Improvement : Show displayName for database and databaseSchema in explore tree (#17876)
* Show displayName for database and databaseSchema in explore tree

* use display name for database and schema

* add playwright

* resync indexes of dataAssets based on database & databaseSchema displayName change

---------

Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
(cherry picked from commit a99fbb2eb6b074a1d385ac363e11efd4b4417b14)
2024-09-27 19:04:42 +05:30
github-actions
95bfb5b912 chore(release): Prepare Branch for 1.5.6 2024-09-25 08:11:38 +00:00
mohitdeuex
5ce631a84d fix-formatting 2024-09-23 11:49:43 +05:30
Siddhant
5a2fa9abcc Fix Ldap Issue on Login 2024-09-23 11:45:27 +05:30