* import/export support for table type custom property
* remove logs
* Add backend tests
* ui: add custom type property parsing
* print rows in the order of columns defined in config
* ui: handle special chars pasring for custom property import/export
* ui:improve table type property parsing
* ui:fix sql input styling
* ui: improve the parsing for table type property
* ui: fix parsing for markdown, string and sqlQuery properties
* ui: fix parsing for table type property
* ui: fix unit test
* fix backend tests
* remove unwanted comments
* ui: add playwright test for table type import/export part1
---------
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
(cherry picked from commit 30497528bcf6f5da692fbbdbc8e88bfddb635e0a)
* fix(data-quality): table diff
- added handling for case-insensitive columns
- added handling for different numeric types (int/float/Decimal)
- added handling of boolean test case parameters
* add migrations for table diff
* add migrations for table diff
* removed cross type diff for now. it appears to be flaky
* fixed migrations
* use casefold() instead of lower()
* - implemented utils.get_test_case_param_value
- fixed params for case sensitive column
* handle bool test case parameters
* format
* testing
* format
* list -> List
* list -> List
* - change caseSensitiveColumns default to fase
- added migration to stay backward compatible
* - removed migration files
- updated logging message for table diff migration
* changed bool test case parameters default to always be false
* format
* docs: data diff
- added the caseSensitiveColumns parameter
requires: https://github.com/open-metadata/OpenMetadata/pull/18115
* fixed test_get_bool_test_case_param
(cherry picked from commit be82086e2542d2d176ac66e0bf11100646448b4f)
* fix: test suite alerts
* fix: return testSuites field for test suite alerts
* style: ran java linting
(cherry picked from commit add22b5d285a8a2d00928b734db4d6a848cc0e27)
* Add new ‘metaEnum’ Custom Property to allow adding Enum Keys with Description
* replace JsonNodeFactory method with JsonUtils
* rename property from metaEnum to enumWithDescriptions, and other method optimizations
* ui: add support for creating enumWithDescription property
* minor locale changes
* ui: add edit support for created enumWithDescription property
* Refactor enum description field layout in AddCustomProperty and EditCustomPropertyModal
* add support for adding values to enumWithDescription custom property type
* Refactor custom property input IDs in AddCustomProperty and EditCustomPropertyModal components
* Refactor custom property table rendering logic and UI components
* Refactor custom property table rendering logic and UI components
* Refactor custom property table rendering logic and UI components
* add basic card layout
* Refactor CustomPropertyTable component to improve UI and functionality
* update playwright test part 1
* Refactor PropertyValue component to conditionally render right panel styles
* fix: entity reference property update
* Refactor CustomPropertyTable component to conditionally render right panel styles
* fix: flaky test
* Refactor CustomPropertyTable test to use updated test IDs and remove unnecessary code
* fix flaky test
* improve the playwright test
* add more test
---------
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
(cherry picked from commit 1b029d2bf2793c6a4f016c91a4634c490462d7f4)
* fix import issue
* Feat : Allow Custom Property Update in Bulk Upload
* Feat : Allow Custom Property Update in Bulk Upload
* supported editable imports in glossary page
* added remaning localizaion keys
* update logic of fieldToExtensionStrings to use csvparser
* update json and partialStatus condition
* fix tests for partialSuccess status change
* supported customProperty editable field
* fix error in custom property edit modal on new line empty custom property
* added entity type from root to support other bulk import entity as well
* fix the quote removing due to the regex in the string type
* Add backend tests , and error msg improvements
* GlossaryStatus header change
* fix unit test and dry run in case of synonyms having quotes in it
* Remove extension column in CSVs for all entities except glossaryTerm
* added editor for reviewers
* unit test around csv utils
* added escape for string too, in case of semicolon comes
* added playwright test without extension and supported relatedTerm as editable
* added unit test around csv util logic
* resolve conflicts
* Backend - add support for enumWithDescriptions in bulk import
* add tests and other error handling improvements related to enumWithDescriptions
* fix the custom property modal header and render the layout as per right panel in entities
* parese enumWithDescription for the customProperty modal while editable
* fix description data in enumWithDescription one
* fix: Handle NullPointerException when adding custom properties to ensure loop continues for other schemas of the same type for addToRegistry
* added extension playwrigth test and fix enumWithDescription object failure
* descrease the size of extension modal
* remove additional comments
* fix the escape in parent key
* improve custom property layout
* improve ui for inline properties
* fix description, glossary and relatedTerm escape char issue
* fix some customProperty ui changes
* fix sonar issue
* minor layout changes
* minor label improvements for entity ref and list
---------
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
(cherry picked from commit 1d727d57bd6d770f2f0ad3d0ebff63279b8a271f)
* Fix OpenSearch Content Size Issue
entity content is too long [204857600] for the configured buffer limit [104857600]
* Change Type to Long
* Add Payload Size to take dynamic entry
* Migrations for 1.5.6
* Mark Stale Entries Stopped
* Format checkstyle
* Fix failure
---------
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
(cherry picked from commit f1ae49e1a0fc560b3a611acb855ec5d465deff5c)
* Add new ‘metaEnum’ Custom Property to allow adding Enum Keys with Description
* replace JsonNodeFactory method with JsonUtils
* rename property from metaEnum to enumWithDescriptions, and other method optimizations
* ui: add support for creating enumWithDescription property
* minor locale changes
* ui: add edit support for created enumWithDescription property
* Refactor enum description field layout in AddCustomProperty and EditCustomPropertyModal
* add support for adding values to enumWithDescription custom property type
* Refactor custom property input IDs in AddCustomProperty and EditCustomPropertyModal components
* Refactor custom property table rendering logic and UI components
* Refactor custom property table rendering logic and UI components
* Refactor custom property table rendering logic and UI components
* add basic card layout
* Refactor CustomPropertyTable component to improve UI and functionality
* update playwright test part 1
* Refactor PropertyValue component to conditionally render right panel styles
* fix: entity reference property update
* Refactor CustomPropertyTable component to conditionally render right panel styles
* fix: flaky test
* Refactor CustomPropertyTable test to use updated test IDs and remove unnecessary code
* fix flaky test
* improve the playwright test
* add more test
---------
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
(cherry picked from commit 1b029d2bf2793c6a4f016c91a4634c490462d7f4)
* Show displayName for database and databaseSchema in explore tree
* use display name for database and schema
* add playwright
* resync indexes of dataAssets based on database & databaseSchema displayName change
---------
Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
(cherry picked from commit a99fbb2eb6b074a1d385ac363e11efd4b4417b14)
* GEN-1493 - Fix opensearch pagination
* GEN-1494 - Add CI for py-tests with Postgres and Opensearch
* GEN-1494 - Add CI for py-tests with Postgres and Opensearch
* chore(api): make ingestion pipeline APIs public
* format
---------
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
(cherry picked from commit 0e43aeb1b6c37f6c27b7940801b40bbe1ae3ad69)
Connection is not a required attribute for a DatabaseService.
In order to avoid errors we are removing the dependency on this
attribute and checking that the DatabaseServiceType belongs to either
Snowflake, Redshift or BigQuery, which are the supported databases for
this feature.
