1565 Commits

Author SHA1 Message Date
Mayur Singal
a4d62f6d85
MINOR: Add location path to table entity (#18307) 2024-10-21 10:31:27 +05:30
Sriharsha Chintalapani
9bffbfc3d5
Fix #18007: Disabled Classifications or Tags shouldn't be visible in UI (#18242)
* Fix #18007: Disabled Classifications or Tags shouldn't be visible in UI

* added playwright test for disabled tags should not be visible while search

* replace testing tag to new generated one to avoid flakyness

* added test for checking tags are re-enabling it from disabled state

* fix the playwright test for the wrong column selector

---------

Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2024-10-19 14:18:38 -07:00
Sriharsha Chintalapani
85cc240e1e
Minor: Add an API to list all the properties and custom properties for a given entity type (#18248)
* Minor: Add an API to list all the properties and custom properties for a given entity type

* Minor: Add an API to list all the properties and custom properties for a given entity type

* add custom properties

* add custom properties

* add custom properties
2024-10-19 14:14:34 -07:00
Sriharsha Chintalapani
868231e051
Fix Search RBAC, avoid processing Operations other than ViewAll, ViewBasic, ALL (#18328) 2024-10-19 14:13:56 -07:00
Teddy
781989e5bc
MINOR - live index on test suite creation (#18317)
* fix: live index on test suite creation

* fix: make live indexing use entityInterface
2024-10-18 12:07:11 +02:00
Sriharsha Chintalapani
c78cda6757
Minor: Fix rbac for multiple rules (#18057)
* Minor: Search RBAC, fix condition evaluation for single policy multiple rules

* Minor: Search RBAC, fix condition evaluation for single policy multiple rules

* add test for complex policies

* Add viewAll policy to organization

---------

Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
2024-10-17 19:15:06 -07:00
Ethan
e708a3242e
feat: update version (#18259) 2024-10-17 16:18:37 -07:00
Teddy
ff95f84aa9
MINOR: added testSuite field back to lineage response (#18313)
* fix: added testSuite field back to lineage response

* style: fix style
2024-10-17 08:59:10 -07:00
Teddy
d20ee5cc8a
MINOR - added test case results to search reindex (#18277)
* feat: added test case results to search reindex

* fix: failing typescript test case
2024-10-17 11:50:46 +02:00
Teddy
28727b1c16
fix: remove test case result index from all index (#18295) 2024-10-17 09:28:14 +02:00
Teddy
fc51d7feb4
FIX #17042 - Allow non admin/bot to read profiler global config (#18292)
* fix: custom properties folder name in generation to match expected package name (i.e. customProperties -- uppercase P)

* fix: allow non admin/bot to read profiler global config with the right permission

* style: ran java linting

* fix: custom properties import casing
2024-10-17 09:27:34 +02:00
sonika-shah
b175f6cb7e
Minor : increase MAX_AGGREGATE_SIZE in search (#18299) 2024-10-16 13:43:22 -07:00
Siddhant
42eea35aff
correct negative values of the changeCount. (#18279) 2024-10-16 17:51:00 +00:00
Sriharsha Chintalapani
6ffce0f4a5
Minor: Add an option to execute data migrations in ext migrations (#18267)
* Minor: Add an option to execute data migrations in ext migrations

* Minor: Add an option to execute data migrations in ext migrations
2024-10-16 08:56:29 -07:00
sonika-shah
30497528bc
feat: add Import/export support for table type custom property in glossary (#18262)
* import/export support for table type custom property

* remove logs

* Add backend tests

* ui: add custom type property parsing

* print rows in the order of columns defined in config

* ui: handle special chars pasring for custom property import/export

* ui:improve table type property parsing

* ui:fix sql input styling

* ui: improve the parsing for table type property

* ui: fix parsing for markdown, string and sqlQuery properties

* ui: fix parsing for table type property

* ui: fix unit test

* fix backend tests

* remove unwanted comments

* ui: add playwright test for table type import/export part1

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2024-10-16 15:44:38 +05:30
sonika-shah
f366827208
GEN-1662 : Fix - on dashboard soft delete, chart should not be visible (#18283) 2024-10-15 21:34:58 -07:00
sonika-shah
831cccf71e
Minor : Fix exception in search due to exception in database.displayName and databaseSchema.aggregation (#18270)
* Minor : Update database.displayName in search indexes from text to keyword

* Update for databaseSchema.displayName and serviceType in search indexes from text to keyword

* Revert "Update for databaseSchema.displayName and serviceType in search indexes from text to keyword"

This reverts commit 16408d81a234b505cfe794dd983f282612c10c9f.

Revert commit changes - 1

* Revert "Minor : Update database.displayName in search indexes from text to keyword"

This reverts commit 2264563f726df07db85ddfea09826e5cfe1fd076.

* print rows in the order of columns defined in config
2024-10-16 08:23:41 +05:30
Teddy
c6586d338d
fix: add domain params for test suite search list filter (#18263) 2024-10-15 20:45:19 +02:00
Imri Paran
be82086e25
MINOR: add column case sensitivity parameter (#18115)
* fix(data-quality): table diff

- added handling for case-insensitive columns
- added handling for different numeric types (int/float/Decimal)
- added handling of boolean test case parameters

* add migrations for table diff

* add migrations for table diff

* removed cross type diff for now. it appears to be flaky

* fixed migrations

* use casefold() instead of lower()

* - implemented utils.get_test_case_param_value
- fixed params for case sensitive column

* handle bool test case parameters

* format

* testing

* format

* list -> List

* list -> List

* - change caseSensitiveColumns default to fase
- added migration to stay backward compatible

* - removed migration files
- updated logging message for table diff migration

* changed bool test case parameters default to always be false

* format

* docs: data diff

- added the caseSensitiveColumns parameter

requires: https://github.com/open-metadata/OpenMetadata/pull/18115

* fixed test_get_bool_test_case_param
2024-10-15 16:29:43 +02:00
sonika-shah
62ee79e71e
GEN-1836: Table custom property enhancements (#18239)
* Table custom property enhancements

* ui: remove rowCount

* minor style file changes

* minor change to show no data placeholder

* add icons for property types

* fix type filtering issue

* fix spacing issue for custom properties card

* refactor comments and style file

* fix test

* add playwright test for adding/updating table type property in entity

* add sesrchField for search property by name

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2024-10-15 12:41:10 +05:30
Pere Miquel Brull
9496da1997
MINOR - Improve exception messages for JWT Filter (#18231)
* MINOR - Improve exception messages for JWT Filter

* MINOR - Improve exception messages for JWT Filter
2024-10-14 10:22:11 +02:00
Sriharsha Chintalapani
da6ce5c63b
Minor: Add deleteEntityByFQNPrefix (#18243) 2024-10-13 09:22:22 -07:00
Siddhant
07b039b8b8
Migrations fixes for #17967 (#18232)
* fix migrations.

* fix logging
2024-10-11 13:51:12 +00:00
Imri Paran
4d775cff0b
GEN-1793: fix app config from resource (#18228)
* fix: app config from resource

* removed useless logging
2024-10-11 10:59:43 +02:00
Teddy
add22b5d28
GEN 1654 - Fix Alerts for Test Suites (#18222)
* fix: test suite alerts

* fix: return testSuites field for test suite alerts

* style: ran java linting
2024-10-11 10:26:13 +02:00
sonika-shah
7d736f6195
Feature : Add table-type custom property (#18135)
* Feature : Add table-type custom property

* ui: remove enumWithDescriptions property

* Refactor AddCustomProperty component to remove unused EnumWithDescriptionsConfig import and property

* ui: add support for creating and updating the table-type property

* add rowCount field in table-type and clean logic of validation

* add rowCount field in table-type and clean logic of validation

* add rowCount field in table-type and clean logic of validation

* ui: add support for adding value to table type property part 1

* use rowCount from the API

* default row-count to 10

* fix tooltip to read rowcount from the props

* fix empty row issue

* rename from table-type to table-cp

* Refactor table type property to handle empty rows and display in modal

* Refactor table type property to handle empty rows and display in modal

* use locales for messages

* minor change

* ui: use column layout for rendering custom properties cards

* remove enumwithDescriptions from backend and add tests for table type

* fix unit test

* fix playwright

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2024-10-10 13:43:19 -07:00
Pere Miquel Brull
bba6e46fe5
FIX - App Extension migration JSONB (#18219) 2024-10-10 16:40:57 +02:00
Mohit Yadav
81729bf36b
[OnBoardingApp] Add apps data store (#18209)
* fix(ui): pagination issue with search in services list page

* Add Apps Data store

* Revert Services Changes

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2024-10-10 19:25:11 +05:30
Teddy
ad39b38b10
fix: broken DQ alerts from PR #18014 (#18181) 2024-10-10 11:09:37 +02:00
Mohit Yadav
6098a34687
Order Apps (#18179) 2024-10-09 14:21:28 +05:30
Pere Miquel Brull
4b2d37babc
FIX - App Extension Migration (#18176) 2024-10-09 09:34:18 +02:00
Sachin Chaurasiya
457f3d919a
GEN-1322: API Entity - Remove Beta (#17967)
* GEN-1322: API Entity - Remove Beta

* minor: add doc for the metadata pipeline

* api service refactor

* api service refactor backend changes

* add apiconnection in test service connection

* pytest fix

* fix java file formatting

* Fix casing of REST in ApiServiceRest.spec.ts

* Refactor REST to Rest in API classes

* minor change

* minor change

* minor change

* fix cashing for API to Api

* add playwright test for api service ingestion

* fix: playwright test

---------

Co-authored-by: harshsoni2024 <harshsoni2024@gmail.com>
2024-10-08 14:39:55 +05:30
Teddy
1948cf7d05
MINOR - Add support for additional aggregation (#18129)
* fix import issue

* fix: added origin entity FQN to test case index

* feat: added aggregation support for bucket selector

* feat: moved aggregation builder to its own class

* style: ran java linting

* fix: typos

* style: ran java linting

* feat: implement aggregation builder graph

* feat: clean up existing aggregation implementation for graph builder

* style: ran java linting

* fix: clean up comment

* style: fix java linting

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2024-10-08 07:35:40 +02:00
Pere Miquel Brull
1a42f4633e
FIX - PG AppName Migration (#18139) 2024-10-07 16:35:16 +02:00
Ayush Shah
2c84442e39
fix: Empty Connection Overwrite Logic (#18122) 2024-10-07 10:10:57 +05:30
Mohit Yadav
7ae81272b3
Fix performance issue (#18128)
* Fix ClassGraph

* Use CONST
2024-10-05 10:38:22 -07:00
Mayur Singal
52ea9ea81e
Fix #18005: Mask Greenplum Password (#18047) 2024-10-04 16:57:15 +05:30
Mohit Yadav
a352a7ca6c
[GEN-1704] Remove Table Details from Import/Export at table level (#18093)
* [GEN-1704] Remove Table Details from Import/Export at table level, and only add columns

* Fix Tests
2024-10-04 10:07:45 +05:30
Mayur Singal
eada21326a
GEN-1215: DI Populate Test Case Result & Resolution Status (#17969) 2024-10-03 16:30:53 +05:30
Pere Miquel Brull
e81efc8d98
MINOR - Add App Limits (#18072)
* App Limits - Prep extension

* App Limits - Prep extension

* App Limits - Allow to search by name

* App Limits - Allow to search by name

* fix postgres sql

* comments
2024-10-03 11:00:29 +02:00
Teddy
751bceb763
MINOR - Reduce lineage response size (#18080)
* fix import issue

* fix: reduce response size and exclude fields in search client source

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2024-10-03 08:13:13 +02:00
Teddy
4cfce98090
GEN 1409 - Logic to fetch DQ Lineage (#18069)
* fix import issue

* feat: added dq lineage tracing logic

* fix: move dq lineage to its own endpoint

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2024-10-02 15:15:26 +02:00
Siddhant
ed052596e8
[IMPROVEMENT] Add Support for Custom Headers and HTTP Methods in Generic Webhook (#18056)
* Add support for custom headers and JSON payload configuration in webhook

* move testDestination API to EventSubscriptionResource

* support POST and PUT http ops for generic webhook requests

* fix name

* remove json field from webhook

* fix getEmailTestMessage

* refactor exception handling
2024-10-02 09:20:12 +05:30
sonika-shah
f6b6874f57
Minor : fix term references validation msg on glossary import (#18058) 2024-10-01 14:21:33 +05:30
Mohit Yadav
66cd00c568
Fix Ops (#18061) 2024-10-01 12:31:08 +05:30
sonika-shah
683193fb41
Fix #18035 - getting type null exception on feed (#18052) 2024-10-01 10:49:48 +05:30
sonika-shah
1d727d57bd
Feature: Allow Custom Property Update in Glossary Bulk Import/export (#17919)
* fix import issue

* Feat : Allow Custom Property Update in Bulk Upload

* Feat : Allow Custom Property Update in Bulk Upload

* supported editable imports in glossary page

* added remaning localizaion keys

* update logic of fieldToExtensionStrings to use csvparser

* update json and partialStatus condition

* fix tests for partialSuccess status change

* supported customProperty editable field

* fix error in custom property edit modal on new line empty custom property

* added entity type from root to support other bulk import entity as well

* fix the quote removing due to the regex in the string type

* Add backend tests , and error msg improvements

* GlossaryStatus header change

* fix unit test and dry run in case of synonyms having quotes in it

* Remove extension column in CSVs for all entities except glossaryTerm

* added editor for reviewers

* unit test around csv utils

* added escape for string too, in case of semicolon comes

* added playwright test without extension and supported relatedTerm as editable

* added unit test around csv util logic

* resolve conflicts

* Backend - add support for enumWithDescriptions in bulk import

* add tests and other error handling improvements related to enumWithDescriptions

* fix the custom property modal header and render the layout as per right panel in entities

* parese enumWithDescription for the customProperty modal while editable

* fix description data in enumWithDescription one

* fix: Handle NullPointerException when adding custom properties to ensure loop continues for other schemas of the same type for addToRegistry

* added extension playwrigth test and fix enumWithDescription object failure

* descrease the size of extension  modal

* remove additional comments

* fix the escape in parent key

* improve custom property layout

* improve ui for inline properties

* fix description, glossary and relatedTerm escape char issue

* fix some customProperty ui changes

* fix sonar issue

* minor layout changes

* minor label improvements for entity ref and list

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2024-10-01 00:12:43 +05:30
Mohit Yadav
f1ae49e1a0
[Search] Indexing Fixes (#18048)
* Fix OpenSearch Content Size Issue
entity content is too long [204857600] for the configured buffer limit [104857600]

* Change Type to Long

* Add Payload Size to take dynamic entry

* Migrations for 1.5.6

* Mark Stale Entries Stopped

* Format checkstyle

* Fix failure

---------

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2024-09-30 23:39:27 +05:30
Teddy
9552886f29
GEN 1211 - Added TTResp and TTReso metrics (#18033)
* fix import issue

* feat: compute test case resolution metrics

* feat: added  index key to resolution index

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2024-09-30 14:21:41 +02:00
Mayur Singal
fd75db3e9b
MINOR: DI Missing Dashboard Description Status (#18018) 2024-09-30 11:06:22 +05:30