9736 Commits

Author SHA1 Message Date
Shailesh Parmar
8fe184dce8
#15260 UI: consistent user/team selectable list for all the places in ui (#16047) 2024-04-26 10:03:23 +05:30
Sachin Chaurasiya
a526aa55e1
fix: 404 page layout (#16044)
* fix: 404 page layout

* Fix 404 page layout issue
2024-04-26 00:42:37 +05:30
sonika-shah
a9773b9527
Add predefined color palette for UI styling assets (#15982)
* Add predefined color palette for UI styling assets - backend

* Update UI components to use customLogoConfig in applicationConfig

* Update UI components to use customLogoConfig and customTheme in applicationConfig

* Update UI components to use customLogoConfig and customTheme in applicationConfig

* Update UI components to use customLogoConfig and customTheme in AppearanceConfigSettingsPage.tsx

* Update UI components to use customLogoConfig and customTheme in AppearanceConfigSettingsPage.test.tsx

* Remove existing customLogoConfiguration

* Refactor App.tsx and ThemeUtils.ts files

* Update AppearanceConfigSettingsPage.tsx with new imports and default theme values

* Update AppearanceConfigSettingsPage.tsx with new imports and reset functionality

* add cypress test

* Fix color update issue in CustomThemeConfig.spec.ts

* Remove existing customLogoConfiguration -migration changes

* Fix theme configuration initialization in useApplicationStore.ts

* Update CustomThemeConfig.spec.ts to check if the color is updated

* update existing customLogoConfiguration with customUiThemePreference -migration changes

* Update CustomThemeConfig.spec.ts to fix color update check

* Add unit tests for ThemeUtils

* move validateJsonSchema method to JsonUtils

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2024-04-25 22:43:02 +05:30
Shailesh Parmar
016f585e14
#14440 Enhance table details, and restore the test case states in column profiler tab (#16024)
Co-authored-by: Teddy <teddy.crepineau@gmail.com>
2024-04-25 22:05:58 +05:30
Pere Miquel Brull
7db1612c13
#6420 - Allow better bot role binding (#15966)
* #6420 - Allow better bot role binding

* format

* Add bot user role in data file

* Add bot user role in data file

* Trigger Build

* Trigger Build
2024-04-25 18:27:45 +02:00
Pere Miquel Brull
39dde222b2
MINOR - Migration validation list diff message (#16015)
* MINOR - Migration validation list diff message

* wording

* Trigger Build
2024-04-25 18:21:00 +02:00
Teddy
4ed87a4d08
Fix #15341 - Test Case reference as inherited field for Test Case Incident (#16027)
* fix: unique test computation to scalar_subquery

* fix: make test case reference an inherited field

* style: ran java linting

* fix: added test case resolution migration

* style: ran java linting
2024-04-25 17:31:11 +02:00
Chirag Madlani
e8d9490b0e
fix(ui): invalid redirect for frequently joined columns (#16020)
* fix(ui): invalid redirect for frequently joined columns

* added cypress
2024-04-25 18:52:12 +05:30
Pere Miquel Brull
4b4a7d70aa
MINOR - Add default to ingestion dependency sh (#16021)
* MINOR - Add default to ingestion dependency sh

* MINOR - Add default to ingestion dependency sh
2024-04-25 14:18:41 +02:00
Pere Miquel Brull
8a3a9516ca
FIX - UserResource CI (#16034) 2024-04-25 14:08:07 +02:00
Mayur Singal
db8102271e
Fix #12502: Add support for lineage export (#16009) 2024-04-25 16:08:50 +05:30
Onkar Ravgan
828e9abc97
Added enum support in custom prop python sdk (#16026) 2024-04-25 14:46:55 +05:30
Mayur Singal
976e4b304f
MINOR: Ignore lineage edge not found logs (#16019) 2024-04-25 14:16:51 +05:30
Mayur Singal
b14b191416
MINOR: Add support for search index column lineage (#16032) 2024-04-25 14:15:02 +05:30
Teddy
5fe8024708
doc: added classifier config breaking change (#16036) 2024-04-25 10:05:08 +02:00
Ayush Shah
18ba585d2f
Revert from DBA_ to ALL_ (#16030) 2024-04-25 13:02:47 +05:30
Ayush Shah
3621407642
Fixes #15732: Modify Reference for Tags to EntityName (#15938) 2024-04-25 11:53:46 +05:30
Onkar Ravgan
536aa62748
Added None option to db config (#15994) 2024-04-25 10:20:09 +05:30
Ayush Shah
a15da7ec98
Issue #14812: Add support for empty string as missing count (#16017) 2024-04-25 09:45:26 +05:30
Akash Jain
f90f1301d9
chore(docs): Update Helm Values; Azure Key Vault Docs for 1.4.X (#16014)
* chore(docs): Update Helm Values; Azure Key Vault Docs for 1.4.X

* fix: use bare-metal config values and update example

* docs: Add note on PIPELINE_SERVICE_CLIENT_SECRETS_MANAGER_LOADER usage with Helm Values
2024-04-24 12:23:58 +02:00
Shailesh Parmar
cd73328f87
#11951 Column Profiling metrics based on data type (for UI and calculations) (#15987)
* #11951 Column Profiling metrics based on data type (for UI and calculations)

* fixed cypress

* fixed cypres test

* fixed cypress test
2024-04-24 15:51:06 +05:30
Teddy
9f49b41acf
fix: remove classifier config from openmetadata config file (#15998)
BREAKING CHANGE: if you previously used your own classifier this will remove its support
2024-04-24 11:41:40 +02:00
Shilpa Vernekar
8ad4c4c4c7
Added the missing doc on Conversation Threads (#15949)
* Added the missing doc on Conversation Threads

* Deleted the duplicate document
2024-04-24 11:34:01 +02:00
Raduś
207b5d9445
Fixes 15839: More accurate documentation about setting up Secret Manager in Azure (#16000)
* added docs on kv setup in azure

* less about App Registration

---------

Co-authored-by: Radosław Niemczyk <radoslaw.niemczyk@stark.dk>
2024-04-24 11:08:47 +02:00
Ayush Shah
595117f8b4
Minor: Fixes #15776 Numeric out of value error Trino (#15995) 2024-04-24 13:06:08 +05:30
Ayush Shah
8c26d2748d
Fix Import error (#16011) 2024-04-24 13:05:55 +05:30
Imri Paran
91a98a82ad
delete ingestion/src/metadata/__init__.py (#16004) 2024-04-24 09:30:54 +02:00
RabochiyYan
c90f1c0010
issue-15607 (#16002)
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2024-04-24 08:08:22 +02:00
Pere Miquel Brull
e6c79ce810
#15901 - Non-admins cannot see users' mails (#15983)
* nullify mail

* #15901 - Non-admins cannot see users' mails

* hide masked email

* fix tests

---------

Co-authored-by: Chira Madlani <chirag@getcollate.io>
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2024-04-24 07:28:35 +02:00
Teddy
5606e6209d
FIX #15593 - test case exc summary endpoint improvements (#15992) 2024-04-23 20:30:05 +02:00
Sachin Chaurasiya
0e61d41e73
fix: redirect url path cookie expiry (#15970) 2024-04-23 18:00:22 +05:30
Ayush Shah
cf914dea94
Fix Inspector (#15997) 2024-04-23 16:32:30 +05:30
Teddy
a4b856956d
fix: compute unique and count at the same time (#15996) 2024-04-23 12:38:49 +02:00
Alexander Nedomets
e996f15a7d
ISSUE-15426 increase the server response rate GET /v1/dataQuality/testCases (#15442)
* ISSUE-15426 increase the server response rate for endpoint GET /v1/dataQuality/testCases

* fix style code

---------

Co-authored-by: Teddy <teddy.crepineau@gmail.com>
2024-04-23 12:38:02 +02:00
Ayush Shah
0963a111fe
Fixes #12127: Add Support for Complex types of Databricks & UnityCatalog in profiler (#15976) 2024-04-23 15:54:36 +05:30
Pere Miquel Brull
df5d5e1866
MINOR - Fix datamodel lineage call (#15991)
* MINOR - Fix datamodel lineage call

* amend merge
2024-04-23 09:56:24 +02:00
Shailesh Parmar
14ba83a427
cypress: fixed service ingestion cypress for test connection (#15989)
* cypress: fixed service ingestion cypress for test connection

* remove unwanted wait for get request
2024-04-23 12:12:51 +05:30
Sachin Chaurasiya
2ee0d6f847
fix(#15924): 'Learn More' links on my-data page have 2 URLS combined as one (#15980)
* fix(#15924): 'Learn More' links on my-data page have 2 URLS combined as one

* address comments
2024-04-23 11:40:48 +05:30
Mayur Singal
85b6983eee
Fix #15062 & #14810: Fix Column level lineage overwrites pipeline Lineage & manual col lineage (#15897) 2024-04-23 09:37:43 +05:30
Teddy
449a5f2de3
FIX #11951 - ingestion logic for global profiler config (#15948)
* feat: add global metric configuration for the profiler

* style: ran java linting

* fix: renamed disable to disabled

* style: ran java linting

* feat: ometa sdk for profiler setting

* test: ingestion profiler global config tests

* fix: update metric name to use MetricType Enum

* fix: allow bot to retrieve settings

* fix: exclude GX artifacts

* feat: implement global profiler setting logic for ingestion side

* fix: exclude metrics if Metric is empty

* style: ran python linting

* style: ran python linting

* fix: skip empty metrics

* style: ran python linting

* fix: moved GET profiler config to seperate endpoint in system resource

* fix: moved compute metric filter to MetricFilter + renamed container

* fix: test failures

* fix: profiler test case
2024-04-22 22:35:37 +02:00
Imri Paran
93ec391f5c
MINOR: Dynamodb sample data (#15264)
* feat(nosql-profiler): row count

1. Implemented the NoSQLProfilerInterface as an entrypoint for the nosql profiler.
2. Added the NoSQLMetric as an abstract class.
3. Implemented the interface for the MongoDB database source.
4. Implemented an e2e test using testcontainers.

* added profiler support for mongodb connection

* doc

* use int_admin_ometa in test setup

* - fixed linting issue in gx
- removed unused inheritance

* moved the nosql function into the metric class

* feat(profiler): add dynamodb row count

* feat(profiler): add dynamodb row count

* formatting

* validate_compose: raise exception for bad status code.

* fixed import

* format

* feat(nosql-profiler): added sample data

1. Implemented the NoSQL sampler.
2. Some naming changes to the NoSQL adaptor to avoid fixing names with the profiler interface.
3. Tests.

* added default sample limit

* formatting

* fixed import

* feat(profiler): dynamodb sample data

* tests for dynamo db sample data

* format

* format

* use service connection for nosql adaptor factory

* fixed tests

* format

* fixed after merge
2024-04-22 17:46:40 +02:00
IceS2
cb801dedb4
FIXES 13209: Add Sagemaker Model Storage (#15986)
* Add Sagemaker Model Storage

* Fix checkstyle

* Sagemaker unittest

* Small refactor to be less verbose
2024-04-22 16:53:25 +02:00
Chirag Madlani
14698aff62
test(e2e): export basic details from EntityClass.ts (#15990) 2024-04-22 19:42:56 +05:30
IceS2
08c114c340
FIXES 15626: Fix issue with not url model store (#15974)
* Changed the MLModelStore storage type to string

* fix checkstyle

* remove unused files

* Update requirements

* fix checkstyle

* Skipping MLFlow intergration on python 3.8

* Hack to allow pytest to parse the mlflow integrations test on python 3.8

* Fix checkstyle
2024-04-22 15:50:44 +02:00
Mayur Singal
c04ec3e922
Fix #14973: Qliksense - Add option to disable hostname validation (#15954) 2024-04-22 18:49:59 +05:30
Mohit Yadav
27e9012a56
Activity Feed Improvements (#15840)
* - Created Specific Schemas for different change Events
- Added Card Style for different Events
- Added Feed Info for runtime card creation and graph drawing in case test Case Result updates

* Review comment

* Test fix

* Revert unrequired changes

* Reverted changes

* Fixed Tests

* fix test

* Add Domain, Data Producs Asset addition/removal Uppdates

* Probale test case failure fix

* Followers Fields
2024-04-22 18:42:40 +05:30
Mohit Yadav
c2193a963f
fix- Allow Lineage for stored Procedure (#15397)
* Allow Lineage for stored Procedure

* Add Node in case of empty edges

* Add for OpenSearchClient
2024-04-22 17:42:39 +05:30
Imri Paran
249d6a03b6
fixed pytest workflow environment (#15984) 2024-04-22 15:03:53 +05:30
Imri Paran
2e1786f7b6
MINOR: use polling mechanism for bnackend tests (#15962)
* handle unstable tests

* handle retry by polling ES

* remove waitForAsyncOp

* use retry

* format

* poll elastic for 10 seconds

* fixed tag delete test with polling

* poll up to 3 seconds

* fixed tag delete test again

* fixed assertEntityReferenceFromSearch

* fixed assertEntityReferenceFromSearch

* better error messages
2024-04-22 11:10:59 +02:00
Sachin Chaurasiya
3435a9612e
UI: Refactor service configuration retrieval in ServiceUtilClassBase (#15959) 2024-04-22 14:04:40 +05:30