10673 Commits

Author SHA1 Message Date
Mayur Singal
b14b191416
MINOR: Add support for search index column lineage (#16032) 2024-04-25 14:15:02 +05:30
Teddy
5fe8024708
doc: added classifier config breaking change (#16036) 2024-04-25 10:05:08 +02:00
Ayush Shah
18ba585d2f
Revert from DBA_ to ALL_ (#16030) 2024-04-25 13:02:47 +05:30
Ayush Shah
3621407642
Fixes #15732: Modify Reference for Tags to EntityName (#15938) 2024-04-25 11:53:46 +05:30
Onkar Ravgan
536aa62748
Added None option to db config (#15994) 2024-04-25 10:20:09 +05:30
Ayush Shah
a15da7ec98
Issue #14812: Add support for empty string as missing count (#16017) 2024-04-25 09:45:26 +05:30
Akash Jain
f90f1301d9
chore(docs): Update Helm Values; Azure Key Vault Docs for 1.4.X (#16014)
* chore(docs): Update Helm Values; Azure Key Vault Docs for 1.4.X

* fix: use bare-metal config values and update example

* docs: Add note on PIPELINE_SERVICE_CLIENT_SECRETS_MANAGER_LOADER usage with Helm Values
2024-04-24 12:23:58 +02:00
Shailesh Parmar
cd73328f87
#11951 Column Profiling metrics based on data type (for UI and calculations) (#15987)
* #11951 Column Profiling metrics based on data type (for UI and calculations)

* fixed cypress

* fixed cypres test

* fixed cypress test
2024-04-24 15:51:06 +05:30
Teddy
9f49b41acf
fix: remove classifier config from openmetadata config file (#15998)
BREAKING CHANGE: if you previously used your own classifier this will remove its support
2024-04-24 11:41:40 +02:00
Shilpa Vernekar
8ad4c4c4c7
Added the missing doc on Conversation Threads (#15949)
* Added the missing doc on Conversation Threads

* Deleted the duplicate document
2024-04-24 11:34:01 +02:00
Raduś
207b5d9445
Fixes 15839: More accurate documentation about setting up Secret Manager in Azure (#16000)
* added docs on kv setup in azure

* less about App Registration

---------

Co-authored-by: Radosław Niemczyk <radoslaw.niemczyk@stark.dk>
2024-04-24 11:08:47 +02:00
Ayush Shah
595117f8b4
Minor: Fixes #15776 Numeric out of value error Trino (#15995) 2024-04-24 13:06:08 +05:30
Ayush Shah
8c26d2748d
Fix Import error (#16011) 2024-04-24 13:05:55 +05:30
Imri Paran
91a98a82ad
delete ingestion/src/metadata/__init__.py (#16004) 2024-04-24 09:30:54 +02:00
RabochiyYan
c90f1c0010
issue-15607 (#16002)
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2024-04-24 08:08:22 +02:00
Pere Miquel Brull
e6c79ce810
#15901 - Non-admins cannot see users' mails (#15983)
* nullify mail

* #15901 - Non-admins cannot see users' mails

* hide masked email

* fix tests

---------

Co-authored-by: Chira Madlani <chirag@getcollate.io>
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2024-04-24 07:28:35 +02:00
Teddy
5606e6209d
FIX #15593 - test case exc summary endpoint improvements (#15992) 2024-04-23 20:30:05 +02:00
Sachin Chaurasiya
0e61d41e73
fix: redirect url path cookie expiry (#15970) 2024-04-23 18:00:22 +05:30
Ayush Shah
cf914dea94
Fix Inspector (#15997) 2024-04-23 16:32:30 +05:30
Teddy
a4b856956d
fix: compute unique and count at the same time (#15996) 2024-04-23 12:38:49 +02:00
Alexander Nedomets
e996f15a7d
ISSUE-15426 increase the server response rate GET /v1/dataQuality/testCases (#15442)
* ISSUE-15426 increase the server response rate for endpoint GET /v1/dataQuality/testCases

* fix style code

---------

Co-authored-by: Teddy <teddy.crepineau@gmail.com>
2024-04-23 12:38:02 +02:00
Ayush Shah
0963a111fe
Fixes #12127: Add Support for Complex types of Databricks & UnityCatalog in profiler (#15976) 2024-04-23 15:54:36 +05:30
Pere Miquel Brull
df5d5e1866
MINOR - Fix datamodel lineage call (#15991)
* MINOR - Fix datamodel lineage call

* amend merge
2024-04-23 09:56:24 +02:00
Shailesh Parmar
14ba83a427
cypress: fixed service ingestion cypress for test connection (#15989)
* cypress: fixed service ingestion cypress for test connection

* remove unwanted wait for get request
2024-04-23 12:12:51 +05:30
Sachin Chaurasiya
2ee0d6f847
fix(#15924): 'Learn More' links on my-data page have 2 URLS combined as one (#15980)
* fix(#15924): 'Learn More' links on my-data page have 2 URLS combined as one

* address comments
2024-04-23 11:40:48 +05:30
Mayur Singal
85b6983eee
Fix #15062 & #14810: Fix Column level lineage overwrites pipeline Lineage & manual col lineage (#15897) 2024-04-23 09:37:43 +05:30
Teddy
449a5f2de3
FIX #11951 - ingestion logic for global profiler config (#15948)
* feat: add global metric configuration for the profiler

* style: ran java linting

* fix: renamed disable to disabled

* style: ran java linting

* feat: ometa sdk for profiler setting

* test: ingestion profiler global config tests

* fix: update metric name to use MetricType Enum

* fix: allow bot to retrieve settings

* fix: exclude GX artifacts

* feat: implement global profiler setting logic for ingestion side

* fix: exclude metrics if Metric is empty

* style: ran python linting

* style: ran python linting

* fix: skip empty metrics

* style: ran python linting

* fix: moved GET profiler config to seperate endpoint in system resource

* fix: moved compute metric filter to MetricFilter + renamed container

* fix: test failures

* fix: profiler test case
2024-04-22 22:35:37 +02:00
Imri Paran
93ec391f5c
MINOR: Dynamodb sample data (#15264)
* feat(nosql-profiler): row count

1. Implemented the NoSQLProfilerInterface as an entrypoint for the nosql profiler.
2. Added the NoSQLMetric as an abstract class.
3. Implemented the interface for the MongoDB database source.
4. Implemented an e2e test using testcontainers.

* added profiler support for mongodb connection

* doc

* use int_admin_ometa in test setup

* - fixed linting issue in gx
- removed unused inheritance

* moved the nosql function into the metric class

* feat(profiler): add dynamodb row count

* feat(profiler): add dynamodb row count

* formatting

* validate_compose: raise exception for bad status code.

* fixed import

* format

* feat(nosql-profiler): added sample data

1. Implemented the NoSQL sampler.
2. Some naming changes to the NoSQL adaptor to avoid fixing names with the profiler interface.
3. Tests.

* added default sample limit

* formatting

* fixed import

* feat(profiler): dynamodb sample data

* tests for dynamo db sample data

* format

* format

* use service connection for nosql adaptor factory

* fixed tests

* format

* fixed after merge
2024-04-22 17:46:40 +02:00
IceS2
cb801dedb4
FIXES 13209: Add Sagemaker Model Storage (#15986)
* Add Sagemaker Model Storage

* Fix checkstyle

* Sagemaker unittest

* Small refactor to be less verbose
2024-04-22 16:53:25 +02:00
Chirag Madlani
14698aff62
test(e2e): export basic details from EntityClass.ts (#15990) 2024-04-22 19:42:56 +05:30
IceS2
08c114c340
FIXES 15626: Fix issue with not url model store (#15974)
* Changed the MLModelStore storage type to string

* fix checkstyle

* remove unused files

* Update requirements

* fix checkstyle

* Skipping MLFlow intergration on python 3.8

* Hack to allow pytest to parse the mlflow integrations test on python 3.8

* Fix checkstyle
2024-04-22 15:50:44 +02:00
Mayur Singal
c04ec3e922
Fix #14973: Qliksense - Add option to disable hostname validation (#15954) 2024-04-22 18:49:59 +05:30
Mohit Yadav
27e9012a56
Activity Feed Improvements (#15840)
* - Created Specific Schemas for different change Events
- Added Card Style for different Events
- Added Feed Info for runtime card creation and graph drawing in case test Case Result updates

* Review comment

* Test fix

* Revert unrequired changes

* Reverted changes

* Fixed Tests

* fix test

* Add Domain, Data Producs Asset addition/removal Uppdates

* Probale test case failure fix

* Followers Fields
2024-04-22 18:42:40 +05:30
Mohit Yadav
c2193a963f
fix- Allow Lineage for stored Procedure (#15397)
* Allow Lineage for stored Procedure

* Add Node in case of empty edges

* Add for OpenSearchClient
2024-04-22 17:42:39 +05:30
Imri Paran
249d6a03b6
fixed pytest workflow environment (#15984) 2024-04-22 15:03:53 +05:30
Imri Paran
2e1786f7b6
MINOR: use polling mechanism for bnackend tests (#15962)
* handle unstable tests

* handle retry by polling ES

* remove waitForAsyncOp

* use retry

* format

* poll elastic for 10 seconds

* fixed tag delete test with polling

* poll up to 3 seconds

* fixed tag delete test again

* fixed assertEntityReferenceFromSearch

* fixed assertEntityReferenceFromSearch

* better error messages
2024-04-22 11:10:59 +02:00
Sachin Chaurasiya
3435a9612e
UI: Refactor service configuration retrieval in ServiceUtilClassBase (#15959) 2024-04-22 14:04:40 +05:30
IceS2
19fa15f010
fix e2e (#15981) 2024-04-22 09:57:06 +02:00
Imri Paran
0a1018648c
Fixes #15566: add dynamodb row count (#15204)
* feat(nosql-profiler): row count

1. Implemented the NoSQLProfilerInterface as an entrypoint for the nosql profiler.
2. Added the NoSQLMetric as an abstract class.
3. Implemented the interface for the MongoDB database source.
4. Implemented an e2e test using testcontainers.

* added profiler support for mongodb connection

* doc

* use int_admin_ometa in test setup

* - fixed linting issue in gx
- removed unused inheritance

* moved the nosql function into the metric class

* feat(profiler): add dynamodb row count

* feat(profiler): add dynamodb row count

* formatting

* fixed import

* format

* dded dynamodb row count

* format

* removed unused factory file

* removed "validate"

* migrations

* removed validations

* format

* linting

* fixed: test_amundsen.py

* Update schemaChanges.sql
2024-04-22 09:14:52 +02:00
sonika-shah
7221f253bd
Fix issue in search with hierarchy for glossary terms (#15978) 2024-04-22 10:19:38 +05:30
Ayush Shah
9481f142a3
Fix GO SDK repo link (#15971) 2024-04-19 20:48:16 -07:00
Imri Paran
d8781bbef2
MINOR: postgres integration test (#15929)
* implemented postgres-integration-tests

* format

* format

* - disable ryuk
- disabled verbose sqlfluff logging

* query usage assertion
2024-04-19 10:00:37 -07:00
Aniket Katkar
eeaab62e63
Update LogsClassBase.ts to convert method from arrow function (#15969) 2024-04-19 17:22:27 +02:00
Pere Miquel Brull
e01054fe68
MINOR - 1.3.3 release docs (#15972) 2024-04-19 15:14:35 +02:00
Pere Miquel Brull
b1a4faf171
MINOR - Metadata Actions schemas (#15822)
* MINOR - Metadata Actions schemas

* add type for left side menu bar items

* fix the required fields in automatorAppConfig.json schema

* update constants

* mixin

* create new styled component to show in alerts form card

* Add new translations for ingestion pipeline and location

* Fix import statement in AlertDetailsPage.tsx

* Update automatorAppConfig.json schema to use an array for the 'type' property

* config

* move the advanced search configs to a new classBase for better customization

* Update automatorAppConfig.json schema to add "name" and "description" fields

* Update automatorAppConfig.json schema to remove "name" and "description" fields

* Add new translations for description-plural in multiple language files

* filter Automator

* revert remove

* Update pipeline actions interface and component to handle edit click event

* Update select type for advanced search fields in AdvancedSearchClassBase.ts

* Update ErrorPlaceHolderIngestion component to accept cardClassName prop

* Update FormCardSection component to accept className prop

* Update TagsContainerV2 component to include state property in tag data

* Update TagsContainerV2 component to include defaultState and defaultLabelType properties

* Update ingestionPipelineAPI.ts to include applicationType parameter in getIngestionPipelines function

* Update AdvanceSearchProvider.test.tsx to include pathname in useLocation mock

* work on comments

* fix sonar lint errors

* format

* Update useLocation mock in AdvanceSearchProvider.test.tsx to include pathname

* revert remove

* Update LogsViewerPage interfaces and component to include application_task in IngestionPipelineLogByIdInterface

* Update LeftSidebar component to import LeftSidebarItem interface and fix type annotation in children map function

* fix observability alert test

* revert the form list add method change

---------

Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
2024-04-19 12:46:58 +02:00
Mohit Yadav
701e288512
Fix Default App Init (#15965) 2024-04-19 13:45:33 +05:30
Mohit Yadav
b8979ccc42
Fix Vulnerability Flagged (#15961) 2024-04-19 13:28:53 +05:30
Imri Paran
557550c876
fixed exclusion for yaml/json validation (#15950) 2024-04-19 08:45:18 +02:00
Ayush Shah
d5b1465406
Fixes #14113 - Allow SSL file uploads (#15828) 2024-04-19 11:38:27 +05:30
Imri Paran
247e05a83d
MINOR: Update README.md python version (#15893) 2024-04-18 21:33:16 +05:30