12410 Commits

Author SHA1 Message Date
Imri Paran
91a98a82ad
delete ingestion/src/metadata/__init__.py (#16004) 2024-04-24 09:30:54 +02:00
RabochiyYan
c90f1c0010
issue-15607 (#16002)
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2024-04-24 08:08:22 +02:00
Pere Miquel Brull
e6c79ce810
#15901 - Non-admins cannot see users' mails (#15983)
* nullify mail

* #15901 - Non-admins cannot see users' mails

* hide masked email

* fix tests

---------

Co-authored-by: Chira Madlani <chirag@getcollate.io>
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2024-04-24 07:28:35 +02:00
Teddy
5606e6209d
FIX #15593 - test case exc summary endpoint improvements (#15992) 2024-04-23 20:30:05 +02:00
Sachin Chaurasiya
0e61d41e73
fix: redirect url path cookie expiry (#15970) 2024-04-23 18:00:22 +05:30
Ayush Shah
cf914dea94
Fix Inspector (#15997) 2024-04-23 16:32:30 +05:30
Teddy
a4b856956d
fix: compute unique and count at the same time (#15996) 2024-04-23 12:38:49 +02:00
Alexander Nedomets
e996f15a7d
ISSUE-15426 increase the server response rate GET /v1/dataQuality/testCases (#15442)
* ISSUE-15426 increase the server response rate for endpoint GET /v1/dataQuality/testCases

* fix style code

---------

Co-authored-by: Teddy <teddy.crepineau@gmail.com>
2024-04-23 12:38:02 +02:00
Ayush Shah
0963a111fe
Fixes #12127: Add Support for Complex types of Databricks & UnityCatalog in profiler (#15976) 2024-04-23 15:54:36 +05:30
Pere Miquel Brull
df5d5e1866
MINOR - Fix datamodel lineage call (#15991)
* MINOR - Fix datamodel lineage call

* amend merge
2024-04-23 09:56:24 +02:00
Shailesh Parmar
14ba83a427
cypress: fixed service ingestion cypress for test connection (#15989)
* cypress: fixed service ingestion cypress for test connection

* remove unwanted wait for get request
2024-04-23 12:12:51 +05:30
Sachin Chaurasiya
2ee0d6f847
fix(#15924): 'Learn More' links on my-data page have 2 URLS combined as one (#15980)
* fix(#15924): 'Learn More' links on my-data page have 2 URLS combined as one

* address comments
2024-04-23 11:40:48 +05:30
Mayur Singal
85b6983eee
Fix #15062 & #14810: Fix Column level lineage overwrites pipeline Lineage & manual col lineage (#15897) 2024-04-23 09:37:43 +05:30
Teddy
449a5f2de3
FIX #11951 - ingestion logic for global profiler config (#15948)
* feat: add global metric configuration for the profiler

* style: ran java linting

* fix: renamed disable to disabled

* style: ran java linting

* feat: ometa sdk for profiler setting

* test: ingestion profiler global config tests

* fix: update metric name to use MetricType Enum

* fix: allow bot to retrieve settings

* fix: exclude GX artifacts

* feat: implement global profiler setting logic for ingestion side

* fix: exclude metrics if Metric is empty

* style: ran python linting

* style: ran python linting

* fix: skip empty metrics

* style: ran python linting

* fix: moved GET profiler config to seperate endpoint in system resource

* fix: moved compute metric filter to MetricFilter + renamed container

* fix: test failures

* fix: profiler test case
2024-04-22 22:35:37 +02:00
Imri Paran
93ec391f5c
MINOR: Dynamodb sample data (#15264)
* feat(nosql-profiler): row count

1. Implemented the NoSQLProfilerInterface as an entrypoint for the nosql profiler.
2. Added the NoSQLMetric as an abstract class.
3. Implemented the interface for the MongoDB database source.
4. Implemented an e2e test using testcontainers.

* added profiler support for mongodb connection

* doc

* use int_admin_ometa in test setup

* - fixed linting issue in gx
- removed unused inheritance

* moved the nosql function into the metric class

* feat(profiler): add dynamodb row count

* feat(profiler): add dynamodb row count

* formatting

* validate_compose: raise exception for bad status code.

* fixed import

* format

* feat(nosql-profiler): added sample data

1. Implemented the NoSQL sampler.
2. Some naming changes to the NoSQL adaptor to avoid fixing names with the profiler interface.
3. Tests.

* added default sample limit

* formatting

* fixed import

* feat(profiler): dynamodb sample data

* tests for dynamo db sample data

* format

* format

* use service connection for nosql adaptor factory

* fixed tests

* format

* fixed after merge
2024-04-22 17:46:40 +02:00
IceS2
cb801dedb4
FIXES 13209: Add Sagemaker Model Storage (#15986)
* Add Sagemaker Model Storage

* Fix checkstyle

* Sagemaker unittest

* Small refactor to be less verbose
2024-04-22 16:53:25 +02:00
Chirag Madlani
14698aff62
test(e2e): export basic details from EntityClass.ts (#15990) 2024-04-22 19:42:56 +05:30
IceS2
08c114c340
FIXES 15626: Fix issue with not url model store (#15974)
* Changed the MLModelStore storage type to string

* fix checkstyle

* remove unused files

* Update requirements

* fix checkstyle

* Skipping MLFlow intergration on python 3.8

* Hack to allow pytest to parse the mlflow integrations test on python 3.8

* Fix checkstyle
2024-04-22 15:50:44 +02:00
Mayur Singal
c04ec3e922
Fix #14973: Qliksense - Add option to disable hostname validation (#15954) 2024-04-22 18:49:59 +05:30
Mohit Yadav
27e9012a56
Activity Feed Improvements (#15840)
* - Created Specific Schemas for different change Events
- Added Card Style for different Events
- Added Feed Info for runtime card creation and graph drawing in case test Case Result updates

* Review comment

* Test fix

* Revert unrequired changes

* Reverted changes

* Fixed Tests

* fix test

* Add Domain, Data Producs Asset addition/removal Uppdates

* Probale test case failure fix

* Followers Fields
2024-04-22 18:42:40 +05:30
Mohit Yadav
c2193a963f
fix- Allow Lineage for stored Procedure (#15397)
* Allow Lineage for stored Procedure

* Add Node in case of empty edges

* Add for OpenSearchClient
2024-04-22 17:42:39 +05:30
Imri Paran
249d6a03b6
fixed pytest workflow environment (#15984) 2024-04-22 15:03:53 +05:30
Imri Paran
2e1786f7b6
MINOR: use polling mechanism for bnackend tests (#15962)
* handle unstable tests

* handle retry by polling ES

* remove waitForAsyncOp

* use retry

* format

* poll elastic for 10 seconds

* fixed tag delete test with polling

* poll up to 3 seconds

* fixed tag delete test again

* fixed assertEntityReferenceFromSearch

* fixed assertEntityReferenceFromSearch

* better error messages
2024-04-22 11:10:59 +02:00
Sachin Chaurasiya
3435a9612e
UI: Refactor service configuration retrieval in ServiceUtilClassBase (#15959) 2024-04-22 14:04:40 +05:30
IceS2
19fa15f010
fix e2e (#15981) 2024-04-22 09:57:06 +02:00
Imri Paran
0a1018648c
Fixes #15566: add dynamodb row count (#15204)
* feat(nosql-profiler): row count

1. Implemented the NoSQLProfilerInterface as an entrypoint for the nosql profiler.
2. Added the NoSQLMetric as an abstract class.
3. Implemented the interface for the MongoDB database source.
4. Implemented an e2e test using testcontainers.

* added profiler support for mongodb connection

* doc

* use int_admin_ometa in test setup

* - fixed linting issue in gx
- removed unused inheritance

* moved the nosql function into the metric class

* feat(profiler): add dynamodb row count

* feat(profiler): add dynamodb row count

* formatting

* fixed import

* format

* dded dynamodb row count

* format

* removed unused factory file

* removed "validate"

* migrations

* removed validations

* format

* linting

* fixed: test_amundsen.py

* Update schemaChanges.sql
2024-04-22 09:14:52 +02:00
sonika-shah
7221f253bd
Fix issue in search with hierarchy for glossary terms (#15978) 2024-04-22 10:19:38 +05:30
Ayush Shah
9481f142a3
Fix GO SDK repo link (#15971) 2024-04-19 20:48:16 -07:00
Imri Paran
d8781bbef2
MINOR: postgres integration test (#15929)
* implemented postgres-integration-tests

* format

* format

* - disable ryuk
- disabled verbose sqlfluff logging

* query usage assertion
2024-04-19 10:00:37 -07:00
Aniket Katkar
eeaab62e63
Update LogsClassBase.ts to convert method from arrow function (#15969) 2024-04-19 17:22:27 +02:00
Pere Miquel Brull
e01054fe68
MINOR - 1.3.3 release docs (#15972) 2024-04-19 15:14:35 +02:00
Pere Miquel Brull
b1a4faf171
MINOR - Metadata Actions schemas (#15822)
* MINOR - Metadata Actions schemas

* add type for left side menu bar items

* fix the required fields in automatorAppConfig.json schema

* update constants

* mixin

* create new styled component to show in alerts form card

* Add new translations for ingestion pipeline and location

* Fix import statement in AlertDetailsPage.tsx

* Update automatorAppConfig.json schema to use an array for the 'type' property

* config

* move the advanced search configs to a new classBase for better customization

* Update automatorAppConfig.json schema to add "name" and "description" fields

* Update automatorAppConfig.json schema to remove "name" and "description" fields

* Add new translations for description-plural in multiple language files

* filter Automator

* revert remove

* Update pipeline actions interface and component to handle edit click event

* Update select type for advanced search fields in AdvancedSearchClassBase.ts

* Update ErrorPlaceHolderIngestion component to accept cardClassName prop

* Update FormCardSection component to accept className prop

* Update TagsContainerV2 component to include state property in tag data

* Update TagsContainerV2 component to include defaultState and defaultLabelType properties

* Update ingestionPipelineAPI.ts to include applicationType parameter in getIngestionPipelines function

* Update AdvanceSearchProvider.test.tsx to include pathname in useLocation mock

* work on comments

* fix sonar lint errors

* format

* Update useLocation mock in AdvanceSearchProvider.test.tsx to include pathname

* revert remove

* Update LogsViewerPage interfaces and component to include application_task in IngestionPipelineLogByIdInterface

* Update LeftSidebar component to import LeftSidebarItem interface and fix type annotation in children map function

* fix observability alert test

* revert the form list add method change

---------

Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
2024-04-19 12:46:58 +02:00
Mohit Yadav
701e288512
Fix Default App Init (#15965) 2024-04-19 13:45:33 +05:30
Mohit Yadav
b8979ccc42
Fix Vulnerability Flagged (#15961) 2024-04-19 13:28:53 +05:30
Imri Paran
557550c876
fixed exclusion for yaml/json validation (#15950) 2024-04-19 08:45:18 +02:00
Ayush Shah
d5b1465406
Fixes #14113 - Allow SSL file uploads (#15828) 2024-04-19 11:38:27 +05:30
Imri Paran
247e05a83d
MINOR: Update README.md python version (#15893) 2024-04-18 21:33:16 +05:30
IceS2
fd51df25fa
Removed stale examples. Update dependencies (#15951) 2024-04-18 17:41:09 +02:00
Mohit Yadav
bc13659a6d
Inherit sso roles (#15903)
* Use Roles from Provider

* Add Cache For Roles From Users

* Fix Failing Test

* Revert secrets

Update Impl to use loggedInUser and CreateUser for Role assignment and resync

* Revert Expiry check
2024-04-18 20:46:04 +05:30
Mayur Singal
18da8a5964
Fix #15208: Lineage - log query parsing issue summary (#15921) 2024-04-18 19:07:51 +05:30
Imri Paran
b8dc12b30b
aligned pre-commit with Makefile. added check json (#15295)
* aligned pre-commit with Makefile. added check json

* add check for json/yaml files

* add path checks for json/yaml validation
2024-04-18 15:32:38 +02:00
Sachin Chaurasiya
6b3096f43c
ui: improve refresh token usage part 2 (#15947)
* ui: improve refresh token usage part 2

* Fix loading state issue in AuthProvider component
2024-04-18 18:22:34 +05:30
Shailesh Parmar
c7f6db3a61
#13475 ui/backend: test case validation for min max value (#15946) 2024-04-18 17:59:38 +05:30
Mohit Yadav
d1d964867d
Move migration for apps to 1.3.3 all together (#15944) 2024-04-18 14:26:05 +05:30
sonika-shah
45bae608bd
Fixes #10724 : Search with hierarchy api for glossary terms (#15865)
* Fixes #10724 : New search with hierarchy api for glossary terms

* Added query param in existing search api - to search with hierarchy

* Created new json to manage hierarchy and other updates
2024-04-18 14:22:18 +05:30
Mayur Singal
d81978c388
MINOR: Fix sample data CI error (#15934) 2024-04-18 14:18:22 +05:30
IceS2
612bea46a6
FIXES #14772: Display Assets without Owner/Description (#15794)
* Update table_index_mapping to turn columns into a nested type

* test: added query null/empty description test

* style: ran java linting

* Add Table test for incomplete description search query

* Fix tests

* Fix linters

* Fix column search

* Increase waitForEsAsync to 500

* Defined the new calculated fields for the indexes

* Refactor search of assets with no description

* add descriptionStatus to the entities taht didn't have it

* Remove descriptionStatus where it's not needed

* Remove TestCase and TestSuite from search test

* Remove TestCase and TestSuite from search test

* Increase waitForEsAsync for checkDeleteentity 1000

* Update jp and zh mappings

* Fix syntax

* Increase waitForEsAsync for some tests to 1000

* Remove unused aggregations

* Refactor code to reduce repetition

* Fix checkstyle

---------

Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
2024-04-18 10:41:58 +02:00
harshsoni2024
39fc846fdb
Fix #9281: Column level lineage for other entities (#15827) 2024-04-18 12:20:33 +05:30
Sachin Chaurasiya
c591db4eba
bump(ui): tiptap dependencies (#15932) 2024-04-18 11:35:00 +05:30
Ayush Shah
0952e4ff81
Fix All_ table to DBA_ (#15937) 2024-04-18 10:09:15 +05:30