11743 Commits

Author SHA1 Message Date
Teddy
ac2f6d7132
MINOR - Fix sqa table reference (#18839)
* fix: sqa table reference

* style: ran python linting

* fix: added raw dataset to query runner

* fix: get table and schema name from orm object

* fix: get table level config for table tests
2024-11-28 18:49:11 +01:00
mgorsk1
da176767a8
feat: add dbt freshness check test (#18730)
* add dbt freshness check

* docs

* run linting

* add test case param definition

* fix test case param definition

* add config for dbt http, fix linting

* refactor (only create freshness test definition when user executed one)

* fix dbt files class

* fix dbt files class 2

* fix dbt objects class

* fix linting

* fix pylint

* fix linting once and for all

---------

Co-authored-by: Teddy <teddy.crepineau@gmail.com>
2024-11-28 18:30:11 +01:00
Sriharsha Chintalapani
6410583018
Fix export async for users with "." in their email's principal name (#18845)
* Fix exportAsync failing for usernames with . in it

* Fix exportAsync failing for usernames with . in it
2024-11-28 07:37:45 -08:00
Shailesh Parmar
4720a8da2b
playwright: added initial db setup for playwright test (#18832)
* playwright: fixed service ingestion aut

* updated the initial start of the playwright test
2024-11-28 20:26:30 +05:30
Pranita Fulsundar
9d37ff0e34
Feat: edit display name (#18720)
* feat: edit display name

* refactor: logic and style changes

* fix: minor changes

* style: update style for edit button

* style: remove inline styles and update hover effect

* refactor: remove edit permission for version page and fix handleEditDisplayName function

* refactor: updated displayName

* fix: data-testid for the Link

---------

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2024-11-28 19:49:58 +05:30
harshsoni2024
cb33f274fc
Connector: rename microstrategy connector (#18604) 2024-11-28 18:50:42 +05:30
Pere Miquel Brull
f99ed517bc
FIX - TestSuite source to get the right interface based on the service type (#18838) 2024-11-28 14:08:11 +01:00
Karan Hotchandani
e22fc6ddeb
Fix Glossary tree hierarchy state (#18703)
* fix the tree state on edit glossary term

* add playwright tests

* fix permission loading

* fix tests

* adding timeout for in review state

* adding timeout for in review state

* increasing timeout

* fix tests

* update tests

* add a poll for checking tasks created

* testing response

* adding limit

* fix tests

* change user for testing

* Catch Exceptions on the Consumer to avoid losing records

---------

Co-authored-by: Pablo Takara <pjt1991@gmail.com>
2024-11-28 16:36:45 +05:30
Ashish Gupta
7877d5c14c
Allow Asset add and remove operation for editTag permission user (#18786)
* Allow Asset add and remove operation for editTag permission user

* remove edit all permission check in bulkAssetTag api for tag

* fix the permission check by checking specific and the index used to exclude

* check editTag permission before updating assets by bulkTagAsset api

* fix the button not visible for the non admin user

* added playwright for the limited user check aroud asset

* restrict add asset button in certification page

* minor fix

* cleanup aroud tag page and fix usertab count around Team page

* use entity type instead of search index

---------

Co-authored-by: sonikashah <sonikashah94@gmail.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
2024-11-28 16:15:07 +05:30
Suman Maharana
9a21e77e15
Added dbt cloud multi projects and jobs filter (#18801)
* Added dbt cloud multi project and jobs filter

* added tests

* change to array type

* updated yaml config

* added migrations
2024-11-28 16:10:34 +05:30
IceS2
b9e49fc35d
Make Fetching Data Async (#18822) 2024-11-28 10:53:57 +01:00
Pere Miquel Brull
460d20a856
MINOR - Fix clean_uri and add before pagination (#18826)
* print

* MINOR - Fix clean_uri and add before pagination

* MINOR - Fix clean_uri and add before pagination
2024-11-28 09:35:41 +01:00
Karan Hotchandani
b614594252
Json logic query builder fixes (#18819)
* minor workflow changes

* fix json logic fixes for extension field

* fix tests

* query builder ui changes

* minor add entity type in global search

* fix tests

* update certification ui

* update default icons

* minor add test id
2024-11-28 08:42:46 +01:00
Akash Verma
609620e54f
fixes : #12891: "Added more test connection cases for Airflow ingestion" (#18769) 2024-11-28 13:02:04 +05:30
Amir Shakeri
860b420d3d
Remove ORDER BY from the postgres DELETE statement (#18757)
Co-authored-by: amir.shakeri <amir.shakeri@free-now.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2024-11-27 23:21:23 -08:00
RounakDhillon
d3af7ae601
Docs: Airflow Version Update (#18828)
* Docs: Airflow Version Update

* Docs: Airflow Version Update

---------

Co-authored-by: Rounak Dhillon <rounakdhillon@Rounaks-MacBook-Air.local>
2024-11-28 07:13:54 +00:00
Teddy
fb826b2c68
MINOR -- propagate result to suites (#18823)
* fix: update result summary for test suite

* fix: stream pattern

* fix: inverse null conditional logic
2024-11-28 08:09:56 +01:00
Kenil Shah
804e3defb2
Fix Colors in Custom Charts (#18810)
* Fix Colors in Custom Charts

* code fixes

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2024-11-27 20:56:41 +05:30
Imri Paran
cd74d8f55a
MINOR: ref(data-quality): modularized test case validator import (#18716)
* ref(data-quality): modularized test case validator import

- removed test_suite_factory
- implemented TestCaseImporter
- removed SQAValidatorBuilder and PandasValidatorBuilder in favor of a SourceType enum
- removed the orm table creation from test suite source

* format

* IValidatorBuilder -> ValidatorBuilder

* use the table from the sampler in the test suite interface

* linting

* fixed the profiler with similar solution

* removed unused inheritance

* removed unneeded super().__init__()

* removed all instances of orm_table

* fixed tests

* add reportExplicitAny=false

* fixed tests
2024-11-27 16:25:12 +01:00
Pranita Fulsundar
fdd8c5878c
fix: add and remove users in a team (#18776)
* Improvement : Teams api to update and remove users

* fix: add and remove user apis, with e2e test case

* fix: test for Teams page

* fix: e2e test for delete user

* fix: remove user field from fetchTeamAdvancedDetails function

* fix: test for loadAdvancedDetails

* fix: response api for add and remove user

* fix: userCount after delete

* fix: update users call

---------

Co-authored-by: sonikashah <sonikashah94@gmail.com>
Co-authored-by: sonika-shah <58761340+sonika-shah@users.noreply.github.com>
2024-11-27 19:13:16 +05:30
Mayur Singal
9985286cdb
MINOR: Fix snowflake test connection on - in db name (#18817) 2024-11-27 18:38:46 +05:30
Mayur Singal
a316de67af
MINOR: Databricks LocationPath Update Fix (#18815) 2024-11-27 18:38:26 +05:30
Aniket Katkar
be47656f2f
Add Marathi language to the localization (#18804)
* Add marathi language localization

* add new

* update localization

* update the missing key translation
2024-11-27 18:35:18 +05:30
RounakDhillon
82f85543b4
Docs: Service Spec updation (#18796) 2024-11-27 17:04:36 +05:30
Chirag Madlani
3ff11d8518
Revert "Add alert bar component (#17230)" (#18812)
This reverts commit e32f9cf8623cbe96cce8d0cc6c063b489c3f9590.
2024-11-27 16:43:33 +05:30
Aniket Katkar
e1f717ad08
Minor: Fix the 'cross-spawn' library vulnerability issue (#18811)
* Fix the vulnerability issue for 'cross-spawn' library

* update the cross-spawn resolution version to 7.0.5
2024-11-27 16:15:31 +05:30
Imri Paran
e58efdde67
feat: added getLatestRecord for extension (#18797) 2024-11-27 10:08:53 +00:00
Aniket Katkar
c101c7cf30
Minor: Auto classification UI (#18785)
* Add the auto classification pipeline option in the service ingestion

* Localization changes for other languages

* Improve the logic for getSupportedPipelineTypes function and add unit tests for newly added logic

* Add playwright tests for the auto classification feature

* Improve the getSupportedPipelineTypes function logic to reduce the cognitive complexity

* update md docs

* Add classificationFilterPattern in the UI schema form order

* fix logs from backend for auto classification

* Changes to view the auto classification logs

* Fix the sonar errors

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2024-11-27 14:51:59 +05:30
sonika-shah
e8031bcc0e
Improvement : Teams api to update and remove users (#18729) 2024-11-27 10:11:27 +01:00
Prajwal214
026f39c5c7
Docs: Fixing Broken Menu (#18809)
Co-authored-by: Prajwal Pandit <prajwalpandit@Prajwals-MacBook-Air.local>
2024-11-27 08:30:30 +00:00
RounakDhillon
69f0c90b8d
Docs: 1.5.12 Updation (#18808)
Co-authored-by: Rounak Dhillon <rounakdhillon@Rounaks-MacBook-Air.local>
2024-11-27 08:12:40 +00:00
Teddy
58699063db
MINOR -- Fix DQ Partition Issue (#18641)
* fix: renamed `random_sample` to `get_dataset` and change dunder method access for SQA Table object

* fix: removed handle_partition decorator

* fix: fixed DQ partition issue + moved to `tablesample` method

* style: ran python linting

* style: fix python format check issues

* feat: added postgres tablesample

* style: ran python linting

* fix: sampling delta

* fix: merge conflicts

* fix: resolved conflicts

* style: ran python linting

* fix: patch orm call in test case

* fix: mock build_table_orm call in tests

* fix: test case failures and errors

* fix: removed unused import

* fix: patch typo

* fix: trino table schema retrieval

* fix: remove tuple context manager for 3.8 test support
2024-11-27 08:50:54 +01:00
RounakDhillon
9432cb5a3c
Docs: Release Doc Updation (#18807)
Co-authored-by: Rounak Dhillon <rounakdhillon@Rounaks-MacBook-Air.local>
Co-authored-by: Prajwal214 <167504578+Prajwal214@users.noreply.github.com>
2024-11-27 13:04:13 +05:30
Siddhant
15f56c124a
fix: Minus sign correction. (#18802) 2024-11-27 12:22:58 +05:30
Shrushti Polekar
9f1be47b37
Feat: Support for Emoji Option in Feed Editor (#18772) 2024-11-27 01:26:57 +05:30
Sweta Agarwalla
e32f9cf862
Add alert bar component (#17230)
* add alert bar component

* updated as per comments

* updated as per comments

* updated alert bar component

* remove styles attributes

* update styles

* add alert store and use alert in page layout

* update component to have reset method

* refactor: update reset calling method

* update reset method name

* updated as per feedbacks

* refcator: update CrossIcon component usage

* chore: remove condition for CrossIcon

* update animation for opening alert bar.

* add autoCloseTimer to alert banner

* remove cross icon component

* add cross icon svg

* update to fix the height issue

* fix height glitch issue when alert appears

* update the alert notification tests

* update alert transition issue

* revert the changes for height issue

* add alert in mydata

* update alert animation issue

* update alert position in page layout

* update as per feedbacks

* fix tests failure

* update test for toast

* remove dummy alert bar

* made alert fixed to top

* fix check failing issue

* fix activity feed playwright test issue

* update test

* fix test issues

* update page layout

* fix sonar cloud failure

* fix sonar cloud failure

* fix test issues

* resolve sonar issue

* update lineage spec

* update as per comments

* update domain page css

* fix sonar issue

* fix sonar cloud issue

* remove react-toastify

* fix sonar error

* yarn install command run

* update yarn lock

* revert yarn lock changes

* update yarn lock

* revert yarn

* revert yarn changes

* remove toastify instance

* update message type

* fix sonar issue

* add alert bar in Alert details page

* create mock for page layout

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2024-11-27 00:35:23 +05:30
Kenil Shah
b3e52e8831
fix: show duration based on current time if endTime is not there (#18799) 2024-11-27 00:29:31 +05:30
Imri Paran
c5171139c3
chore: added data diff to base requirements (#18789) 2024-11-26 17:28:22 +00:00
IceS2
8cade39bad
MINOR: Increase visibility on flowable process (#18792)
* Add annotation to turn delete_recursive test into the last one to be executed

* Improve Fetching Entities by only fetching the FQN

* Cut back default batchsize to 500

* implement logging for flowable process

* Implement Error Handling Flow

* Remove testing code

* Checking if User is Reviewer when resolving glossary task
2024-11-26 17:04:59 +01:00
Imri Paran
2e9efe5b82
MINOR: fix: use importer as module (#18793)
* fix: use importer as module

to allow monkeypatching in collate

* Update i_validator_builder.py
2024-11-26 16:42:18 +01:00
Imri Paran
3e7808ba78
fixed either annotation (#18778)
* fixed either annotation

* added back Entity

* using `typing_extensions.Annotated` for compatibility with python3.8

* removed bound T for Either
2024-11-26 16:40:32 +01:00
Teddy
68abc1a821
fix: minor observability bugs (#18795) 2024-11-26 16:34:46 +01:00
Karan Hotchandani
943d606fb9
Workflow UI changes (#18790)
* minor workflow changes

* fix json logic fixes for extension field

* fix tests
2024-11-26 20:56:55 +05:30
Shailesh Parmar
de3d7c40db
GEN-2031: fix Add profiler configuration button in Data Quality tab (#18798) 2024-11-26 20:49:36 +05:30
Ashish Gupta
490bbf6241
fix: tag page issue around disabled badge and Certification data in ES (#18697)
* fix tag page issue around disabled badge and other

* reset the unwanted code

* modify playwright test for consumer and steward

* modify tag es query to check the prefix in fqn

* fix query and sonar issue

* fix the asset not coming in Tier and Certification page tab

* fix the playwright failure
2024-11-26 19:07:46 +05:30
Kenil Shah
b3679f0cea
Sort assets in search indexing app (#18791) 2024-11-26 18:11:37 +05:30
Aniket Katkar
998cbd1558
Improvements: Alerts bug fixes and improvements (#18753)
* Add and improve the permission logic for the notifications and observability alerts pages
Add logic to update the description from alert details page.
Add logic to set the logged in user as the owner while alert creation

* Remove the permission check for the `/{alertType}/resources` API since it's not necessary

* Update the playwright tests to cover the new alert features

* Add playwright to test the test destinations filter

* Fix the unit tests

* Add unit test for AlertRecentEventsTab component

* update the variable.less import to reference

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2024-11-26 18:00:58 +05:30
Keshav Mohta
10a7f4ea6c
Fixes #15543: Implemented ElasticSearch Index Template Ingestion (#18686) 2024-11-26 14:42:43 +05:30
Shailesh Parmar
8f33a1b92d
Minor: updated docs link in the application (#18787)
* Minor: updated docs link in the application

* fixed link
2024-11-26 14:34:45 +05:30
RounakDhillon
823bc82e02
Docs: Custom Metrics Image update (#18788)
Co-authored-by: Rounak Dhillon <rounakdhillon@Rounaks-MacBook-Air.local>
2024-11-26 08:07:51 +00:00