2141 Commits

Author SHA1 Message Date
Mohit Yadav
b05d29ccee
[DuplicateLogin] User name issue for loggedInUserApi (#16762)
* User Email Based lookup for loggedInUser

* Add Unique on name

* support email only login

* fix cypress

* fix playwright

* reset user for 404
inject enableSelfSignup for auth config

* Add Self Signup Flag

* Add error messages

* Better check

* Change to Custom Exception Message

* Update message as suggested

* fix claim issue for confidential type

* fix sonar

---------

Co-authored-by: Chira Madlani <chirag@getcollate.io>
2024-06-24 18:21:32 +05:30
sonika-shah
70cab0ac1b
Feat: Add glossary level tasks listing (#16673)
* Feat: Add glossary level tasks listing

* add playwright tests

* update owner label

* fix owner label consistency

* fix playwright tests

* fix unit tests

* fix flaky tests

* minor fix

* fix flaky tests

* fix review comments

* fix tests

* fix tests

* add playwright to approve task

* sync feed count

---------

Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
2024-06-24 17:41:28 +05:30
Suman Maharana
5bd48fcc34
Fixes #14065 : Added DBT Cloud connector (#16705) 2024-06-21 17:16:47 +05:30
Imri Paran
b960b60965
Fix #16421: add tableDiff test case (#16554)
* feat: add tableDiff test case

This changed introduces a "table diff" test case which
compares two tables and fails if they are not identical.
The similarity is made based on a specific "key" (because the test only makes sense when performed on ordered collections).

1. Added the `tableDiff` test definition.
2. Implemented a "runtime" parameters feature which injects additional parameters for the test at runtime.
3. Integration tests (because of course).

This feature was not tested end-to-end yet because "array" data

* pydantic v2

* format

* format

* format and added data diff to setup.py

* format

* fixed param issue which has type ARRAY

* fixed runtime_parameter_setter

* moved models to parent directory

* handle errors in table diff

* fixed issue with edit test case

* format

* added more details to pytest skip

* format

* refactor: Improve createTestCaseParameters function in DataQualityUtils

* fixed unit test

* removed unused fixture

* removed validator.py

* fixed tests

* added validate kwarg to tests_mixin

* removed "postgres" data diff extra as they interfere with psycopg2-binary

* fixed tests

* pinned tenacity for tests

* reverted tenacity pinning

* added ui support for test diff

* fixed dq cypress and added edit flow

* organized the test case

* added dialect support

* fixed tests

* option style fix

* fixed calculation for passing/failing rows

* restrict the tableDiff test to limited services

* set where to None if blank string

* fixed where clause

* fixed tests for where clause

* use displayName in place of name in edit form

* added docs for RuntimeParameterSetter

* fixed cypress

---------

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2024-06-20 16:54:12 +02:00
Ayush Shah
c9a017d8db
#16720: Add Support for Salesforce SSL (#16719) 2024-06-20 12:10:41 +05:30
IceS2
f0049853ec
FIXES 14885: Initial deltalake implementation for s3 (#16665)
* Initial deltalake implementation for s3

* Fix styles

* Fix test_amundsen

* Fix UnitTests

* Fix Checkstyle

* Fix integration tests due to datalake client refactor

* Fix unit tests

* Fix tests

* Fix Integration DeltaLake Storage test

* Skip delta storage integration test for python 3.8

* DeltaLake JSONSchema changes migrations

* Update import name

* Add some comments based on sonarcloud suggestions

* Update DeltaLake documentation

* Resolve some comments
2024-06-20 12:08:21 +05:30
Mohit Yadav
53407fb681
[Issue-16642] Add Claim Mapping to uniquely identifty username and email from claims (#16643)
* - Add Claim Mapping to uniquely identift username and email from claims

* - Null Check

* - Add field to yaml

* - Fix issue with token being null

* - Auth Code Flow Fix

* support jwtPrincipleClaimMapping from UI

---------

Co-authored-by: Chira Madlani <chirag@getcollate.io>
2024-06-19 13:13:09 +05:30
Mohit Yadav
ea820e9590
Security Fixes for Headers and Input Sanitisation (#16712)
* - Security Fixes

* Fix Vulnerability

* Fix Vulnerability
2024-06-19 12:31:09 +05:30
Juntao Zhang
8e011145ed
Fixes #16353: Table versions will be inconsistent when modified by different users across different applications. (#16354) 2024-06-17 11:26:56 +05:30
Jin Won, Park
60208a1990
bugfix: Security Vulnerability in Roles Patch API (#16664) 2024-06-16 12:33:30 -07:00
Mohit Yadav
1dcb1bd46f
- Update What's new (#16669)
- fix vulnerability
2024-06-15 12:01:40 +05:30
mohitdeuex
d9ae6f6db9 - Fix User Signup - p2 2024-06-15 00:17:28 +05:30
Mohit Yadav
b4cba8a850
- Fix User Signup (#16667) 2024-06-14 23:46:45 +05:30
Imri Paran
385dcd40f5
added query param "validate" for failed row sample (#16159)
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2024-06-14 10:39:29 +00:00
Sachin Chaurasiya
55cd180ffa
feat(#16208): custom properties for Dashboard Data Models (#16628)
* feat(#16208): custom properties for Dashboard Data Models

* chore: update the padding for custom properties tab content

* Backend : Support extension field for dashboardDataModel

* ui: update ui to fetch the extension data

* feat: show custom properties on right panel

* chore: add custom properties in version page

* test: add playwright test for data model custom properties

* test: remove duplicate checks

---------

Co-authored-by: sonikashah <sonikashah94@gmail.com>
2024-06-13 20:51:47 +05:30
Mohit Yadav
cc2d581eb0
Fix owner notification (#16629)
* - Fix Task notification not getting sent to owners

* - Fix Task notification not getting sent to owners
2024-06-12 17:40:35 +05:30
Onkar Ravgan
4f50e0b6a0
cleaned dbt code after pydantic update (#16605) 2024-06-12 11:24:29 +05:30
Mohit Yadav
3db41f08e2
Fix Test Suite Filter (#16615)
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2024-06-12 10:40:05 +05:30
Mohit Yadav
77dfe1f6af
Fix Postgres Application listing (#16600)
* Fix Postgres Application listing

* Fix Listing
2024-06-11 13:18:50 +05:30
sonika-shah
04543722a6
Minor: Ensure correct index mapping in Elasticsearch for clusterAlias (#16598) 2024-06-11 10:06:44 +05:30
sonika-shah
8723b8c36a
Fix: Ensure correct index mapping in Elasticsearch for clusterAlias (#16589)
* Fix: Ensure correct index mapping in Elasticsearch for clusterAlias

* Fix: Ensure correct index mapping in Elasticsearch for clusterAlias
2024-06-10 18:40:27 +05:30
Teddy
ff00175fb1
MINOR - Data Quality Preparatory Work (#16523)
* chore: added min/max bound and dynamic support flag

* chore: added migration for dynamic attribute

* style: fix pythin checkstyle
2024-06-10 11:03:55 +02:00
Karan Hotchandani
4c8bf1cac1
Updating glossary reviewers should propagate reviewers in glossary term (#16580)
* highlight inherited reviewer in glossary

* locales

* use glossary name for search query

* fix glossary version cypress

* add union datatype for subfields

* Adding reviewer to glossary also adds them as an assignee to the task

* add glossary approval cypress

---------

Co-authored-by: sonikashah <sonikashah94@gmail.com>
2024-06-09 22:18:06 -07:00
Mohit Yadav
aeb020ae3b
[ISSUE-16503] Fix createUser to use EntityResource (#16549)
* Fix createUser to use EntityResource

* fix broken tests

* Fix Tests - 3
2024-06-07 21:03:50 +05:30
Mohit Yadav
9ec3d94e3b
[FIX] GlossaryTerm reviewers should be user or team only (#16372)
* add teams as reviewer

* Check Users to be reviewers

* Reviewers can be a team or user

* Fix check by id or name

* Review can be team or user both

* Validate Reviewers

* add multi select control

* - Fix Reviewers

* - Centralize Reviewer Relationship to EntityRepository

* - Sort

* add team as reviewer for glossary terms

* locales

* cleanup

* - Update Reviewer should remove existing reviewers

* fix selectable owner control

* fix code smells

* fix reviewer issue

* add glossary cypress

* fix patch issue on reviewers set to null

* update cypress tests

* fix cypress

* fix cypress

* fix reviewers in glossary task and supported cypress

* fix pytest

* Fix

* fix cypress

* fix code smells

* Inherited Reviewers need to be present always

* filter out inherited users

* fix cypress

* fix backend tests failure

* fix backend tests failure -checkstyle

* restrict owner to accept task in case of reviewer present

* fix pytest

---------

Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
Co-authored-by: sonikashah <sonikashah94@gmail.com>
2024-06-06 20:23:37 +05:30
Mohit Yadav
b612dd90c0
Fix Topic Schema missing messageSchema (#16545) 2024-06-06 02:26:49 +05:30
mohitdeuex
4563ad4fd1 [MINOR] Fix Test Failure for EventRegistration 2024-06-06 01:36:05 +05:30
Mohit Yadav
d374e48b79
Fix Event Handlers registration Issue (#16544)
* Fix Event Handlers Issue

* Review Comments
2024-06-05 22:40:02 +05:30
sonika-shah
d3123c4914
Update documentation for Search Index apis (#16539) 2024-06-05 21:27:02 +05:30
Mohit Yadav
5ddbe8b210
Fix settings for email not encrypted on init (#16541)
* Fix Email Settings not encrypted

* Fix Email Settings not encrypted

* Move fernet to secure test
2024-06-05 20:52:44 +05:30
Teddy
6b00dde902
Fix #16229 - Tag and Service filters for test cases (#16484)
* fix: added test case support for tags (inherit from table/column)]"

* feat: add tag and service filter for test cases

* feat: add tier query param

* fix: tests
2024-06-03 22:32:01 -07:00
Siddhant
7558ccc432
Fixes : 14333 - Changed announcements startTime and endTime from seconds to milliseconds. (#16438)
* Improvement: Changed announcements startTime and endTime from seconds to milliseconds.

* Improvement: Changed announcements startTime and endTime from seconds to milliseconds.

* supported announcement milleseconds change from UI

* fix sonar issue

* remove unwanted code

---------

Co-authored-by: Ashish Gupta <ashish@getcollate.io>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
2024-06-03 15:22:37 +05:30
Teddy
fda7c9425f
fix: delete test case results on hard delete of a test case (#16500) 2024-06-03 09:42:39 +02:00
Mohit Yadav
022772943f
Fix Schema Field Null Issue (#16510) 2024-06-03 13:03:26 +05:30
Mohit Yadav
f0b0f7a942
- Non Indexable fields should be remvoed at the end (#16499) 2024-06-03 11:04:32 +05:30
sonika-shah
9aa85b37be
Fix #16493 :User Deletion Error in Search - Adding Conditional Check (#16492)
* Fix User Deletion Error in Search - Adding Conditional Check

* Fix User Deletion Error in Search - Adding Conditional Check
2024-05-31 17:13:14 +05:30
Mohit Yadav
9e5c5529a8
- Remove Change Description from Lineage (#16488) 2024-05-30 17:14:46 -07:00
sonika-shah
ae5e9d61cc
Fix #16278 : Search to display Draft glossaryTerms on Explore page (#16462)
* Fix #16278 : Search to display Draft glossaryTerms as well on Explore page

* add term status quick filter

* change aggregation key for status field

* change aggregation key for status field

* add lowercase_normalizer in status filed for aggregate api

* add cypress tests

* fix cypress

---------

Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
2024-05-30 13:25:13 +00:00
Siddhant
541df25940
Fixes: 15835 : Added tests covering EventSubscription. (#16298)
* Improvement: Added new test cases covering EventSubscription and fixed previous test cases.

* Improvement: Added test cases covering EventSubscription for multiple destination.

* Improvement: Added test cases covering EventSubscription for multiple destination.

* Improvement: Refactored the classes implementing DRY.

* Improvement: Implemented validation for entity url and message format.

* Enabling the subscription tests randomly.
2024-05-30 18:18:10 +05:30
Imri Paran
a4c516d2c7
Fixes 16305: Added Test Case for Matching Enum (#16362)
* Added Test Case for Matching Enum

1. Implemented the test case using the `matchEnum` parameter.
2. Added integration tests.
3. Added migrations.

* fix tests

* fixed tests

* format

* fixed tests

* clear search cache before running ingestion

* format

* changed scopt of aws fixture

* moved migrations to 1.5.0
2024-05-28 09:30:30 +02:00
gpby
d909a3141e
Teradata Connector (#16373)
* [WIP] add teradata connector

* [WIP] add teradata ingestion

* [WIP] add teradata connector

* [WIP] add teradata connector

* [WIP] add teradata connector

* [WIP] add teradata connector

* [WIP] add teradata connector

* [WIP] add teradata connector

* Reformat code

* Remove unused databaseName property
2024-05-28 06:40:22 +02:00
Ayush Shah
e1a4937744
Fix SSL issue (#16412) 2024-05-26 18:49:35 +00:00
Mohit Yadav
fe2db2d63c
Add Null Check for isAdmin (#16407)
* Remove Retry From Abstract Event Consumer

* - Add Check for null Or Empty in isAdmin

* - Fix Test
2024-05-24 15:58:41 +05:30
Mohit Yadav
f8ed079731
Remove Retry From Abstract Event Consumer (#16405) 2024-05-24 13:07:26 +05:30
Akash Jain
015d71c9de
chore: Update main branch for 1.5.0 Release (#16401) 2024-05-23 18:46:15 +05:30
Teddy
5555c3db88
[MINOR] test case listing with prefix (#16382)
* fix: test case listing with prefix

* fix: domain filtering

* added cypress for domain and data quality filters

---------

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2024-05-22 18:52:20 +05:30
Mohit Yadav
f5edf6c760
Fix Initial Offset (#16375)
* Fix Initial Offset

* Fix Query for postgres
2024-05-22 14:25:11 +05:30
Mohit Yadav
d332f713ab
Fix slow reindexing (#16364) 2024-05-21 15:49:54 +05:30
sonika-shah
8435f8b710
fix get tags asset on glossary rename (#16342)
* fix get tags asset on glossary rename

* fix get tags asset on glossary rename

* fix get tags asset on glossary rename - ui change

* fix get tags asset on glossary rename - ui change
2024-05-20 22:53:50 +05:30
Mohit Yadav
1a61a45c41
- Fix Reindex (#16347) 2024-05-20 12:42:49 +05:30