9736 Commits

Author SHA1 Message Date
Suman Maharana
f425d9bf73
Fixes #16591 : DBT Glossary Term linking Independent from Tag rule (#16745) 2024-06-21 17:36:25 +05:30
Suman Maharana
5bd48fcc34
Fixes #14065 : Added DBT Cloud connector (#16705) 2024-06-21 17:16:47 +05:30
Ikko Eltociear Ashimine
6539c95d3f
chore: update percentille_mixin.py (#16743) 2024-06-21 17:14:27 +05:30
Onkar Ravgan
ceaf4bf08a
MINOR: Add method to list custom properties for a entity for python sdk (#16753)
* List custom properties for a entity

* added test

* fixed test
2024-06-21 16:34:49 +05:30
Mayur Singal
d8a4e4d4ff
MINOR: Add docs for big query create credentials/service account (#16759) 2024-06-21 15:58:40 +05:30
IceS2
3c5d705793
Fixed expected result for schemas exclude (#16757) 2024-06-21 09:42:35 +00:00
Matt Chamberlin
ac6ddbf6c4
MINOR: support JSONL datalake file types (#16614)
* fix: support JSONL datalake file types

* add jsonl zip file types

* update fileFormat enum in table schema

* add tests

* fix test data ref

* reformat

* fix tests

---------

Co-authored-by: Matthew Chamberlin <mchamberlin@ginkgobioworks.com>
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
2024-06-21 09:54:19 +02:00
IceS2
7411f9e0e1
Enable Primary Key Constraint for DB2 (#16755) 2024-06-21 09:45:43 +02:00
Prajwal214
9f6e3181c0
Doc: Updating Private Key Information for SAML (#16739) 2024-06-21 07:17:50 +00:00
Prajwal214
1961e016a5
Doc: updating Enum for PipelineType (#16716) 2024-06-21 12:42:12 +05:30
IceS2
34f6f81a20
MINOR: added exclude_defaults=False for profiler and deploy on airflow-apis (#16734) 2024-06-21 12:05:13 +05:30
Suman Maharana
f88f929855
Fixes #14065 : Added DBTCloud Connector docs (#16733) 2024-06-21 10:58:52 +05:30
Imri Paran
b960b60965
Fix #16421: add tableDiff test case (#16554)
* feat: add tableDiff test case

This changed introduces a "table diff" test case which
compares two tables and fails if they are not identical.
The similarity is made based on a specific "key" (because the test only makes sense when performed on ordered collections).

1. Added the `tableDiff` test definition.
2. Implemented a "runtime" parameters feature which injects additional parameters for the test at runtime.
3. Integration tests (because of course).

This feature was not tested end-to-end yet because "array" data

* pydantic v2

* format

* format

* format and added data diff to setup.py

* format

* fixed param issue which has type ARRAY

* fixed runtime_parameter_setter

* moved models to parent directory

* handle errors in table diff

* fixed issue with edit test case

* format

* added more details to pytest skip

* format

* refactor: Improve createTestCaseParameters function in DataQualityUtils

* fixed unit test

* removed unused fixture

* removed validator.py

* fixed tests

* added validate kwarg to tests_mixin

* removed "postgres" data diff extra as they interfere with psycopg2-binary

* fixed tests

* pinned tenacity for tests

* reverted tenacity pinning

* added ui support for test diff

* fixed dq cypress and added edit flow

* organized the test case

* added dialect support

* fixed tests

* option style fix

* fixed calculation for passing/failing rows

* restrict the tableDiff test to limited services

* set where to None if blank string

* fixed where clause

* fixed tests for where clause

* use displayName in place of name in edit form

* added docs for RuntimeParameterSetter

* fixed cypress

---------

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2024-06-20 16:54:12 +02:00
IceS2
7020c065ec
Fix Tableau E2E Tests (#16740) 2024-06-20 14:11:03 +00:00
Sachin Chaurasiya
870bb8c3f2
minor(#16099): when adding team give user option to configure the isJoinable field (#16722)
* minor(#16099): when adding team give user option to configure the isJoinable field

* chore: add helper text for public team field

* test: add test for create team

* fix: playwright test
2024-06-20 18:46:59 +05:30
Ashish Gupta
cd5d8dfa06
fix user cypress failure (#16728) 2024-06-20 16:41:15 +05:30
Sachin Chaurasiya
1ad1d820d8
test: fix custom properties spec (#16732) 2024-06-20 15:07:27 +05:30
Ayush Shah
c9a017d8db
#16720: Add Support for Salesforce SSL (#16719) 2024-06-20 12:10:41 +05:30
IceS2
f0049853ec
FIXES 14885: Initial deltalake implementation for s3 (#16665)
* Initial deltalake implementation for s3

* Fix styles

* Fix test_amundsen

* Fix UnitTests

* Fix Checkstyle

* Fix integration tests due to datalake client refactor

* Fix unit tests

* Fix tests

* Fix Integration DeltaLake Storage test

* Skip delta storage integration test for python 3.8

* DeltaLake JSONSchema changes migrations

* Update import name

* Add some comments based on sonarcloud suggestions

* Update DeltaLake documentation

* Resolve some comments
2024-06-20 12:08:21 +05:30
Sriharsha Chintalapani
3f504206ec
Update README.md (#16725) 2024-06-19 20:59:57 -07:00
Shilpa Vernekar
97dca7cfd1
Docs: Fixed the 404 links (#16717) 2024-06-19 07:51:12 -07:00
Ashish Gupta
25efd7641e
fix cypress for dataModelVersionPage (#16715) 2024-06-19 19:45:56 +05:30
IceS2
6b7e9238f7
Update ischema_names for db2 to take BOOLEAN into account (#16718) 2024-06-19 14:03:02 +02:00
Imri Paran
c79c5da00a
Fixes #16632: Add testCases property to a test suite source config (#16631)
* feat: test-suites

enable specifying a subset of test cases to run in a test suite pipeline

* improved property description
2024-06-19 12:47:38 +02:00
Prajwal214
5c2f01cd41
Doc: updating Icon for observability (#16710)
Co-authored-by: Prajwal Pandit <prajwalpandit@Prajwals-MacBook-Air.local>
2024-06-19 09:32:07 +00:00
Mohit Yadav
53407fb681
[Issue-16642] Add Claim Mapping to uniquely identifty username and email from claims (#16643)
* - Add Claim Mapping to uniquely identift username and email from claims

* - Null Check

* - Add field to yaml

* - Fix issue with token being null

* - Auth Code Flow Fix

* support jwtPrincipleClaimMapping from UI

---------

Co-authored-by: Chira Madlani <chirag@getcollate.io>
2024-06-19 13:13:09 +05:30
Mohit Yadav
a5295396bd
Add WebConf Env to Compose (#16713) 2024-06-19 12:34:33 +05:30
Mohit Yadav
ea820e9590
Security Fixes for Headers and Input Sanitisation (#16712)
* - Security Fixes

* Fix Vulnerability

* Fix Vulnerability
2024-06-19 12:31:09 +05:30
Shilpa Vernekar
bcbc2c0ded
Docs: Data Quality & Observability (#16701) 2024-06-18 07:47:41 -07:00
Imri Paran
e2f845b2d1
docs: add 1.5.x-SNAPSHOT (#16694) 2024-06-18 15:53:06 +02:00
Ashish Gupta
11b535bc6b
#16477: fix deleted user profile not showing (#16592)
* fix deleted user profile not showing

* logout currentUser if he deleted himself

* supported unit test for the deleted user

* supported playwright test for manage user from profile page

* remove unwanted class

* fix flaky failure and changes made as per comments

* changes as per comments
2024-06-18 18:05:56 +05:30
Mayur Singal
12362a9dea
MINOR: Fix numpy version (#16696) 2024-06-18 17:03:35 +05:30
Ashish Gupta
b0517740a0
fix cypress failure for teams drag and drop (#16693) 2024-06-18 16:44:27 +05:30
dependabot[bot]
ca5fd1a156
Bump ws from 7.5.3 to 7.5.10 in /openmetadata-ui/src/main/resources/ui (#16691)
Bumps [ws](https://github.com/websockets/ws) from 7.5.3 to 7.5.10.
- [Release notes](https://github.com/websockets/ws/releases)
- [Commits](https://github.com/websockets/ws/compare/7.5.3...7.5.10)

---
updated-dependencies:
- dependency-name: ws
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-06-18 12:47:44 +05:30
Imri Paran
955ed5afe1
MINOR: fix sql lineage with timezone change (#16685)
* skip mssql test for python

* fixed mssql lineage
2024-06-18 07:15:52 +00:00
Shilpa Vernekar
d6f8836755
Updated Release Docs (#16686) 2024-06-18 06:22:48 +00:00
Shailesh Parmar
282327cf27
playwright: migrate glossary version page spec (#16671) 2024-06-18 11:38:46 +05:30
Mayur Singal
57e51df05f
MINOR: Fix superset cypress error (#16689) 2024-06-18 11:36:51 +05:30
Onkar Ravgan
113fe64c02
updated CA supported connectors (#16688) 2024-06-17 21:26:03 -07:00
gpby
db959c33a6
Add Teradata connector docs (#16672)
* Add Teradata doc to ui

* Add Teradata doc
2024-06-17 17:47:04 -07:00
IceS2
640d7c7532
MINOR: Fix Redash e2e filtered_mix test (#16684)
* Fix E2E count

* Fix E2E Redash filtered mix test
2024-06-17 17:46:47 -07:00
Jin Won, Park
bb240fe800
Fixes #15499: Fix the OpenMetadata(Client) constructor bug - ApiClient null check. (re-commit) (#16661)
* bugfix: change the ApiClient init task.

* style: run `mvn spotless:apply`
2024-06-17 10:12:10 -07:00
Prajwal214
1f27bb7feb
Doc: Adding How-to Guide for Incident Manager (#16674)
* Doc: Adding Docs for Incident Manager

* Doc: Adding Docs for Incident Manager

---------

Co-authored-by: Prajwal Pandit <prajwalpandit@Prajwals-MacBook-Air.local>
Co-authored-by: Shilpa Vernekar <94032785+ShilpaVernekar@users.noreply.github.com>
2024-06-17 09:28:50 -07:00
Imri Paran
95d2d0f82f
skip mssql test for python (#16683) 2024-06-17 13:19:04 +00:00
Imri Paran
18206393e2
MINOR: added lineage ingestion test for mssql (#16436)
* added test case for SQL Server lineage

* reasons for failing tests
2024-06-17 08:56:28 +02:00
Juntao Zhang
8e011145ed
Fixes #16353: Table versions will be inconsistent when modified by different users across different applications. (#16354) 2024-06-17 11:26:56 +05:30
Huanjie Guo
1175cf9dec
bugfix: change double quote to single quote (#15888)
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2024-06-17 10:51:38 +05:30
Mayur Singal
72ed09d6f6
MINOR: Fix column merge error lineage (#16670)
* MINOR: Fix Column merge error

* append only when col lineage available

* pyformat
2024-06-16 20:32:21 -07:00
Jin Won, Park
60208a1990
bugfix: Security Vulnerability in Roles Patch API (#16664) 2024-06-16 12:33:30 -07:00
Sriharsha Chintalapani
6ee03963b9
fix: openmetadata-service/pom.xml to reduce vulnerabilities (#16639)
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMAZURE-7246765
- https://snyk.io/vuln/SNYK-JAVA-COMMICROSOFTAZURE-7246766

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
2024-06-15 12:34:26 -07:00