2892 Commits

Author SHA1 Message Date
Teddy Crepineau
bf2031d0b6 Merge remote-tracking branch 'upstream/1.5.11' into 1.5.11 2024-11-06 11:24:33 +01:00
Teddy
1f2e30f8b7 GEN 1683 - Add Column Value to be At Expected Location Test (#18524)
* feat: added column value to be in expected location test

* fix: renamed value -> values

* doc: added 1.6 documentatio entry

* style: ran python linting

* fix: move data packaging to pyproject.yaml

* fix: add init file back for data package

* fix: failing test case

(cherry picked from commit d579008c998db64a7a1890351d2bdbd6964c7251)
2024-11-06 11:23:25 +01:00
Mayur Singal
c92e5bfcaf MINOR: Airflow dependency Fix (#18530) 2024-11-06 15:52:44 +05:30
Suman Maharana
3bc8d3b2f9 Fix #17778 : Databricks query run optimisation (#18467)
* Fix : Databricks query run  optimization

* Fixed dialect error

* fix get columns

* py format

---------

Co-authored-by: ulixius9 <mayursingal9@gmail.com>
2024-11-06 10:10:53 +05:30
IceS2
357e1c80f8
Return s3 endpoint as str() instead of Url (#18521) 2024-11-05 18:43:34 +01:00
Suman Maharana
669b09e6c5 Minor: Fixed dbtcloud test connection and improved docs (#18408) 2024-11-05 18:26:28 +05:30
github-actions
d6569ed705 chore(release): Prepare Branch for 1.5.11 2024-10-31 20:46:13 +00:00
github-actions
61713892e9 chore(release): Prepare Branch for 1.5.10 2024-10-29 16:06:49 +00:00
Pere Miquel Brull
bba91b9569 GEN-1234 - Clean up suggestions when a user is deleted (#17988)
* GEN-1234 - Clean up suggestions when a user is deleted

* add method

* add method

* fix postgres query
2024-10-25 15:51:46 +02:00
github-actions
ae1b8c4927 chore(release): Prepare Branch for 1.5.9 2024-10-25 05:14:05 +00:00
harshsoni2024
44c5dd46a9 GEN-1911: Quicksight lineage source fix (#18348) 2024-10-24 11:42:36 +05:30
Ayush Shah
fca9bb0a4f fixes: Mode test connection returns data in dict instead of json (#18386) 2024-10-24 11:12:38 +05:30
Katarzyna Kałek
010761ed5c FIX #18309: fixed task deserialization in Airflow metadata ingestion (#18310)
* fixed task deserialization in Airflow metadata ingestion

* fixed formatting

---------

Co-authored-by: Katarzyna Kałek <kkalek@olx.pl>
2024-10-24 09:27:56 +05:30
Vijay Lakshmanan
1bc2cc1d71 Fixes #16263: Fixed Mode dashboard ingestion API call (#18355) 2024-10-24 09:26:13 +05:30
Mayur Singal
5801e6c380 MINOR: Add location path to table entity (#18307) 2024-10-23 13:12:18 +05:30
Pere Miquel Brull
9f60ba68f5 MINOR - Only timeout on main threads (#18341) 2024-10-21 16:38:11 +02:00
Pere Miquel Brull
5c25d35545 MINOR - Return TestConnectionResult from test_connection_fn (#18320)
* MINOR - Return TestConnectionResult from test_connection fn

* MINOR - Return TestConnectionResult from test_connection fn
2024-10-21 09:53:16 +02:00
Pere Miquel Brull
819d035bbe MINOR - Pass timeout to test connection and return TestConnectionStep (#18236)
* update connections

* MINOR - Pass timeout in test connection and return TestConnectionStep

* format

* comments

* comments
2024-10-21 09:50:44 +02:00
Mayur Singal
4063e4fbe6 Fix #18177: Fix Hive Metastore connection issue (#18178) 2024-10-18 12:13:40 +05:30
github-actions
b2d2839801 chore(release): Prepare Branch for 1.5.8 2024-10-17 20:44:45 +00:00
harshsoni2024
4ac6111893 salesforce table description from label if not through query (#18286) 2024-10-16 12:58:06 +05:30
harshsoni2024
7bbc92b960 MINOR: Fix pinotdb col. datatype error (#18268) 2024-10-16 12:57:58 +05:30
Mayur Singal
2ea683a112 MINOR: Fix Couchbase columns not fetched (#18284) 2024-10-16 09:55:17 +05:30
Ayush Shah
36f682753c Fixes #18186: Quicksight Ingestion Error handled (#18218) 2024-10-16 09:55:13 +05:30
Imri Paran
5f93b05d8b MINOR: add column case sensitivity parameter (#18115)
* fix(data-quality): table diff

- added handling for case-insensitive columns
- added handling for different numeric types (int/float/Decimal)
- added handling of boolean test case parameters

* add migrations for table diff

* add migrations for table diff

* removed cross type diff for now. it appears to be flaky

* fixed migrations

* use casefold() instead of lower()

* - implemented utils.get_test_case_param_value
- fixed params for case sensitive column

* handle bool test case parameters

* format

* testing

* format

* list -> List

* list -> List

* - change caseSensitiveColumns default to fase
- added migration to stay backward compatible

* - removed migration files
- updated logging message for table diff migration

* changed bool test case parameters default to always be false

* format

* docs: data diff

- added the caseSensitiveColumns parameter

requires: https://github.com/open-metadata/OpenMetadata/pull/18115

* fixed test_get_bool_test_case_param

(cherry picked from commit be82086e2542d2d176ac66e0bf11100646448b4f)
2024-10-15 16:41:43 +02:00
Imri Paran
58b11669aa cherry picked be82086e2542d2d176ac66e0bf11100646448b4f 2024-10-15 16:40:02 +02:00
harshsoni2024
83bfda5229 GEN-1552: Postgres stored procedures support (#18083) 2024-10-15 14:26:29 +05:30
harshsoni2024
a9a37cfd0b fix query for mysql con. (#18272) 2024-10-15 14:21:04 +05:30
Mayur Singal
84300d8b56 Fix #17963: Fix PinotDB Ingestion (#18266)
* Fix #17963: Fix PinotDB Ingestion

* fix conn args
2024-10-15 08:40:57 +05:30
sushi30
bf9a098aa6 Merge remote-tracking branch 'origin/1.5.7' into 1.5.7 2024-10-14 11:39:48 +02:00
Imri Paran
c68cfb0a20 MINOR: fix(looker): exclude version
https://github.com/looker-open-source/sdk-codegen/issues/1518
(cherry picked from commit 3c7f995677214fbc25c3c6c331f903105b48a0f9)
2024-10-14 11:39:10 +02:00
Suman Maharana
fe2531e448 GEN-895: Added Glue Pipeline Lineage (#18063) 2024-10-14 14:55:19 +05:30
Suman Maharana
63bff7aafa Fixed dbt Manifest and Run results parsing (#18234) 2024-10-14 14:55:09 +05:30
IceS2
8c5d9ab0ca
MINOR: Update DB2 dependencies to fix issue about not having ibm-db installed (#18192)
* Update DB2 dependencies to fix issue about not having ibm-db installed

* Fix checkstyle
2024-10-10 08:25:59 +02:00
Prajwal214
e5d43bce96 Minor: Updated pyiceberg version to 0.5.1 (#18155)
Co-authored-by: Prajwal Pandit <prajwalpandit@Prajwals-MacBook-Air.local>
2024-10-08 18:09:20 +05:30
Akash Jain
c51ae56d9b
fix: PostgreSQL installation in Ingestion Docker (#18114) 2024-10-08 12:34:25 +02:00
IceS2
8640b4c665
MINOR: Fix Ingestion Dockerfile Compatibility by changing IF syntax (#18098)
* Fix Ingestion Dockerfile Compatibility by changing IF syntax

* Increased shell compatibility by using only one '='
2024-10-07 15:08:25 +02:00
harshsoni2024
075c67b8b3 get primitive datatype in case of array, struct (#18102) 2024-10-07 11:12:06 +05:30
github-actions
6a36355d3e chore(release): Prepare Branch for 1.5.7 2024-10-03 15:01:32 +00:00
Onkar Ravgan
b1dcb1180e AlationSink conn improvements (#18091) 2024-10-03 16:23:09 +05:30
Mayur Singal
84441c4ad1 GEN-1251: Fix Expected ColumnLineage but got dict (#17708) 2024-10-03 14:30:50 +05:30
Aldwyn Cabarrubias
312b584836 Change time format for the created_at of the DBT cloud pipeline status (#17916)
Co-authored-by: Suman Maharana <sumanmaharana786@gmail.com>
2024-09-30 17:02:38 +05:30
Teddy
d3325cda93 MINOR - Fix General Profiler Bugs (#17995)
* fix import issue

* fix: better handle None values in profiler processing

* fix: profiler errors

* chore: fix comment

* style: fix python linting failure

* fix: null byte error with the database client

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
(cherry picked from commit 8dc6b7d282a700c2a3d4659f904a3966e16843a2)
2024-09-30 08:13:08 +02:00
IceS2
cb2ef3f559 Fix missing cast to str (#18016) 2024-09-30 07:55:49 +05:30
Suman Maharana
2348614695 Added DBT tests with versionless and fixed v7 parsing (#18028) 2024-09-27 19:57:13 +05:30
Suman Maharana
25bda0f756 Minor: fix lineage & queries in dbt (#17999) 2024-09-27 19:48:56 +05:30
Suman Maharana
5f234cdbc4 Fix Manifest is not parsed correctly on dbt versionless (#17975) 2024-09-27 19:47:46 +05:30
harshsoni2024
27816cb964 allow powerbi datamodel children in col.lineage (#18030) 2024-09-27 19:30:08 +05:30
Mayur Singal
3e5cc923bf MINOR: MSTR connector import fix (#18025) 2024-09-27 16:57:35 +05:30
github-actions
95bfb5b912 chore(release): Prepare Branch for 1.5.6 2024-09-25 08:11:38 +00:00