Suman Maharana
26bfde8f9c
Fix dbtcloud task/run date ( #19265 )
2025-01-08 11:35:56 +05:30
Pere Miquel Brull
e56f477a4a
Fix #19147 - Executable Test Suites ( #19221 )
...
* backend
* format & tests
* rename backend
* migrations and ingestion
* format & tests
* format & tests
* tests
* format & tests
* tests
* updated ui side of changes
* addressing comment
* fixed failing unit test
* fix test list
* added e2e test, and fixed existing test
---------
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2025-01-07 17:59:54 +01:00
Akash Verma
b2898f7007
Cockroach enhancement ( #19108 )
2025-01-07 18:51:59 +05:30
Suman Maharana
00be51f299
Fixes #17747 : dbt update owners ( #19144 )
...
* Fixes 17747: dbt update owners
* update messages
* addressed comments
* py_format
* py_format
* Added tests
2025-01-07 16:37:30 +05:30
harshsoni2024
d3465e6a2d
MINOR: PowerBI improve error logging ( #19249 )
2025-01-07 14:39:59 +05:30
Suman Maharana
5b77c14dc8
Fixes #18816 - Airbyte api endpoint ( #19207 )
...
* Fix Airbyte api endpoint
* Fix Airbyte api endpoint
2025-01-07 12:41:56 +05:30
Teddy
f40369f59b
ISSUE-19220: remove druid and doris from non sqa ( #19250 )
...
* fix: remove druid and doris from non sqa
* style: ran p[ython styling
2025-01-07 08:06:57 +01:00
Pere Miquel Brull
4ee783cb63
FIX #19232 - Correct array type mapping in ORM converter ( #19241 )
2025-01-07 11:32:36 +05:30
Maciej Bryński
637e33fcae
Fixes 19217: Add ability to use confluent-kafka version greater than 2.1.1 ( #19218 )
...
* Add ability to use confluent-kafka version greater than 2.1.1
* fix: spotless
2025-01-06 09:01:22 -08:00
Teddy
3190411b94
MINOR - fix unity profiler ( #19247 )
2025-01-06 18:07:36 +05:30
piby180
ebd6020329
Specify Length function for PinotDB ( #19189 )
2025-01-06 14:44:02 +05:30
Mayur Singal
088cb64b7c
Fix #15952 : Update SQLParse to Version 0.5 ( #19224 )
2025-01-06 11:39:34 +05:30
Abdallah Serghine
05c57857aa
Fixes ISSUE-19095: auto refresh boto credentials ( #19098 )
...
When using using the assumeRole connection option with jobs involving
AWS services, the default 1 hour of boto might not cut it and the job
fails, one way of solving this is to refresh the credentials when they
expire, this ensures there is always valid credentials for the job
regardless for how long it runs.
Co-authored-by: Abdallah Serghine <abdallah.serghine@olx.pl>
Co-authored-by: IceS2 <pjt1991@gmail.com>
2025-01-03 10:51:15 +01:00
Pere Miquel Brull
9dc56c3bb0
TEST - Add bots search RBAC validation ( #19159 )
...
* TEST - Add bots search RBAC validation
* format
* format
2025-01-02 15:32:03 +01:00
Akash Verma
39dcb5baef
Feature : Cockroach db connector ( #18961 )
2025-01-02 13:07:55 +05:30
IceS2
3d83f41b82
Remove the sample_data from assert in profiler since it was moved to the classification workflow ( #19153 )
2024-12-20 10:48:56 +01:00
Pere Miquel Brull
d084243d0a
MINOR - Add Gov entities for entity ref & Automator Actions ( #19090 )
...
* MINOR - Add Gov entities for entity ref
* MINOR - Add Gov entities for entity ref
* add automator configs
* add automator configs
2024-12-20 07:14:52 +01:00
Pere Miquel Brull
7c2850da7e
MINOR - Improve MissingExpectedEntityAckException msg ( #19033 )
2024-12-20 07:14:36 +01:00
IceS2
efbdf21098
Fix e2e tests ( #19130 )
...
* Fix E2E
* Fix E2E
* Fix MySQL count
* Tentative Fix
* Tentative Fix
* Revert PowerBI changes
* Revert PowerBI changes
2024-12-19 10:39:30 +01:00
Suman Maharana
6dc7e5c26d
Fix dbt Table not found Issue ( #19117 )
2024-12-18 18:36:43 +05:30
Mayur Singal
a49aab7111
MINOR: User search should only look in name & displayName ( #19121 )
...
* MINOR: User search should only look in name & displayname
* py_format
* pyformat
---------
Co-authored-by: Suman Maharana <sumanmaharana786@gmail.com>
2024-12-18 16:44:54 +05:30
harshsoni2024
91628b0d92
powerbi refactor, avoid prepare bulk data ( #19123 )
2024-12-18 16:39:06 +05:30
IceS2
c664ab93f6
Fix checkstyle ( #19099 )
2024-12-18 10:10:32 +01:00
Teddy
fec328bb98
fix: handle existing dbt test results ( #19102 )
2024-12-18 14:17:58 +05:30
Akash Verma
69557e8716
fixes : #15742 Oracle stored package feature ( #18852 )
2024-12-16 19:35:20 +05:30
Abdallah Serghine
ac967dfe50
ISSUE-16094: fix s3 storage parquet structureFormat ingestion ( #18660 )
...
This aims at fixing the s3 ingestion for parquet files, current behaviour is that
the pipeline will break if it encounters a file that is not valid parquet in the
the container, this is not great as containers might container non parquet files
on purpose like for example _SUCCESS files created by spark.
For that do not fail the whole pipeline when a single container fails, instead
count it as a failure and move on with the remainder of the containers, this is
already an improvement by ideally the ingestion should try a couple more files
under the given prefix before given up, additionally we can allow users to specify
file patterns to be ignored.
Co-authored-by: Abdallah Serghine <abdallah.serghine@olx.pl>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2024-12-14 11:40:23 +01:00
Teddy
79b2888bb5
fix: azuresql sampler logic ( #19034 )
2024-12-13 07:35:04 +01:00
Keshav Mohta
f4ff43c24c
Fixes #17888 - Implemented Cross Database Lineage ( #18831 )
2024-12-12 15:13:36 +05:30
Keshav Mohta
cde3a7dd1e
Feature: Cassandra Connector ( #18943 )
2024-12-12 15:12:55 +05:30
Pere Miquel Brull
17c5ba8698
MINOR - Add APIs to Ref Map ( #19019 )
...
* MINOR - Add APIs to Ref Map
* MINOR - Add APIs to Ref Map
* MINOR - Add APIs to Ref Map
* format
2024-12-12 10:40:03 +01:00
Suman Maharana
85c7f6d22e
Minor: Fix kafkaconnect test connection ( #18965 )
2024-12-09 16:52:35 +05:30
Imri Paran
16875853a0
test(data-dff): fix flaky test ( #18898 )
...
use 99.5 CI for data diff sampling
2024-12-06 18:55:27 +05:30
Imri Paran
e30571cf4e
[GEN-2187] fix(data-diff): added MD5 handling for bigquery ( #18904 )
...
* fix(data-diff): added nd5 handling for bigquery
- added MD5 handling for bigquery
- use URL instead of Engine because it requires less steps and less prone to failure
* added e2e test for data diff with sampling in bigquery
2024-12-06 14:21:33 +01:00
Teddy
610322ffed
MINOR - MSSQL timestamp type profiler fix ( #18935 )
...
* fix: mssql timestamp processing
* fix: min/max test type on datetime column
* style: fix python format
2024-12-06 08:03:42 +01:00
LeoLuo123
b5750cbee1
Fixes 18300: Get last completed job run ( #18891 )
...
* Get last completed job run
* formatting
---------
Co-authored-by: 😺 Leo Luo <leo.luo@mavenclinic.com>
Co-authored-by: Suman Maharana <sumanmaharana786@gmail.com>
2024-12-05 14:53:26 +01:00
Teddy
03bd8e9dc4
FEAT: added TABLESAMPLE for MSSQL ( #18926 )
...
* feat: added TABLESAMPLE for sqlserver
* fix: class name
* test: added test to generated sample query
2024-12-05 14:17:39 +01:00
Suman Maharana
113fae6be0
Fix: dbt manifest parsing issue ( #18930 )
2024-12-05 13:06:25 +05:30
harshsoni2024
c941569a9e
filter empty columns, better msg ( #18932 )
2024-12-05 13:05:58 +05:30
Ayush Shah
8664c8df75
Fixes GEN-2199: Allow Fivetran filtering of pipelines using name instead of id ( #18929 )
2024-12-05 10:55:11 +05:30
Mayur Singal
8ac80e6807
MINOR: Tableau Capture SQL in Lineage ( #18925 )
2024-12-05 09:55:21 +05:30
Mayur Singal
6326ae3cb2
MINOR: DB2 Support License ( #18928 )
2024-12-05 09:54:58 +05:30
Ayush Shah
81b68682aa
Fixes GEN-2198: Snowflake unencrypted key support, connection error on storing bytes ( #18927 )
2024-12-05 07:55:44 +05:30
Mayur Singal
6d21dd12a4
MINOR: Snowflake UDF Lineage Support - main ( #18886 )
2024-12-05 00:19:40 +05:30
Mayur Singal
e44ca06173
MINOR: Add Try/Except to store procedure yielding ( #18883 )
2024-12-04 21:36:53 +05:30
Teddy
a615f49ab2
MINOR: fix table/schema name ( #18899 )
...
* fix: fix table/schema name
* fix: minor profiler and dbt issues
* style: ran python linting
---------
Co-authored-by: Imri Paran <imri.paran@gmail.com>
2024-12-04 10:12:38 +01:00
Pere Miquel Brull
613fd331e0
MINOR - Clean up configs & add auto classification docs ( #18907 )
...
* MINOR - Clean up configs & add auto classification docs
* deprecation notice
2024-12-04 09:32:25 +01:00
Suman Maharana
11b0a9c376
Fixes: mircostrategy test connection ( #18889 )
2024-12-03 17:13:15 +01:00
Suman Maharana
e582cb4d9c
Minor: Fix dbt source file issue ( #18903 )
2024-12-03 21:42:11 +05:30
Imri Paran
7ae886e8f9
chore(importer): better error message for missing plugins ( #18878 )
...
Before:
"Generic ImportError message"
After:
Error initializing metadata: You might be missing the plugin [bigquery]. Try:
pip install "openmetadata-ingestion[bigquery]==1.6.0"
2024-12-03 14:41:47 +00:00
Mayur Singal
7c6f5e67dd
MINOR: Snowflake Support Alter Table Swap Lineage ( #18887 )
2024-12-03 16:23:58 +05:30
