3270 Commits

Author SHA1 Message Date
Ayush Shah
7d21a8295b
MINOR: Typo for datetime attribute (#19420) 2025-01-17 14:29:36 +05:30
harshsoni2024
69d413ac34
Fix #19360: powerbi report lineage fix (#19395) 2025-01-17 14:22:52 +05:30
Mayur Singal
d0f65991f2
MINOR: Fix Kafka Test connection (#19410)
* MINOR: Fix Kafka Test connection

* fix: pylint fixed

---------

Co-authored-by: Ayush Shah <ayush@getcollate.io>
2025-01-17 12:21:43 +05:30
mgorsk1
fcf7072b12
🎉 Init (#19417) 2025-01-17 11:04:34 +05:30
Mayur Singal
f91172f7f5
Fix #19317: fetch Stored Procedures from account usage (#19375) 2025-01-16 11:33:11 +05:30
Mayur Singal
14164cf7ab
Fix #19317: Add MaterializedView & DynamicTable for lineage computation (#19373) 2025-01-16 11:12:02 +05:30
Mayur Singal
c1100d6751
Fix #19370: Fix Mariadb Dialect (#19371) 2025-01-16 11:11:39 +05:30
Suman Maharana
4cd5988bc1
Fix #19313 - dbt ingestion picks up wrong service to patch metadata (#19337)
* Fix #19313 - dbt ingestion picks up wrong service to patch metadata

* py format and linting

* Added a flag for searching across databases and docs

* py format
2025-01-15 11:45:32 +05:30
Keshav Mohta
7bea4f957f
Feature: Docker Host Retry (#19127) 2025-01-14 19:48:10 +05:30
Keshav Mohta
20f567b8da
Fixes #18570 - Redash Get Dashboards (#19331)
* fix: get dashboard by id

* fix: function param name id->dashboard_id | python checkstyle

* refactor: used api version and rename get dashboard function

* fix: used clean uri
2025-01-14 16:58:25 +05:30
Akash Verma
072711a563
Added condition for datatype=array without type consistency (#19312) 2025-01-14 14:05:42 +05:30
agriev
dcebc41e3f
Adds percona server for postgresql support (#19322)
* percona server for postgresql support

The only meaningful difference is version string in percona server for postgresql. So commit propose universal and safe way to detect server version by integer string, not complicated parsing of unformatted string.

* updated tests with get_server_version_num

commented outdated tests

---------

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2025-01-13 17:51:40 -08:00
Suman Maharana
89dae42407
Fix mysql e2e count (#19315) 2025-01-10 21:41:38 +05:30
Keshav Mohta
4bd8994a00
Feature: Cassandra SSL (#19226) 2025-01-10 11:25:43 +05:30
Akash Verma
9ecc8a8afe
Added integration testcontainer test for mongodb (#19282) 2025-01-10 10:10:11 +05:30
Akash Verma
83894d3ff0
resolved <NoneType object has no attribute rsplit> issue (#19293) 2025-01-10 10:09:20 +05:30
Mayur Singal
be3fdedc76
Fix #19160: Add Depth Support for Structured Containers (#19288) 2025-01-09 18:14:52 +05:30
Akash Verma
4cad5762ad
Added lineage in cli e2e (#19216) 2025-01-09 14:59:49 +05:30
harshsoni2024
63aa484fec
MINOR: powerbi e2e fix (#19240) 2025-01-09 13:49:59 +05:30
Matt Chamberlin
bf8a9e4f46
fix: Add docStore endpoints to Ometa API routes (#19172) 2025-01-08 15:47:18 +05:30
harshsoni2024
02046641d3
Redshift stored procedure query parse fix (#19276) 2025-01-08 15:10:59 +05:30
Mayur Singal
8fdaea805f
MINOR: Kafka dependency conflict resolution (#19278) 2025-01-08 14:42:24 +05:30
Suman Maharana
26bfde8f9c
Fix dbtcloud task/run date (#19265) 2025-01-08 11:35:56 +05:30
Pere Miquel Brull
e56f477a4a
Fix #19147 - Executable Test Suites (#19221)
* backend

* format & tests

* rename backend

* migrations and ingestion

* format & tests

* format & tests

* tests

* format & tests

* tests

* updated ui side of changes

* addressing comment

* fixed failing unit test

* fix test list

* added e2e test, and fixed existing test

---------

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2025-01-07 17:59:54 +01:00
Akash Verma
b2898f7007
Cockroach enhancement (#19108) 2025-01-07 18:51:59 +05:30
Suman Maharana
00be51f299
Fixes #17747: dbt update owners (#19144)
* Fixes 17747: dbt update owners

* update messages

* addressed comments

* py_format

* py_format

* Added tests
2025-01-07 16:37:30 +05:30
harshsoni2024
d3465e6a2d
MINOR: PowerBI improve error logging (#19249) 2025-01-07 14:39:59 +05:30
Suman Maharana
5b77c14dc8
Fixes #18816 - Airbyte api endpoint (#19207)
* Fix Airbyte api endpoint

* Fix Airbyte api endpoint
2025-01-07 12:41:56 +05:30
Teddy
f40369f59b
ISSUE-19220: remove druid and doris from non sqa (#19250)
* fix: remove druid and doris from non sqa

* style: ran p[ython styling
2025-01-07 08:06:57 +01:00
Pere Miquel Brull
4ee783cb63
FIX #19232 - Correct array type mapping in ORM converter (#19241) 2025-01-07 11:32:36 +05:30
Maciej Bryński
637e33fcae
Fixes 19217: Add ability to use confluent-kafka version greater than 2.1.1 (#19218)
* Add ability to use confluent-kafka version greater than 2.1.1

* fix: spotless
2025-01-06 09:01:22 -08:00
Teddy
3190411b94
MINOR - fix unity profiler (#19247) 2025-01-06 18:07:36 +05:30
piby180
ebd6020329
Specify Length function for PinotDB (#19189) 2025-01-06 14:44:02 +05:30
Mayur Singal
088cb64b7c
Fix #15952: Update SQLParse to Version 0.5 (#19224) 2025-01-06 11:39:34 +05:30
Abdallah Serghine
05c57857aa
Fixes ISSUE-19095: auto refresh boto credentials (#19098)
When using using the assumeRole connection option with jobs involving
AWS services, the default 1 hour of boto might not cut it and the job
fails, one way of solving this is to refresh the credentials when they
expire, this ensures there is always valid credentials for the job
regardless for how long it runs.

Co-authored-by: Abdallah Serghine <abdallah.serghine@olx.pl>
Co-authored-by: IceS2 <pjt1991@gmail.com>
2025-01-03 10:51:15 +01:00
Pere Miquel Brull
9dc56c3bb0
TEST - Add bots search RBAC validation (#19159)
* TEST - Add bots search RBAC validation

* format

* format
2025-01-02 15:32:03 +01:00
Akash Verma
39dcb5baef
Feature : Cockroach db connector (#18961) 2025-01-02 13:07:55 +05:30
IceS2
3d83f41b82
Remove the sample_data from assert in profiler since it was moved to the classification workflow (#19153) 2024-12-20 10:48:56 +01:00
Pere Miquel Brull
d084243d0a
MINOR - Add Gov entities for entity ref & Automator Actions (#19090)
* MINOR - Add Gov entities for entity ref

* MINOR - Add Gov entities for entity ref

* add automator configs

* add automator configs
2024-12-20 07:14:52 +01:00
Pere Miquel Brull
7c2850da7e
MINOR - Improve MissingExpectedEntityAckException msg (#19033) 2024-12-20 07:14:36 +01:00
IceS2
efbdf21098
Fix e2e tests (#19130)
* Fix E2E

* Fix E2E

* Fix MySQL count

* Tentative Fix

* Tentative Fix

* Revert PowerBI changes

* Revert PowerBI changes
2024-12-19 10:39:30 +01:00
Suman Maharana
6dc7e5c26d
Fix dbt Table not found Issue (#19117) 2024-12-18 18:36:43 +05:30
Mayur Singal
a49aab7111
MINOR: User search should only look in name & displayName (#19121)
* MINOR: User search should only look in name & displayname

* py_format

* pyformat

---------

Co-authored-by: Suman Maharana <sumanmaharana786@gmail.com>
2024-12-18 16:44:54 +05:30
harshsoni2024
91628b0d92
powerbi refactor, avoid prepare bulk data (#19123) 2024-12-18 16:39:06 +05:30
IceS2
c664ab93f6
Fix checkstyle (#19099) 2024-12-18 10:10:32 +01:00
Teddy
fec328bb98
fix: handle existing dbt test results (#19102) 2024-12-18 14:17:58 +05:30
Akash Verma
69557e8716
fixes: #15742 Oracle stored package feature (#18852) 2024-12-16 19:35:20 +05:30
Abdallah Serghine
ac967dfe50
ISSUE-16094: fix s3 storage parquet structureFormat ingestion (#18660)
This aims at fixing the s3 ingestion for parquet files, current behaviour is that
the pipeline will break if it encounters a file that is not valid parquet in the
the container, this is not great as containers might container non parquet files
on purpose like for example _SUCCESS files created by spark.

For that do not fail the whole pipeline when a single container fails, instead
count it as a failure and move on with the remainder of the containers, this is
already an improvement by ideally the ingestion should try a couple more files
under the given prefix before given up, additionally we can allow users to specify
file patterns to be ignored.

Co-authored-by: Abdallah Serghine <abdallah.serghine@olx.pl>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2024-12-14 11:40:23 +01:00
Teddy
79b2888bb5
fix: azuresql sampler logic (#19034) 2024-12-13 07:35:04 +01:00
Keshav Mohta
f4ff43c24c
Fixes #17888 - Implemented Cross Database Lineage (#18831) 2024-12-12 15:13:36 +05:30