2958 Commits

Author SHA1 Message Date
Akash Verma
c6fe281de0
Mssql stored procedure description (#19775)
* Mssql stored procedure description

* resolved comment

---------

Co-authored-by: Akash Verma <akashverma@Akashs-MacBook-Pro-2.local>
2025-02-14 10:47:13 +05:30
Mayur Singal
c8e24e5f3b
MINOR: Fix unity catalog lineage - handle errors (#19791)
* MINOR: Fix unity catalog lineage - hanle errors

* lint
2025-02-14 10:45:31 +05:30
mgorsk1
0e260ce36a
feat: use dataset sql for superset lineage (#19617)
* 🎉 Init

* add fixes around row data type and backport fixes around array type

* refactor

* narrow down column lineage

* narrow down column lineage

* fix insert into

* review remarks + linter

* fix tests

* fix style check

* bring back compatibility with older python versions

* add unit tests

* fix tests

* linting

* expand tests

* make compatible with python 3.8

* checkstyle fix

* fix schema alias

* refactor - move get_dashboard_data_model_column_fqn to superset.utils as it's superset specific and won't work with other dashboard systems integrations
2025-02-12 07:14:31 -08:00
Mayur Singal
e873ba0f1b
Fix #19201: Fix connection password masking (#19749) 2025-02-12 16:16:25 +05:30
Mayur Singal
45efd878cb
Fix #19634: use system.query.history table for lineage - databricks (#19744) 2025-02-12 13:29:07 +05:30
Pere Miquel Brull
e4fa16e574
FIX - Profiler Source Include Views Filter (#19746)
* FIX - Profiler Source Include Views Filter

* FIX - Profiler Source Include Views Filter
2025-02-12 08:35:47 +01:00
Mayur Singal
155571f50a
MINOR: Add support for cluster key information - bigquery (#19727) 2025-02-12 12:03:18 +05:30
Mayur Singal
10e2e4afd4
Fix #19680: mask query method to return none if failed (#19752) 2025-02-12 11:44:58 +05:30
Teddy
e1b3e08317
MINOR BQ sampler type missing (#19696)
* fix: missing entity type in bq sampler

* fix: failing tests
2025-02-11 10:46:34 -08:00
Mayur Singal
29f067c162
Fix #19635: Snowflake allow custom account_usage schema (#19678) 2025-02-11 14:58:44 +05:30
Suman Maharana
c43fa48d18
Fix powerbi test connection sucess with bad credentials (#19730) 2025-02-11 13:49:21 +05:30
Akash Verma
fcbe9241bc
Fix: Postgres usage not terminating with bad connection (#19707)
* postgres usage not terminating with bad connection

* Added Operational error

---------

Co-authored-by: Akash Verma <akashverma@Akashs-MacBook-Pro-2.local>
2025-02-11 12:25:51 +05:30
IceS2
67899149e4
MINOR: Fix db2 license file import (#19731)
* Fix db2 license file import

* Update connection.py
2025-02-10 21:40:47 +01:00
Charalampos Georgiadis
15fedbd025
Fixes 19669: Add personas routes to OpenMetadata interface (#19671)
* Add missing personas routes

* Fix - isort

---------

Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
2025-02-10 10:45:47 +01:00
Suman Maharana
0d73ee7e36
Fixes #19171 - Looker parse derived view references query (#19687)
* Looker parse derived view references query

* Addressed Comments

* Linting

* Added Tests
2025-02-10 02:50:51 +05:30
Mayur Singal
b05c506845
Fix #19425: BigQuery External Table with Partition (#19705) 2025-02-07 14:01:04 +05:30
Teddy
e90bf9d487
ISSUE-19651: handle starburst JWToken expiration (#19689)
* fix: handle starburst JWToken expiration

* style: ran python linting
2025-02-07 08:24:52 +01:00
Akash Verma
a3ddf8bfd2
Added redshift external table lineage support (#19665) 2025-02-07 11:35:02 +05:30
Teddy
28bd01c471
MINOR: Remove default 100 when profileSample is None (#19672)
* fix: remove default 100% percent

* fix: use get_dataset

* fix: orm_profiler tests
2025-02-05 19:14:31 +01:00
Akash Verma
8dba4a5ac2
Fixes: snowflake lowercase issue (#19486) 2025-02-04 17:47:28 +05:30
Teddy
ef131d7e20
MINOR: Wrong attribute name in SampleConfig model (#19641)
* fix: wrong attribute name in SampleConfig model

* fix: test attribute

* fix: failing tests

* fix: trino filter error + adjust test to take into account null value

* fix: mssql and azuresql tablesample on views
2025-02-04 10:40:40 +01:00
Suman Maharana
3e3c702942
Fix - switch to collate-dbt-artifacts-parser (#19647)
* Switch to collate-dbt-artifacts-parser
2025-02-04 11:57:39 +05:30
Mayur Singal
3979920103
Fix #19628 - Exclude deleted Stored Procedure Snowflake (#19657) 2025-02-04 11:43:01 +05:30
Mayur Singal
208c40be09
Fix #19633: Fix databricks schema not found (#19646) 2025-02-04 11:42:11 +05:30
Mayur Singal
636a83514d
Fix #12094: Add support for temp table lineage (#19654) 2025-02-04 11:40:10 +05:30
mgorsk1
474f77b46b
feat: use table_id instead of table_name for fetching Superset dataset columns (#19618) 2025-02-03 10:30:42 +05:30
harshsoni2024
aae1dcfc59
issue-19112: API service schema fields of object type not listed (#19616) 2025-02-03 10:24:38 +05:30
Akash Verma
12c005af96
Hive: Updated postgres query to get partition field (#19563) 2025-02-03 10:23:48 +05:30
Suman Maharana
d863113f95
Added debug logs in looker (#19602) 2025-01-31 16:45:35 +05:30
Mayur Singal
d7916a0444
MINOR: Fix ES Req for Views (#19595) 2025-01-29 20:07:27 +05:30
mloetscher
d142edceb7
ISSUE-19546: PowerBiColumns description added (#19547) 2025-01-29 08:33:25 +00:00
Mayur Singal
3a8f1a6d1b
MINOR: Make DBT Tests failure log to debug (#19577) 2025-01-29 11:00:23 +05:30
Mayur Singal
39eae2dfa5
MINOR: Mariadb Lineage Fix (#19575) 2025-01-29 10:59:16 +05:30
Akash Verma
837e6dd418
Metabase: Ingest orphan charts inside a dashbaord named Default (#19419) 2025-01-28 16:53:19 +05:30
Mayur Singal
5118bd6048
MINOR: Optimise Snowflake SP Query (#19536) 2025-01-28 10:29:34 +05:30
Mayur Singal
d2dc7bd038
Fix #19489: Optimise multithreading for lineage (#19524) 2025-01-27 18:15:58 +05:30
harshsoni2024
b1d481f2f1
issue-16744: salesforce column description with toggle api (#19527) 2025-01-27 16:54:35 +05:30
Teddy
8233af52d8
fix: wrong dataset and project id in filter (#19522) 2025-01-27 08:04:49 +01:00
harshsoni2024
ce6b4ace33
issue-19508: PowerBI tables, datamodel metadata missing (#19509) 2025-01-27 12:33:44 +05:30
Ayush Shah
e59ddecf28
Feat: Enhance Kafka SSL configuration support with consumerConfigSSL (#19433) 2025-01-27 10:15:48 +05:30
Akash Verma
68a0e6af58
Fix: Updated queries causing arithmetic overflow error (#19505)
Co-authored-by: Akash Verma <akashverma@Akashs-MacBook-Pro-2.local>
2025-01-24 13:44:55 +05:30
Suman Maharana
94ed7e3c1a
Fix Duplicate table constraints (#19502) 2025-01-24 13:35:53 +05:30
Suman Maharana
f13eb4e273
Fix :postgres parse json schemas (#19487) 2025-01-23 22:18:25 +05:30
Abdallah Serghine
a631d22c32
MINOR: fix model dump dict key names (#19484) (#19485)
Co-authored-by: Abdallah Serghine <abdallah.serghine@olx.pl>
2025-01-23 12:36:19 +05:30
olof-nn
fd2575d244
ISSUE-19454: Fixes broken looker lineage (#19456)
* ISSUE-19454: Fixes the broken lineage in looker when backticks enclosed table refs

* refactor

* use isort

* Update ingestion/src/metadata/ingestion/source/dashboard/looker/metadata.py

Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>

---------

Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
2025-01-22 17:56:01 +05:30
Suman Maharana
1112de22bc
Fix Kafkaconnect validation errors (#19401) 2025-01-20 11:58:00 +05:30
Ayush Shah
aff6913e98
MINOR: BigQuery Improvement, Hive Partitioned Tables, Nonetype issue resolved (#19429) 2025-01-18 19:41:30 +05:30
Ayush Shah
7d21a8295b
MINOR: Typo for datetime attribute (#19420) 2025-01-17 14:29:36 +05:30
harshsoni2024
69d413ac34
Fix #19360: powerbi report lineage fix (#19395) 2025-01-17 14:22:52 +05:30
Mayur Singal
d0f65991f2
MINOR: Fix Kafka Test connection (#19410)
* MINOR: Fix Kafka Test connection

* fix: pylint fixed

---------

Co-authored-by: Ayush Shah <ayush@getcollate.io>
2025-01-17 12:21:43 +05:30