2979 Commits

Author SHA1 Message Date
Suman Maharana
4d464c3173
Fix dbt Nonetype not Iterable (#20073) 2025-03-06 18:14:25 +05:30
Suman Maharana
29faee5b16
Fix Sigma not ingesting workbooks (#20082) 2025-03-05 17:21:20 +05:30
harshsoni2024
b14b4f5ac8
snowflake vector & unknown col. fix (#20079) 2025-03-05 17:00:14 +05:30
Pere Miquel Brull
55d7e50441
MINOR - Add and remove data products Actions in Automator (#19948)
* MINOR - Add and remove Data Product assets in Automator config

* MINOR - Add and remove Data Product assets in Automator config

* domain mixin

* build ref

* build ref

* create types

* fix tests

* fix conflicts

---------

Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
2025-03-05 07:11:17 +01:00
olof-nn
c46ed2aa56
Don't overwrite query to execute (#20069) 2025-03-05 11:11:20 +05:30
Mayur Singal
6f0dbd01eb
MINOR: Redshift - better log for view with no schema binding (#20005) 2025-03-04 15:26:20 +05:30
Mayur Singal
2af5e30f4c
MINOR: Improve memeory in temp table lineage (#20041) 2025-03-04 15:24:47 +05:30
Akash Verma
dfb6e1e3fe
Feat: Mssql Db&schema descrption (#19769) 2025-02-28 12:13:23 +05:30
Mayur Singal
8479fc436e
MINOR: Looker case insensitive search for users (#19979) 2025-02-27 14:27:04 +05:30
Mayur Singal
73876a9122
MINOR: Use clean url in clients (#19978) 2025-02-27 12:18:50 +05:30
Pere Miquel Brull
603d61eaa2
Fix #19856 - Set the db in mysql/mariadb for metric computations (#19994)
* use db for mysql/mariadb

* format
2025-02-26 20:30:42 +01:00
Pere Miquel Brull
6b7a9fe76c
MINOR - Update sampler tablenames (#19976)
* MINOR - Update sampler tablenames

* MINOR - Update sampler tablenames

* MINOR - Update sampler tablenames
2025-02-26 14:08:14 +01:00
Imri Paran
97fad806a2
Fixes 19755: Publish app config with status (#19754)
* feat(app): add config to status

add config to the reported status of the ingestion pipeline

* added separate pipeline service client call for external apps

* fix masking of pydantic model

* - overload model_dump to mask secrets instead of a separate method
- moved tests to test_custom_pydantic.py

* fix: execution time

* fix: mask secrets in dump json

* fix: for python3.8

* fix: for python3.8

* fix: use mask_secrets=False when dumping a model for create

* format

* fix: update mask_secrets=False for workflow configurations

* fix: use context directly when using model_dump_json

* fix: default behavior when dumping json

* format

* fixed tests
2025-02-25 16:51:49 +00:00
Keshav Mohta
df193bd0c4
Feature: Reverse Metadata Ingestion (#19723) 2025-02-25 18:41:08 +05:30
Charalampos Georgiadis
3366385e15
Add result_maker check for query share url in Looker (#19833)
* Add result_maker check for query share url

* Formatting

* Move sourceUrl logic outside of the yield

* Rename

* Convert to snake case

* Fix camel case

* Avoid nested conditionals

* Update result_maker check

---------

Co-authored-by: Suman Maharana <sumanmaharana786@gmail.com>
2025-02-20 21:46:18 +05:30
Mayur Singal
88f615ae47
Fix #19876: Snowflake Lineage Ingestion Fails Due to KeyError (#19878) 2025-02-20 16:26:11 +05:30
Mayur Singal
6305383a80
Minor: Trino Add missing import (#19853)
* Minor: Add missing import

* format
2025-02-18 10:02:31 +00:00
harshsoni2024
e0237d68b8
MINOR: powerbi fetch workspaces failure handle (#19785) 2025-02-17 15:27:03 +05:30
Pere Miquel Brull
91b62fdc32
FIX #19798 - Shortening SQA __tablename__ to avoid hitting errors in … (#19809)
* FIX #19798 - Shortening SQA __tablename__ to avoid hitting errors in postgres

* fix tests

---------

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2025-02-17 09:37:06 +01:00
Pere Miquel Brull
e4c34210ec
Fix #19807 - Implement the right SQA Sampler for UnityCatalog (#19811) 2025-02-16 11:58:27 -08:00
Suman Maharana
d6f2c9c416
Fix dbt Test case Timestamp issue (#19803) 2025-02-15 20:33:02 +05:30
Akash Verma
c6fe281de0
Mssql stored procedure description (#19775)
* Mssql stored procedure description

* resolved comment

---------

Co-authored-by: Akash Verma <akashverma@Akashs-MacBook-Pro-2.local>
2025-02-14 10:47:13 +05:30
Mayur Singal
c8e24e5f3b
MINOR: Fix unity catalog lineage - handle errors (#19791)
* MINOR: Fix unity catalog lineage - hanle errors

* lint
2025-02-14 10:45:31 +05:30
mgorsk1
0e260ce36a
feat: use dataset sql for superset lineage (#19617)
* 🎉 Init

* add fixes around row data type and backport fixes around array type

* refactor

* narrow down column lineage

* narrow down column lineage

* fix insert into

* review remarks + linter

* fix tests

* fix style check

* bring back compatibility with older python versions

* add unit tests

* fix tests

* linting

* expand tests

* make compatible with python 3.8

* checkstyle fix

* fix schema alias

* refactor - move get_dashboard_data_model_column_fqn to superset.utils as it's superset specific and won't work with other dashboard systems integrations
2025-02-12 07:14:31 -08:00
Mayur Singal
e873ba0f1b
Fix #19201: Fix connection password masking (#19749) 2025-02-12 16:16:25 +05:30
Mayur Singal
45efd878cb
Fix #19634: use system.query.history table for lineage - databricks (#19744) 2025-02-12 13:29:07 +05:30
Pere Miquel Brull
e4fa16e574
FIX - Profiler Source Include Views Filter (#19746)
* FIX - Profiler Source Include Views Filter

* FIX - Profiler Source Include Views Filter
2025-02-12 08:35:47 +01:00
Mayur Singal
155571f50a
MINOR: Add support for cluster key information - bigquery (#19727) 2025-02-12 12:03:18 +05:30
Mayur Singal
10e2e4afd4
Fix #19680: mask query method to return none if failed (#19752) 2025-02-12 11:44:58 +05:30
Teddy
e1b3e08317
MINOR BQ sampler type missing (#19696)
* fix: missing entity type in bq sampler

* fix: failing tests
2025-02-11 10:46:34 -08:00
Mayur Singal
29f067c162
Fix #19635: Snowflake allow custom account_usage schema (#19678) 2025-02-11 14:58:44 +05:30
Suman Maharana
c43fa48d18
Fix powerbi test connection sucess with bad credentials (#19730) 2025-02-11 13:49:21 +05:30
Akash Verma
fcbe9241bc
Fix: Postgres usage not terminating with bad connection (#19707)
* postgres usage not terminating with bad connection

* Added Operational error

---------

Co-authored-by: Akash Verma <akashverma@Akashs-MacBook-Pro-2.local>
2025-02-11 12:25:51 +05:30
IceS2
67899149e4
MINOR: Fix db2 license file import (#19731)
* Fix db2 license file import

* Update connection.py
2025-02-10 21:40:47 +01:00
Charalampos Georgiadis
15fedbd025
Fixes 19669: Add personas routes to OpenMetadata interface (#19671)
* Add missing personas routes

* Fix - isort

---------

Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
2025-02-10 10:45:47 +01:00
Suman Maharana
0d73ee7e36
Fixes #19171 - Looker parse derived view references query (#19687)
* Looker parse derived view references query

* Addressed Comments

* Linting

* Added Tests
2025-02-10 02:50:51 +05:30
Mayur Singal
b05c506845
Fix #19425: BigQuery External Table with Partition (#19705) 2025-02-07 14:01:04 +05:30
Teddy
e90bf9d487
ISSUE-19651: handle starburst JWToken expiration (#19689)
* fix: handle starburst JWToken expiration

* style: ran python linting
2025-02-07 08:24:52 +01:00
Akash Verma
a3ddf8bfd2
Added redshift external table lineage support (#19665) 2025-02-07 11:35:02 +05:30
Teddy
28bd01c471
MINOR: Remove default 100 when profileSample is None (#19672)
* fix: remove default 100% percent

* fix: use get_dataset

* fix: orm_profiler tests
2025-02-05 19:14:31 +01:00
Akash Verma
8dba4a5ac2
Fixes: snowflake lowercase issue (#19486) 2025-02-04 17:47:28 +05:30
Teddy
ef131d7e20
MINOR: Wrong attribute name in SampleConfig model (#19641)
* fix: wrong attribute name in SampleConfig model

* fix: test attribute

* fix: failing tests

* fix: trino filter error + adjust test to take into account null value

* fix: mssql and azuresql tablesample on views
2025-02-04 10:40:40 +01:00
Suman Maharana
3e3c702942
Fix - switch to collate-dbt-artifacts-parser (#19647)
* Switch to collate-dbt-artifacts-parser
2025-02-04 11:57:39 +05:30
Mayur Singal
3979920103
Fix #19628 - Exclude deleted Stored Procedure Snowflake (#19657) 2025-02-04 11:43:01 +05:30
Mayur Singal
208c40be09
Fix #19633: Fix databricks schema not found (#19646) 2025-02-04 11:42:11 +05:30
Mayur Singal
636a83514d
Fix #12094: Add support for temp table lineage (#19654) 2025-02-04 11:40:10 +05:30
mgorsk1
474f77b46b
feat: use table_id instead of table_name for fetching Superset dataset columns (#19618) 2025-02-03 10:30:42 +05:30
harshsoni2024
aae1dcfc59
issue-19112: API service schema fields of object type not listed (#19616) 2025-02-03 10:24:38 +05:30
Akash Verma
12c005af96
Hive: Updated postgres query to get partition field (#19563) 2025-02-03 10:23:48 +05:30
Suman Maharana
d863113f95
Added debug logs in looker (#19602) 2025-01-31 16:45:35 +05:30