3089 Commits

Author SHA1 Message Date
Mayuri Nehate
3ae82f6b49
fix(ingest): always resolve platform for browse path v2 (#12045) 2024-12-12 15:24:35 +05:30
Mayuri Nehate
84de42d718
feat(ingest/snowflake): ingest secure, dynamic, hybrid table metadata (#12094) 2024-12-12 12:04:06 +05:30
sid-acryl
d062411c68
fix(ingest/tableau): project_path_pattern use in _is_denied_project (#12010) 2024-12-11 11:38:52 -08:00
Chris Collins
f1ef4f8e5f
feat(structuredProperties) Add new settings aspect plus graphql changes for structured props (#12052) 2024-12-11 13:59:14 -05:00
skrydal
b091e4615d
feat(ingest/kafka): Flag for optional schemas ingestion (#12077) 2024-12-11 16:02:31 +00:00
Jonny Dixon
e6cc676b23
fix(ingest/abs): detect jsonl schema (#11775) 2024-12-11 18:24:47 +05:30
Aseem Bansal
54d53cfc62
fix(ingest/gc): minor tweak gc source (#12093) 2024-12-11 18:24:18 +05:30
Aseem Bansal
ff7ac48021
fix(cli): don't use /api in gms url (#12083) 2024-12-11 16:11:08 +05:30
Mayuri Nehate
355a7e69aa
feat(ingest/snowflake): allow option for incremental properties (#12080) 2024-12-11 16:08:39 +05:30
Harshal Sheth
d953718ab7
feat(ingest): allow max_workers=1 with ASYNC_BATCH rest sink (#12088) 2024-12-10 18:32:52 -05:00
sagar-salvi-apptware
57b12bd9cb
fix(ingest): replace sqllineage/sqlparse with our SQL parser (#12020) 2024-12-10 08:36:01 -08:00
Shirshanka Das
e4ea993df1
fix(py-sdk): DataJobPatchBuilder handling timestamps, output edges (#12067)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-12-09 19:40:31 -05:00
haeniya
4811de1c1d
feat(ingestion/tableau): hidden asset handling (#11559)
Co-authored-by: Yanik Häni <Yanik.Haeni1@swisscom.com>
2024-12-09 14:29:11 +05:30
Sergio Gómez Villamor
0e7ebaf0b2
feat(tableau): adds more reporting metrics to better understand lineage construction in tableau ingestion (#12008)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-12-09 07:29:42 +00:00
Tamas Nemeth
70bec48088
fix(ingest/gc): Additional dataprocess cleanup fixes (#12049) 2024-12-07 13:45:14 +01:00
Tamas Nemeth
1d5ddf0c04
fix(ingest/sagemaker): Adding option to control retry for any aws source (#8727) 2024-12-07 13:40:32 +01:00
hwmarkcheng
46aa962bad
feat(ingest/superset): initial support for superset datasets (#11972) 2024-12-06 13:48:00 -08:00
Harshal Sheth
bd7649ed89
refactor(ingest/sql): add _get_view_definition helper method (#12033) 2024-12-06 08:17:41 -08:00
Harshal Sheth
b495205ed0
fix(ingest/powerbi): reduce type cast usage (#12004) 2024-12-06 08:13:37 -08:00
stcha
ea9eaf439d
fix(ingest/snowflake): Add handling of Hybrid Table type for Snowflake ingestion (#12039) 2024-12-06 15:02:32 +00:00
Mayuri Nehate
2fe21329fa
fix(ingest): avoid shell entities during view lineage generation (#12044) 2024-12-06 12:43:05 +05:30
Gabe Lyons
1ed55f4176
feat(snowflake): adding oauth token bypass to snowflake (#12048) 2024-12-05 17:50:56 -08:00
Tamas Nemeth
3c388a56a5
fix(ingest/gc): Adding test and more checks to gc source (#12027) 2024-12-05 14:19:44 +05:30
Mayuri Nehate
8d15df0c11
feat(ingest/kafka): additional validation for oauth_db signature (#11996) 2024-12-05 12:41:43 +05:30
Alice-sky
ca46c022d5
fix(ingest/pulsar): handle missing/invalid schema objects (#11945)
Co-authored-by: Alice <spongebob2023123@163.com>
2024-12-04 12:19:18 -08:00
Aseem Bansal
fcc8b367c1
feat(cli): add platform filter for undo soft delete (#12012) 2024-12-04 16:24:05 +05:30
Harshal Sheth
2b42b29d2f
fix(ingest/tableau): make sites.get_by_id call optional (#12024) 2024-12-04 14:37:09 +05:30
Sergio Gómez Villamor
df9755c948
feat(tableau): review reporting and debug traces (#12015)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-12-04 14:36:25 +05:30
Tamas Nemeth
230bd2674b
fix(ingest/looker): Don't fail on unknown liquid filters (#12014) 2024-12-03 20:01:12 +01:00
Aseem Bansal
db7e51bf10
fix(ingest/gc): do not cleanup empty job/flow (#12013) 2024-12-03 19:23:10 +05:30
Aseem Bansal
5d7298ea07
fix(ingest/gc): typo fix, do not delete empty entities (#12011) 2024-12-03 18:32:24 +05:30
Tamas Nemeth
16a02411c3
fix(ingest/sagemaker): Gracefully handle missing model group (#12000) 2024-12-03 10:48:04 +01:00
Mayuri Nehate
59181e4637
fix(ingest): resolve missing numeric types for profiling (#11991) 2024-12-02 10:06:51 -08:00
Harshal Sheth
ce6474df5a
chore(ingest): remove deprecated calls to Urn.create_from_string (#11983) 2024-12-02 09:53:13 -08:00
Aseem Bansal
580390ed82
fix(ingest/gc): delete invalid dpis (#11998) 2024-12-02 19:31:59 +05:30
sagar-salvi-apptware
b538d4bc73
fix(ingestion/dremio): Fixed lineage view for dremio EE (#11990) 2024-12-02 15:02:47 +05:30
k-bartlett
dc87b51369
feat(ingest): connector for Neo4j (#11526)
Co-authored-by: kbartlett <keith.bartlett@fullsight.org>
Co-authored-by: Andrew Sikowitz <andrew.sikowitz@acryl.io>
Co-authored-by: Jay Feldman <8128360+feldjay@users.noreply.github.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: deepgarg-visa <149145061+deepgarg-visa@users.noreply.github.com>
Co-authored-by: Felix Lüdin <13187726+Masterchen09@users.noreply.github.com>
2024-12-02 14:53:28 +05:30
Jonny Dixon
74a84885df
feat(ingest/dremio): Retrieve default_schema for SQL views (#11832) 2024-11-29 11:46:29 -08:00
sagar-salvi-apptware
c42f779859
fix: Add option for disabling ownership extraction (#11970)
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
2024-11-29 21:28:31 +05:30
Harshal Sheth
a46de1ecf9
feat(ingest/athena): handle partition fetching errors (#11966) 2024-11-28 21:42:55 -05:00
Harshal Sheth
a92c6b2bb0
feat(ingest): add tests for colon characters in urns (#11976) 2024-11-28 21:42:40 -05:00
Harshal Sheth
189f8cefa7
feat(ingest): standardize sql type mappings (#11982) 2024-11-28 14:53:46 -05:00
skrydal
816fd3dba7
fix(ingestion/iceberg): Improvements to iceberg source (#11987) 2024-11-28 15:34:20 +00:00
Mayuri Nehate
ecba2244f0
fix(ingest/kafka):add poll for admin client for oauth_cb (#11985)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2024-11-28 19:23:30 +05:30
Margarida Fernandes
f3eda31326
feat(ingestion): extend feast plugin to ingest tags and owners (#11784)
Co-authored-by: John Joyce <john@acryl.io>
2024-11-27 15:41:04 -08:00
sid-acryl
7bf7673735
refactor(ingest/powerbi): organize code within the module based on responsibilities (#11924) 2024-11-27 09:32:24 -08:00
Aseem Bansal
48d711b198
fix(ingest): more error handling (#11969) 2024-11-27 16:49:01 +05:30
Harshal Sheth
b6ccb8c9bf
fix(ingest): ensure sentry is initialized with graph tags (#11949) 2024-11-26 22:20:50 -05:00
Mayuri Nehate
2e3b4294bb
feat(ingest/mssql): allow filtering by procedure_pattern (#11953) 2024-11-26 11:16:42 -05:00
Tamas Nemeth
01fb64c531
fix(ingest/bigquery): Fix performance issue with column profiling ignore (#11807) 2024-11-26 15:32:03 +01:00