Sergio Gómez Villamor
|
8cae980286
|
tests(ingestion): moving some tests so they are available for sdk users (#13540)
|
2025-05-19 08:39:53 +02:00 |
|
Harshal Sheth
|
189f8cefa7
|
feat(ingest): standardize sql type mappings (#11982)
|
2024-11-28 14:53:46 -05:00 |
|
Jonny Dixon
|
a8e6a06ea4
|
docs(ingest/dbt): update run result paths examples (#11138)
|
2024-09-27 10:11:06 -07:00 |
|
Harshal Sheth
|
d754650875
|
feat(ingest/dbt): produce multiple assertions for multi-table dbt tests (#11451)
|
2024-09-25 13:10:11 -07:00 |
|
Harshal Sheth
|
897173f270
|
feat(dbt): support prefer_sql_parser_lineage with sources enabled (#11168)
|
2024-08-13 13:54:50 -07:00 |
|
Harshal Sheth
|
4b9844da1b
|
feat(ingest/dbt): add experimental prefer_sql_parser_lineage flag (#11039)
|
2024-07-31 09:23:02 -07:00 |
|
Harshal Sheth
|
3d5735cbc5
|
chore(ingest): run pyupgrade for python 3.8 (#10513)
|
2024-05-15 22:31:05 -07:00 |
|
Harshal Sheth
|
c9b9afc530
|
feat(ingest/dbt): enable model performance and compiled code by default (#10164)
|
2024-04-02 09:29:27 -05:00 |
|
Harshal Sheth
|
f0bdc24fc9
|
feat(ingest/dbt): dbt model performance (#9992)
|
2024-03-26 17:18:54 -07:00 |
|
Harshal Sheth
|
4155a621a6
|
feat(ingest/dbt): capture both raw and compiled code (#10026)
|
2024-03-12 12:54:03 -07:00 |
|
Shubham Jagtap
|
1741c07d76
|
feat(ingestion): Add test_connection methods for important sources (#9334)
|
2023-12-14 12:31:51 -05:00 |
|
Harshal Sheth
|
19aa215068
|
feat(ingest/dbt): dbt column-level lineage (#8991)
|
2023-11-13 19:00:30 -05:00 |
|
Serhii Dimchenko
|
5b9fd977eb
|
fix(ingest/dbt-athena): dbt-athena types mapping for complex types (#8264)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
|
2023-06-22 11:40:27 +02:00 |
|
Serhii Dimchenko
|
6adb496581
|
feat: add dbt-athena adapter support for column types mapping (#8116)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
|
2023-05-27 09:22:55 -05:00 |
|
Harshal Sheth
|
b2689b7514
|
test(ingest/dbt): add test for column meta match (#7673)
|
2023-03-28 21:51:31 +05:30 |
|
Harshal Sheth
|
c8abf9a1d4
|
fix(ingest/dbt): enable incremental lineage by default (#7674)
|
2023-03-24 18:14:19 -04:00 |
|
Harshal Sheth
|
fc41f455a0
|
feat(ingest): support snapshots in dbt and dbt-cloud (#7062)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
|
2023-01-18 08:35:03 -08:00 |
|
Harshal Sheth
|
47be95689e
|
refactor(ingest/stateful): remove most remaining state classes (#6791)
|
2022-12-19 13:40:48 -05:00 |
|
Tamas Nemeth
|
e41b455e14
|
fix(ingest): bigquery - sharded table support improvements (#6789)
|
2022-12-19 18:57:37 +01:00 |
|
Harshal Sheth
|
2f95719dba
|
feat(ingest): remove source config from DatahubIngestionCheckpoint (#6722)
|
2022-12-14 12:39:21 -05:00 |
|
Harshal Sheth
|
cf3db168ac
|
feat(ingest): start simplifying stateful ingestion state (#6740)
|
2022-12-13 10:05:57 +01:00 |
|
Harshal Sheth
|
05a0f3e2a6
|
feat(ingest): dbt cloud integration (#6323)
|
2022-11-21 14:14:33 -05:00 |
|
Harshal Sheth
|
d3174e75b7
|
fix(ingest): dbt - disable incremental lineage by default (#6467)
|
2022-11-17 09:41:43 +01:00 |
|
Mayuri Nehate
|
198c86a620
|
feat(ingest): support incremental lineage to dbt node from external platform (#6392)
|
2022-11-14 13:16:38 -05:00 |
|
Ravindra Lanka
|
b8941ab190
|
feat(ingestion): Add fail-safe stale entity removal via configurable 'fail_safe_threshold' param. (#6027)
|
2022-09-22 16:09:22 -07:00 |
|
Harshal Sheth
|
8ffa7054e5
|
feat(ingest): dbt column-level meta mappings + add_terms operation (#5970)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
|
2022-09-19 15:26:12 -07:00 |
|
Harshal Sheth
|
c8cd7d5040
|
refactor(ingest): use typed objects in dbt ingestion (#5929)
|
2022-09-16 15:07:59 -07:00 |
|
Ravindra Lanka
|
ee68f09624
|
feat(ingestion): Refactor standard state-handling tasks into a common handler that are common across all stateful ingestion sources. (#5766)
|
2022-09-14 09:30:42 -07:00 |
|
Harshal Sheth
|
3cd8ea8316
|
test(ingest): use pytest parameterization for dbt integration tests (#5879)
|
2022-09-10 18:35:58 -07:00 |
|
Harshal Sheth
|
954397a078
|
fix(ingest): remove dbt disable_dbt_node_creation and load_schema options (#5877)
|
2022-09-09 14:07:55 -07:00 |
|
Marcin Szymański
|
57996049fb
|
fix(ingest): sql - add missing trino types (#5870)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
|
2022-09-09 14:07:00 -07:00 |
|
Harshal Sheth
|
2115d5bf1d
|
fix(ingest): remove dbt delete_tests_as_datasets option (#5865)
This option was added for backwards compat and can be dropped now.
|
2022-09-08 11:22:25 -07:00 |
|
Ravindra Lanka
|
228f3b50ea
|
feat(ingestion): send reports of ingestion runs to datahub (#5639)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
|
2022-08-19 09:08:17 -07:00 |
|
Piotr Sierkin
|
828a711684
|
feat(ingest): dbt - control over emitting test_results, test_definitions, etc. (#5328)
Co-authored-by: Piotr Sierkin <piotr.sierkin@getindata.com>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
|
2022-08-06 21:42:53 -07:00 |
|
Marcin Szymański
|
fa42b59d9f
|
fix(ingestion): correct trino datatype handling (#5541)
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
|
2022-08-03 20:55:14 -07:00 |
|
mohdsiddique
|
f1abdc91ee
|
fix(dbt): fix issue of assertion error when stateful ingestion is used with dbt tests (#5540)
* fix(dbt): fix issue of dbt stateful ingestion with tests
Co-authored-by: MugdhaHardikar-GSLab <mugdha.hardikar@gslab.com>
Co-authored-by: MohdSiddique Bagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
|
2022-08-03 13:22:04 -07:00 |
|
Aezo
|
85a55ffac7
|
fix(ingest): dbt - add support for trino datatypes (#5379)
|
2022-07-26 17:02:00 -07:00 |
|
Shirshanka Das
|
4b3135a0f8
|
feat(ingest): dbt - improving dbt_meta mapping (#5237)
|
2022-06-24 13:43:12 +02:00 |
|
Shirshanka Das
|
0ee2569d5c
|
feat(ingest): dbt - adding support for dbt tests (#5201)
|
2022-06-18 13:30:04 -07:00 |
|
skrydal
|
503208beaa
|
feat(ingest): dbt - add platform instance for target platform (#5129)
|
2022-06-12 09:29:44 -07:00 |
|
Gabe Lyons
|
7b1cf6f8b2
|
feat(dbt): enable data platform instance on dbt (#4926)
|
2022-05-17 16:53:16 -07:00 |
|
Tamas Nemeth
|
474b0ba61e
|
feat(ingest): dbt - add query tag mapping and match template (#4744)
|
2022-04-25 10:56:45 -07:00 |
|
Arun Vasudevan
|
5aa3da5c9c
|
feat(ingestion) dbt: Fixing issue with strip_user_ids_from_email and adding owner_extraction_pattern (#4587)
* Fixing issue with strip_user_ids_from_email and adding owner_extraction_pattern
Co-authored-by: BZ <93607724+BoyuanZhangDE@users.noreply.github.com>
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
|
2022-04-13 16:58:36 -07:00 |
|
mohdsiddique
|
57002c766d
|
feat(stateful dbt): add stateful ingestion capability in dbt source (#4456)
* feat(stateful dbt): add stateful ingestion capability in dbt source
Co-authored-by: MohdSiddiqueBagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
|
2022-03-30 18:09:02 -07:00 |
|
Swaroop Jagadish
|
480ad24282
|
feat(ingest): dbt - add support for dbt meta mapping (#3832)
|
2022-01-05 16:32:05 -08:00 |
|
Sergio Gómez Villamor
|
c59c63e90d
|
feat: enables dbt metadata files to be loaded from URIs (#3739)
|
2021-12-15 09:11:39 -08:00 |
|
varunbharill
|
417b555fef
|
feat(dbt): dbt enhancements - dbt nodes, lineage, subtype, etc. (#3519)
|
2021-11-05 09:27:41 -07:00 |
|
AndreasTA-AW
|
561c04bcf8
|
feat(dbt-ingestion): add ability to skip specific models (#3340)
|
2021-10-25 22:31:19 -07:00 |
|
AndreasTA-AW
|
61ba3cf578
|
feat(ingest): added tags and owner from dbt (#3270)
Co-authored-by: Andreas Törnström Andersson <andreas.tornstrom-andersson@forefront.se>
|
2021-10-05 07:31:58 -07:00 |
|
Kevin Hu
|
f82ea3abef
|
feat(ingest): ingest descriptions from dbt models (#2955)
|
2021-07-26 10:47:25 -07:00 |
|