Harshal Sheth
|
47be95689e
|
refactor(ingest/stateful): remove most remaining state classes (#6791)
|
2022-12-19 13:40:48 -05:00 |
|
Tamas Nemeth
|
e41b455e14
|
fix(ingest): bigquery - sharded table support improvements (#6789)
|
2022-12-19 18:57:37 +01:00 |
|
Harshal Sheth
|
2f95719dba
|
feat(ingest): remove source config from DatahubIngestionCheckpoint (#6722)
|
2022-12-14 12:39:21 -05:00 |
|
Harshal Sheth
|
cf3db168ac
|
feat(ingest): start simplifying stateful ingestion state (#6740)
|
2022-12-13 10:05:57 +01:00 |
|
Harshal Sheth
|
05a0f3e2a6
|
feat(ingest): dbt cloud integration (#6323)
|
2022-11-21 14:14:33 -05:00 |
|
Harshal Sheth
|
d3174e75b7
|
fix(ingest): dbt - disable incremental lineage by default (#6467)
|
2022-11-17 09:41:43 +01:00 |
|
Mayuri Nehate
|
198c86a620
|
feat(ingest): support incremental lineage to dbt node from external platform (#6392)
|
2022-11-14 13:16:38 -05:00 |
|
Ravindra Lanka
|
b8941ab190
|
feat(ingestion): Add fail-safe stale entity removal via configurable 'fail_safe_threshold' param. (#6027)
|
2022-09-22 16:09:22 -07:00 |
|
Harshal Sheth
|
8ffa7054e5
|
feat(ingest): dbt column-level meta mappings + add_terms operation (#5970)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
|
2022-09-19 15:26:12 -07:00 |
|
Harshal Sheth
|
c8cd7d5040
|
refactor(ingest): use typed objects in dbt ingestion (#5929)
|
2022-09-16 15:07:59 -07:00 |
|
Ravindra Lanka
|
ee68f09624
|
feat(ingestion): Refactor standard state-handling tasks into a common handler that are common across all stateful ingestion sources. (#5766)
|
2022-09-14 09:30:42 -07:00 |
|
Harshal Sheth
|
3cd8ea8316
|
test(ingest): use pytest parameterization for dbt integration tests (#5879)
|
2022-09-10 18:35:58 -07:00 |
|
Harshal Sheth
|
954397a078
|
fix(ingest): remove dbt disable_dbt_node_creation and load_schema options (#5877)
|
2022-09-09 14:07:55 -07:00 |
|
Marcin Szymański
|
57996049fb
|
fix(ingest): sql - add missing trino types (#5870)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
|
2022-09-09 14:07:00 -07:00 |
|
Harshal Sheth
|
2115d5bf1d
|
fix(ingest): remove dbt delete_tests_as_datasets option (#5865)
This option was added for backwards compat and can be dropped now.
|
2022-09-08 11:22:25 -07:00 |
|
Ravindra Lanka
|
228f3b50ea
|
feat(ingestion): send reports of ingestion runs to datahub (#5639)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
|
2022-08-19 09:08:17 -07:00 |
|
Piotr Sierkin
|
828a711684
|
feat(ingest): dbt - control over emitting test_results, test_definitions, etc. (#5328)
Co-authored-by: Piotr Sierkin <piotr.sierkin@getindata.com>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
|
2022-08-06 21:42:53 -07:00 |
|
Marcin Szymański
|
fa42b59d9f
|
fix(ingestion): correct trino datatype handling (#5541)
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
|
2022-08-03 20:55:14 -07:00 |
|
mohdsiddique
|
f1abdc91ee
|
fix(dbt): fix issue of assertion error when stateful ingestion is used with dbt tests (#5540)
* fix(dbt): fix issue of dbt stateful ingestion with tests
Co-authored-by: MugdhaHardikar-GSLab <mugdha.hardikar@gslab.com>
Co-authored-by: MohdSiddique Bagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
|
2022-08-03 13:22:04 -07:00 |
|
Aezo
|
85a55ffac7
|
fix(ingest): dbt - add support for trino datatypes (#5379)
|
2022-07-26 17:02:00 -07:00 |
|
Shirshanka Das
|
4b3135a0f8
|
feat(ingest): dbt - improving dbt_meta mapping (#5237)
|
2022-06-24 13:43:12 +02:00 |
|
Shirshanka Das
|
0ee2569d5c
|
feat(ingest): dbt - adding support for dbt tests (#5201)
|
2022-06-18 13:30:04 -07:00 |
|
skrydal
|
503208beaa
|
feat(ingest): dbt - add platform instance for target platform (#5129)
|
2022-06-12 09:29:44 -07:00 |
|
Gabe Lyons
|
7b1cf6f8b2
|
feat(dbt): enable data platform instance on dbt (#4926)
|
2022-05-17 16:53:16 -07:00 |
|
Tamas Nemeth
|
474b0ba61e
|
feat(ingest): dbt - add query tag mapping and match template (#4744)
|
2022-04-25 10:56:45 -07:00 |
|
Arun Vasudevan
|
5aa3da5c9c
|
feat(ingestion) dbt: Fixing issue with strip_user_ids_from_email and adding owner_extraction_pattern (#4587)
* Fixing issue with strip_user_ids_from_email and adding owner_extraction_pattern
Co-authored-by: BZ <93607724+BoyuanZhangDE@users.noreply.github.com>
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
|
2022-04-13 16:58:36 -07:00 |
|
mohdsiddique
|
57002c766d
|
feat(stateful dbt): add stateful ingestion capability in dbt source (#4456)
* feat(stateful dbt): add stateful ingestion capability in dbt source
Co-authored-by: MohdSiddiqueBagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
|
2022-03-30 18:09:02 -07:00 |
|
Swaroop Jagadish
|
480ad24282
|
feat(ingest): dbt - add support for dbt meta mapping (#3832)
|
2022-01-05 16:32:05 -08:00 |
|
Sergio Gómez Villamor
|
c59c63e90d
|
feat: enables dbt metadata files to be loaded from URIs (#3739)
|
2021-12-15 09:11:39 -08:00 |
|
varunbharill
|
417b555fef
|
feat(dbt): dbt enhancements - dbt nodes, lineage, subtype, etc. (#3519)
|
2021-11-05 09:27:41 -07:00 |
|
AndreasTA-AW
|
561c04bcf8
|
feat(dbt-ingestion): add ability to skip specific models (#3340)
|
2021-10-25 22:31:19 -07:00 |
|
AndreasTA-AW
|
61ba3cf578
|
feat(ingest): added tags and owner from dbt (#3270)
Co-authored-by: Andreas Törnström Andersson <andreas.tornstrom-andersson@forefront.se>
|
2021-10-05 07:31:58 -07:00 |
|
Kevin Hu
|
f82ea3abef
|
feat(ingest): ingest descriptions from dbt models (#2955)
|
2021-07-26 10:47:25 -07:00 |
|
Kevin Hu
|
d6875b4f4f
|
feat(ingest): test dbt ingestion with and without schemas (#2922)
|
2021-07-21 12:56:31 -07:00 |
|
Harshal Sheth
|
d66381451a
|
feat(ingest): refactor mce comparison and add pytest update golden files option (#2812)
|
2021-06-30 16:53:20 -07:00 |
|
Kevin Hu
|
22a2ed81e4
|
feat(ingest): ingest last-modified from dbt sources.json (#2729)
|
2021-06-23 13:56:20 -07:00 |
|
Gary Lucas
|
af4f3b9683
|
fix(dbt): set target platform and load schema (#2483)
|
2021-05-17 12:22:52 -07:00 |
|
Harshal Sheth
|
a11329d5b8
|
refactor(ingest): update test harness to use a compose file per test (#2392)
|
2021-04-13 17:30:24 -07:00 |
|
Harshal Sheth
|
a921d0deae
|
feat(ingest): MongoDB ingestion source (#2289)
|
2021-03-23 20:15:44 -07:00 |
|
Gary Lucas
|
922307f8ec
|
feat(ingest): Add DBT source to metadata-ingestion (#2247)
|
2021-03-22 23:11:29 -07:00 |
|