Harshal Sheth
|
71ecbd6060
|
fix(ingest/dbt): ensure dbt shows view properties (#7872)
|
2023-04-25 12:25:07 -07:00 |
|
Tamas Nemeth
|
0cc12bcce7
|
feat(ingest): redshift - Redshift rework (#6906)
|
2023-04-12 19:15:43 +02:00 |
|
Harshal Sheth
|
8d99babf75
|
feat(ingest/dbt): update subtypes for dbt (#7750)
|
2023-04-04 17:11:23 -07:00 |
|
Harshal Sheth
|
1634edaf25
|
feat(ingest/dbt): include dbt unique_id in properties (#7737)
|
2023-04-04 13:37:13 +05:30 |
|
Harshal Sheth
|
b2689b7514
|
test(ingest/dbt): add test for column meta match (#7673)
|
2023-03-28 21:51:31 +05:30 |
|
Harshal Sheth
|
c8abf9a1d4
|
fix(ingest/dbt): enable incremental lineage by default (#7674)
|
2023-03-24 18:14:19 -04:00 |
|
Harshal Sheth
|
cbd8e14b78
|
feat(ingest): add auto_materialize_referenced_tags helper (#7626)
|
2023-03-20 16:34:22 -07:00 |
|
Harshal Sheth
|
670342ab64
|
feat(ingest): switch dbt to use auto_stale_entity_removal (#7160)
|
2023-01-30 19:59:20 -08:00 |
|
Harshal Sheth
|
fc41f455a0
|
feat(ingest): support snapshots in dbt and dbt-cloud (#7062)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
|
2023-01-18 08:35:03 -08:00 |
|
Harshal Sheth
|
47be95689e
|
refactor(ingest/stateful): remove most remaining state classes (#6791)
|
2022-12-19 13:40:48 -05:00 |
|
Tamas Nemeth
|
e41b455e14
|
fix(ingest): bigquery - sharded table support improvements (#6789)
|
2022-12-19 18:57:37 +01:00 |
|
Harshal Sheth
|
2f95719dba
|
feat(ingest): remove source config from DatahubIngestionCheckpoint (#6722)
|
2022-12-14 12:39:21 -05:00 |
|
Harshal Sheth
|
cf3db168ac
|
feat(ingest): start simplifying stateful ingestion state (#6740)
|
2022-12-13 10:05:57 +01:00 |
|
Matthieu Blais
|
4e2dde84f6
|
feat(ingest/dbt): add support for latest DBT version 1.3 (#6651)
Co-authored-by: Matthieu Blais <matthieu.blais@tech.jago.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
|
2022-12-06 19:03:24 -05:00 |
|
Harshal Sheth
|
05a0f3e2a6
|
feat(ingest): dbt cloud integration (#6323)
|
2022-11-21 14:14:33 -05:00 |
|
Harshal Sheth
|
d3174e75b7
|
fix(ingest): dbt - disable incremental lineage by default (#6467)
|
2022-11-17 09:41:43 +01:00 |
|
Mayuri Nehate
|
198c86a620
|
feat(ingest): support incremental lineage to dbt node from external platform (#6392)
|
2022-11-14 13:16:38 -05:00 |
|
Ravindra Lanka
|
b8941ab190
|
feat(ingestion): Add fail-safe stale entity removal via configurable 'fail_safe_threshold' param. (#6027)
|
2022-09-22 16:09:22 -07:00 |
|
Harshal Sheth
|
8ffa7054e5
|
feat(ingest): dbt column-level meta mappings + add_terms operation (#5970)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
|
2022-09-19 15:26:12 -07:00 |
|
Harshal Sheth
|
c8cd7d5040
|
refactor(ingest): use typed objects in dbt ingestion (#5929)
|
2022-09-16 15:07:59 -07:00 |
|
Ravindra Lanka
|
ee68f09624
|
feat(ingestion): Refactor standard state-handling tasks into a common handler that are common across all stateful ingestion sources. (#5766)
|
2022-09-14 09:30:42 -07:00 |
|
Harshal Sheth
|
3cd8ea8316
|
test(ingest): use pytest parameterization for dbt integration tests (#5879)
|
2022-09-10 18:35:58 -07:00 |
|
Harshal Sheth
|
954397a078
|
fix(ingest): remove dbt disable_dbt_node_creation and load_schema options (#5877)
|
2022-09-09 14:07:55 -07:00 |
|
Marcin Szymański
|
57996049fb
|
fix(ingest): sql - add missing trino types (#5870)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
|
2022-09-09 14:07:00 -07:00 |
|
Harshal Sheth
|
2115d5bf1d
|
fix(ingest): remove dbt delete_tests_as_datasets option (#5865)
This option was added for backwards compat and can be dropped now.
|
2022-09-08 11:22:25 -07:00 |
|
Ravindra Lanka
|
228f3b50ea
|
feat(ingestion): send reports of ingestion runs to datahub (#5639)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
|
2022-08-19 09:08:17 -07:00 |
|
Piotr Sierkin
|
828a711684
|
feat(ingest): dbt - control over emitting test_results, test_definitions, etc. (#5328)
Co-authored-by: Piotr Sierkin <piotr.sierkin@getindata.com>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
|
2022-08-06 21:42:53 -07:00 |
|
Marcin Szymański
|
fa42b59d9f
|
fix(ingestion): correct trino datatype handling (#5541)
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
|
2022-08-03 20:55:14 -07:00 |
|
mohdsiddique
|
f1abdc91ee
|
fix(dbt): fix issue of assertion error when stateful ingestion is used with dbt tests (#5540)
* fix(dbt): fix issue of dbt stateful ingestion with tests
Co-authored-by: MugdhaHardikar-GSLab <mugdha.hardikar@gslab.com>
Co-authored-by: MohdSiddique Bagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
|
2022-08-03 13:22:04 -07:00 |
|
Aezo
|
85a55ffac7
|
fix(ingest): dbt - add support for trino datatypes (#5379)
|
2022-07-26 17:02:00 -07:00 |
|
Gabe Lyons
|
efc5602493
|
feat(ingest): dbt - updating source lineage logic (#5414)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
|
2022-07-24 23:55:01 -07:00 |
|
Shirshanka Das
|
4b3135a0f8
|
feat(ingest): dbt - improving dbt_meta mapping (#5237)
|
2022-06-24 13:43:12 +02:00 |
|
Piotr Sierkin
|
9f2b3b9ba6
|
fix(ingest): dbt - make assertion display names consistent (#5214)
Co-authored-by: Piotr Sierkin <piotr.sierkin@getindata.com>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
|
2022-06-22 22:07:00 -07:00 |
|
Shirshanka Das
|
0ee2569d5c
|
feat(ingest): dbt - adding support for dbt tests (#5201)
|
2022-06-18 13:30:04 -07:00 |
|
skrydal
|
503208beaa
|
feat(ingest): dbt - add platform instance for target platform (#5129)
|
2022-06-12 09:29:44 -07:00 |
|
Gabe Lyons
|
538cfba526
|
fix(ingest): dbt - ensure platform_instance filled out only for dbt nodes (#5115)
|
2022-06-07 20:09:42 -07:00 |
|
Gabe Lyons
|
e607410a40
|
dont set platform instances for sources (#5028)
|
2022-05-27 10:57:27 -07:00 |
|
Gabe Lyons
|
7b1cf6f8b2
|
feat(dbt): enable data platform instance on dbt (#4926)
|
2022-05-17 16:53:16 -07:00 |
|
Tamas Nemeth
|
474b0ba61e
|
feat(ingest): dbt - add query tag mapping and match template (#4744)
|
2022-04-25 10:56:45 -07:00 |
|
Arun Vasudevan
|
5aa3da5c9c
|
feat(ingestion) dbt: Fixing issue with strip_user_ids_from_email and adding owner_extraction_pattern (#4587)
* Fixing issue with strip_user_ids_from_email and adding owner_extraction_pattern
Co-authored-by: BZ <93607724+BoyuanZhangDE@users.noreply.github.com>
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
|
2022-04-13 16:58:36 -07:00 |
|
mohdsiddique
|
57002c766d
|
feat(stateful dbt): add stateful ingestion capability in dbt source (#4456)
* feat(stateful dbt): add stateful ingestion capability in dbt source
Co-authored-by: MohdSiddiqueBagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
|
2022-03-30 18:09:02 -07:00 |
|
Shirshanka Das
|
a69eac8247
|
feat(ingest): dbt,looker,sql_common,kafka - moving sources to produce display names and subtypes more consistently (#4496)
|
2022-03-27 18:49:26 -05:00 |
|
Gabe Lyons
|
a9c1b7e6a3
|
fix(ingest): dbt - dont produce key aspects if the entity has no other aspects (#4217)
|
2022-02-22 16:02:58 -08:00 |
|
Swaroop Jagadish
|
7d986ec880
|
fix(ingest): populate system metadata for all metadata events (mcp, mcpw) (#3900)
|
2022-01-16 12:03:38 -08:00 |
|
Swaroop Jagadish
|
480ad24282
|
feat(ingest): dbt - add support for dbt meta mapping (#3832)
|
2022-01-05 16:32:05 -08:00 |
|
Sergio Gómez Villamor
|
c59c63e90d
|
feat: enables dbt metadata files to be loaded from URIs (#3739)
|
2021-12-15 09:11:39 -08:00 |
|
Remi
|
a9754ebe83
|
fix(ingest): fix dbt source platform when disable_dbt_node_creation is False (#3592)
|
2021-11-17 16:49:48 -08:00 |
|
varunbharill
|
417b555fef
|
feat(dbt): dbt enhancements - dbt nodes, lineage, subtype, etc. (#3519)
|
2021-11-05 09:27:41 -07:00 |
|
AndreasTA-AW
|
561c04bcf8
|
feat(dbt-ingestion): add ability to skip specific models (#3340)
|
2021-10-25 22:31:19 -07:00 |
|
AndreasTA-AW
|
61ba3cf578
|
feat(ingest): added tags and owner from dbt (#3270)
Co-authored-by: Andreas Törnström Andersson <andreas.tornstrom-andersson@forefront.se>
|
2021-10-05 07:31:58 -07:00 |
|