Sergio Gómez Villamor
|
8cae980286
|
tests(ingestion): moving some tests so they are available for sdk users (#13540)
|
2025-05-19 08:39:53 +02:00 |
|
Mayuri Nehate
|
a3a1f50886
|
fix(ingest/dbt): consider dbt run results with success status (#12942)
|
2025-03-24 15:09:48 +05:30 |
|
Harshal Sheth
|
d0423547ba
|
feat(ingest): add parse_ts_millis helper (#12231)
|
2024-12-27 10:50:28 -08:00 |
|
Harshal Sheth
|
189f8cefa7
|
feat(ingest): standardize sql type mappings (#11982)
|
2024-11-28 14:53:46 -05:00 |
|
Jonny Dixon
|
a8e6a06ea4
|
docs(ingest/dbt): update run result paths examples (#11138)
|
2024-09-27 10:11:06 -07:00 |
|
Harshal Sheth
|
d754650875
|
feat(ingest/dbt): produce multiple assertions for multi-table dbt tests (#11451)
|
2024-09-25 13:10:11 -07:00 |
|
Harshal Sheth
|
bb8cf97ea3
|
feat(ingest/dbt): skip CLL on sources with skip_sources_in_lineage (#11195)
|
2024-08-19 15:38:27 -07:00 |
|
Harshal Sheth
|
897173f270
|
feat(dbt): support prefer_sql_parser_lineage with sources enabled (#11168)
|
2024-08-13 13:54:50 -07:00 |
|
Harshal Sheth
|
4b9844da1b
|
feat(ingest/dbt): add experimental prefer_sql_parser_lineage flag (#11039)
|
2024-07-31 09:23:02 -07:00 |
|
Harshal Sheth
|
fa2ab1bcee
|
fix(ingest): add status aspect to dataProcessInstance (#10757)
|
2024-06-27 12:07:28 -07:00 |
|
Harshal Sheth
|
3a72d92493
|
feat(ingest/dbt): include package_name in dbt custom props (#10652)
|
2024-06-12 15:07:42 +02:00 |
|
Harshal Sheth
|
db965d61ea
|
fix(ingest/dbt): only generate one subtype (#10615)
|
2024-05-29 17:11:34 -07:00 |
|
Harshal Sheth
|
37bc423b50
|
feat(ingest): enable stateful ingestion safety threshold (#10516)
|
2024-05-29 12:01:04 -07:00 |
|
Harshal Sheth
|
3d5735cbc5
|
chore(ingest): run pyupgrade for python 3.8 (#10513)
|
2024-05-15 22:31:05 -07:00 |
|
Harshal Sheth
|
7d31420b69
|
feat(ingest): materialize terms produced by ingestion (#10249)
|
2024-04-18 10:48:16 -07:00 |
|
Harshal Sheth
|
c9b9afc530
|
feat(ingest/dbt): enable model performance and compiled code by default (#10164)
|
2024-04-02 09:29:27 -05:00 |
|
Harshal Sheth
|
f0bdc24fc9
|
feat(ingest/dbt): dbt model performance (#9992)
|
2024-03-26 17:18:54 -07:00 |
|
Harshal Sheth
|
6c3834b38c
|
feat(ingest/dbt): add option to skip sources (#10077)
|
2024-03-21 09:10:24 +01:00 |
|
Harshal Sheth
|
1f9ce9d7d8
|
feat(ingest/dbt): point dbt assertions at dbt nodes (#10055)
|
2024-03-18 18:13:01 -07:00 |
|
Harshal Sheth
|
4155a621a6
|
feat(ingest/dbt): capture both raw and compiled code (#10026)
|
2024-03-12 12:54:03 -07:00 |
|
Harshal Sheth
|
4189ca9532
|
feat(ingest/dbt): generate CLL for all node types (#9964)
|
2024-03-05 10:07:03 -08:00 |
|
Tamas Nemeth
|
d2d9661a1e
|
fix(ingest/patch): Adding proper json patch path quoting (#9872)
|
2024-02-26 18:46:21 -08:00 |
|
Harshal Sheth
|
0d8568e087
|
fix(ingest): update dbt type inference (#9512)
|
2023-12-22 14:59:14 -05:00 |
|
Harshal Sheth
|
9d386fbd6f
|
feat(ingest): enable CLL for dbt by default (#9466)
|
2023-12-18 11:38:16 +01:00 |
|
Shubham Jagtap
|
1741c07d76
|
feat(ingestion): Add test_connection methods for important sources (#9334)
|
2023-12-14 12:31:51 -05:00 |
|
Harshal Sheth
|
19aa215068
|
feat(ingest/dbt): dbt column-level lineage (#8991)
|
2023-11-13 19:00:30 -05:00 |
|
Serhii Dimchenko
|
5b9fd977eb
|
fix(ingest/dbt-athena): dbt-athena types mapping for complex types (#8264)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
|
2023-06-22 11:40:27 +02:00 |
|
Serhii Dimchenko
|
6adb496581
|
feat: add dbt-athena adapter support for column types mapping (#8116)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
|
2023-05-27 09:22:55 -05:00 |
|
Harshal Sheth
|
e70d0b3859
|
fix(ingest/dbt): fix dbt subtypes for sources (#8048)
|
2023-05-16 11:11:26 -07:00 |
|
Harshal Sheth
|
71ecbd6060
|
fix(ingest/dbt): ensure dbt shows view properties (#7872)
|
2023-04-25 12:25:07 -07:00 |
|
Tamas Nemeth
|
0cc12bcce7
|
feat(ingest): redshift - Redshift rework (#6906)
|
2023-04-12 19:15:43 +02:00 |
|
Harshal Sheth
|
8d99babf75
|
feat(ingest/dbt): update subtypes for dbt (#7750)
|
2023-04-04 17:11:23 -07:00 |
|
Harshal Sheth
|
1634edaf25
|
feat(ingest/dbt): include dbt unique_id in properties (#7737)
|
2023-04-04 13:37:13 +05:30 |
|
Harshal Sheth
|
b2689b7514
|
test(ingest/dbt): add test for column meta match (#7673)
|
2023-03-28 21:51:31 +05:30 |
|
Harshal Sheth
|
c8abf9a1d4
|
fix(ingest/dbt): enable incremental lineage by default (#7674)
|
2023-03-24 18:14:19 -04:00 |
|
Harshal Sheth
|
cbd8e14b78
|
feat(ingest): add auto_materialize_referenced_tags helper (#7626)
|
2023-03-20 16:34:22 -07:00 |
|
Harshal Sheth
|
670342ab64
|
feat(ingest): switch dbt to use auto_stale_entity_removal (#7160)
|
2023-01-30 19:59:20 -08:00 |
|
Harshal Sheth
|
fc41f455a0
|
feat(ingest): support snapshots in dbt and dbt-cloud (#7062)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
|
2023-01-18 08:35:03 -08:00 |
|
Harshal Sheth
|
47be95689e
|
refactor(ingest/stateful): remove most remaining state classes (#6791)
|
2022-12-19 13:40:48 -05:00 |
|
Tamas Nemeth
|
e41b455e14
|
fix(ingest): bigquery - sharded table support improvements (#6789)
|
2022-12-19 18:57:37 +01:00 |
|
Harshal Sheth
|
2f95719dba
|
feat(ingest): remove source config from DatahubIngestionCheckpoint (#6722)
|
2022-12-14 12:39:21 -05:00 |
|
Harshal Sheth
|
cf3db168ac
|
feat(ingest): start simplifying stateful ingestion state (#6740)
|
2022-12-13 10:05:57 +01:00 |
|
Matthieu Blais
|
4e2dde84f6
|
feat(ingest/dbt): add support for latest DBT version 1.3 (#6651)
Co-authored-by: Matthieu Blais <matthieu.blais@tech.jago.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
|
2022-12-06 19:03:24 -05:00 |
|
Harshal Sheth
|
05a0f3e2a6
|
feat(ingest): dbt cloud integration (#6323)
|
2022-11-21 14:14:33 -05:00 |
|
Harshal Sheth
|
d3174e75b7
|
fix(ingest): dbt - disable incremental lineage by default (#6467)
|
2022-11-17 09:41:43 +01:00 |
|
Mayuri Nehate
|
198c86a620
|
feat(ingest): support incremental lineage to dbt node from external platform (#6392)
|
2022-11-14 13:16:38 -05:00 |
|
Ravindra Lanka
|
b8941ab190
|
feat(ingestion): Add fail-safe stale entity removal via configurable 'fail_safe_threshold' param. (#6027)
|
2022-09-22 16:09:22 -07:00 |
|
Harshal Sheth
|
8ffa7054e5
|
feat(ingest): dbt column-level meta mappings + add_terms operation (#5970)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
|
2022-09-19 15:26:12 -07:00 |
|
Harshal Sheth
|
c8cd7d5040
|
refactor(ingest): use typed objects in dbt ingestion (#5929)
|
2022-09-16 15:07:59 -07:00 |
|
Ravindra Lanka
|
ee68f09624
|
feat(ingestion): Refactor standard state-handling tasks into a common handler that are common across all stateful ingestion sources. (#5766)
|
2022-09-14 09:30:42 -07:00 |
|