sid-acryl
|
9eefedfdc0
|
fix(ingest/dbt): fix dbt catalog version check (#11350)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
|
2024-09-19 22:42:27 -07:00 |
|
Harshal Sheth
|
aec5e1b249
|
fix(ingest/dbt): handle null index values (#11433)
|
2024-09-19 16:05:44 -07:00 |
|
Harshal Sheth
|
7713ea56dd
|
feat(ingest): add get_entity_as_mcps method to client (#11425)
|
2024-09-19 08:22:50 -07:00 |
|
Andrew Sikowitz
|
3e3a05f09c
|
test(ingest/mcp_diff): Fallback to overwriting file on more complicated diffs (#11407)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
|
2024-09-18 16:40:08 -07:00 |
|
Tamas Nemeth
|
dea2ef00c4
|
feat(ingest/gc): Add dry run mode to gc recipe (#11413)
|
2024-09-18 13:43:22 +02:00 |
|
Sergio Gómez Villamor
|
31edb46dbc
|
feat(ingestion): adds env property in ContainerProperties (#11214)
Co-authored-by: siladitya2 <siladitya2@gmail.com>
|
2024-09-18 14:56:52 +05:30 |
|
Tamas Nemeth
|
e7a3890943
|
feat(ingest/gc): Add dataflow and soft deleted entities cleanup (#11102)
|
2024-09-18 10:01:16 +02:00 |
|
Gabe Lyons
|
7ab212dce5
|
fix(docs): Fix typo in bigquery permissions error (#11401)
|
2024-09-17 15:07:08 -07:00 |
|
Harshal Sheth
|
1d83131601
|
fix(ingest/airflow): simplify env configuration (#11371)
|
2024-09-17 12:54:03 -07:00 |
|
Harshal Sheth
|
eb36a68173
|
fix(ingest): override setdefault in file-backed dict (#11359)
|
2024-09-17 09:32:41 -07:00 |
|
Harshal Sheth
|
38bcd9c381
|
feat(ingest): default to ASYNC_BATCH mode in datahub-rest sink (#11369)
|
2024-09-17 07:11:58 +01:00 |
|
Alisa Aylward
|
adc6b90363
|
fix(ingest/snowflake): Update snowflake_utils.py to account for iceberg tables (#11384)
|
2024-09-16 18:19:56 -07:00 |
|
Harshal Sheth
|
49a51be7aa
|
feat(ingest): report ingest run for sample data (#11329)
|
2024-09-16 14:56:10 -07:00 |
|
Aseem Bansal
|
d82e4782c2
|
fix(ingest/nifi): add error handling for version (#11385)
|
2024-09-16 10:15:53 -07:00 |
|
Harshal Sheth
|
b35e3db0b1
|
feat(ingest/dbt): add only_include_if_in_catalog flag for dbt core (#11314)
|
2024-09-13 15:20:00 -07:00 |
|
Harshal Sheth
|
2a0d14e2f5
|
feat(ingest): make default rest sink mode env-configurable (#11335)
|
2024-09-12 14:26:46 -07:00 |
|
Harshal Sheth
|
3755731f0e
|
chore(ingest): improve code formatting (#11326)
|
2024-09-11 10:48:57 -07:00 |
|
sid-acryl
|
920a6ce9b1
|
fix(ingest/databricks): use latest report message format for warning messages (#11319)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
|
2024-09-11 10:48:21 -07:00 |
|
Mayuri Nehate
|
325a608cc5
|
fix(ingest): followup on bigquery queries v2 ordering (#11353)
|
2024-09-11 10:47:21 -07:00 |
|
Harshal Sheth
|
311ea10833
|
feat(ingest): maintain ordering in file-backed dict (#11346)
|
2024-09-10 13:53:38 -07:00 |
|
Ellie O'Neil
|
80970b17b6
|
docs(data product): Update example and docs (#11032)
|
2024-09-10 15:52:15 -05:00 |
|
Mayuri Nehate
|
837d00d391
|
fix(ingest/bq): fix ordering of queries for use_queries_v2 (#11333)
|
2024-09-10 12:17:23 -07:00 |
|
sagar-salvi-apptware
|
852a23b845
|
feat(mode/ingest): Add support for missing Mode datasets in lineage (#11290)
|
2024-09-10 10:24:55 -07:00 |
|
Harshal Sheth
|
f082287a07
|
docs(ingest/dbt): add docs on hiding sources (#11334)
|
2024-09-10 10:13:25 -07:00 |
|
Harshal Sheth
|
f4033707d4
|
chore(ingest): bump acryl-sqlglot (#11331)
|
2024-09-09 21:09:44 -07:00 |
|
Harshal Sheth
|
0d4eda6115
|
fix(ingest): avoid sqlite "too many SQL variables" error (#11332)
|
2024-09-09 20:16:24 -07:00 |
|
Mayuri Nehate
|
cf49f80e77
|
feat(ingest/sql): auto extract and use mode query user metadata (#11307)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
|
2024-09-09 12:38:24 -07:00 |
|
Harshal Sheth
|
28310bb64b
|
feat(ingest): support full urns without owner_type in meta mapping (#11298)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
|
2024-09-09 11:18:07 -07:00 |
|
Harshal Sheth
|
55a56be6b0
|
fix(ingest): disable reporting for dry-run pipelines (#11306)
|
2024-09-09 11:16:56 -07:00 |
|
sid-acryl
|
3150d90bd1
|
fix(ingestion/tableau): restructure the tableau graphql datasource query (#11230)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
|
2024-09-09 10:45:06 -07:00 |
|
Harshal Sheth
|
5467481f16
|
fix(py): fix issues with AvroException (#11311)
|
2024-09-09 09:02:05 +02:00 |
|
Harshal Sheth
|
9b64b117c7
|
docs(ingest/dbt): clarify dbt ingestion docs (#11312)
|
2024-09-09 09:01:46 +02:00 |
|
Harshal Sheth
|
d0bad4a7ee
|
feat(ingest): make rest emitter version error messages more clear (#11295)
|
2024-09-08 11:07:18 -07:00 |
|
Harshal Sheth
|
607ad5e1bc
|
feat(cli): reject missing urns in datahub get (#11313)
|
2024-09-06 15:32:25 -07:00 |
|
Harshal Sheth
|
9589adebb3
|
feat(ingest): enable query usage stats by default (#11281)
|
2024-09-06 10:02:40 -07:00 |
|
Rohan Sunkari
|
c3a7850a11
|
feat(ingest/sql): add default dialect support to SqlQueriesSource (#11285)
|
2024-09-05 13:26:11 -07:00 |
|
Mayuri Nehate
|
d788cd753c
|
feat(ingest/salesforce): helpful error messages on failure (#11266)
|
2024-09-05 09:47:26 -07:00 |
|
Tamas Nemeth
|
9c7f62a779
|
feat(ingest/athena): Add option to disable partition extraction (#11286)
|
2024-09-04 15:01:03 -07:00 |
|
david-leifker
|
ede9520b87
|
feat(schemaField): populate schemaFields with side effects (#10928)
|
2024-09-04 15:36:12 -05:00 |
|
Harshal Sheth
|
401b787427
|
fix(ingest): add custom StrEnum type (#11270)
|
2024-09-04 08:09:36 -07:00 |
|
Mayuri Nehate
|
08a5956e26
|
fix(bigquery): followups on bigquery queries v2 integration (#11291)
|
2024-09-04 07:42:35 -07:00 |
|
sleeperdeep
|
e34a628afe
|
fix(ingest/mssql): remove lower() method from sql_common get_db_name (#10773)
|
2024-09-03 12:41:23 -07:00 |
|
Harshal Sheth
|
96b075d79f
|
feat(ingest): add python deps for apk (#11188)
|
2024-09-03 10:53:44 -07:00 |
|
Mayuri Nehate
|
1f3688a1ed
|
feat(ingest/databricks): include metadata for browse only tables (#10766)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
|
2024-09-02 19:09:45 +05:30 |
|
Mayuri Nehate
|
a7fc7f519a
|
feat(ingest/bq): integrate bigquery-queries into main source (#11247)
|
2024-08-30 18:16:45 -07:00 |
|
matthew-coudert-cko
|
c513e17dbb
|
feat(ingest/fivetran): support filtering on destination ids (#11277)
|
2024-08-30 13:25:18 -07:00 |
|
Mayuri Nehate
|
3e5c18f5d2
|
fix(ingest): limit number of upstreams generated by sql parsing aggre… (#11267)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
|
2024-08-30 13:20:18 -07:00 |
|
Andrew Sikowitz
|
fa1164aa63
|
feat(ingest/s3): Support reading S3 file type (#11177)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
|
2024-08-30 12:15:12 +02:00 |
|
Alisa Aylward
|
675b225c5b
|
feat(ingest/snowflake): Add cluster formula to dataset properties (#11254)
|
2024-08-29 16:11:35 -07:00 |
|
dushayntAW
|
6204cba2bb
|
fix(ingestion/prefect-plugin): Prefect plugin (#10643)
Co-authored-by: shubhamjagtap639 <shubham.jagtap@gslab.com>
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
|
2024-08-29 15:40:10 +02:00 |
|