Harshal Sheth
|
8c21b178df
|
feat(ingest): support incremental column-level lineage (#10090)
|
2024-03-21 09:18:12 +01:00 |
|
siladitya
|
43ac405c57
|
fix(metadata-ingestion)glue connector failure when Optional field Type of PartitionKey is absent for a Table (#10052)
|
2024-03-20 11:02:28 +01:00 |
|
Harshal Sheth
|
630f2a13f6
|
feat(ingest): check for private import path usages (#10059)
|
2024-03-18 14:59:18 -07:00 |
|
Harshal Sheth
|
d4d175da1a
|
fix(ingest/redshift): tweak lineage v2 queries (#10045)
|
2024-03-15 12:16:18 -07:00 |
|
Harshal Sheth
|
b0163c4885
|
feat(ingest): utilities for query logs (#10036)
|
2024-03-12 23:20:46 -07:00 |
|
Tamas Nemeth
|
4535f2adfd
|
fix(ingest/redshift): Temp table lineage fix (#10008)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
|
2024-03-12 14:31:00 -07:00 |
|
Harshal Sheth
|
7e2076e852
|
feat(ingest): add query formatting to sql aggregator (#10025)
|
2024-03-11 15:34:44 -07:00 |
|
Harshal Sheth
|
92a3ac6f11
|
fix(ingest): use contextvar for cooperative timeout (#10021)
|
2024-03-11 14:14:39 -07:00 |
|
ethan-cartwright
|
7540e642a5
|
fix(ingest/redshift): patch instead of replace redshift custom properties (#9293)
Co-authored-by: Ethan Cartwright <ethan.cartwright@acryl.io>
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
|
2024-03-11 11:16:44 -07:00 |
|
Harshal Sheth
|
b6956f9a5c
|
feat(ingest): update sqlglot fork (#10022)
|
2024-03-11 15:22:30 +01:00 |
|
Mayuri Nehate
|
8047d0b514
|
feat(ingest/snowflake): generate query nodes for snowflake (#9966)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
|
2024-03-06 15:11:37 -08:00 |
|
Shubham Jagtap
|
fda5eb89f7
|
feat(ingest): enable stateful_ingestion by default for DataHub rest sink (#9934)
|
2024-03-05 11:18:03 -08:00 |
|
AvaniSiddhapuraAPT
|
782d33db99
|
fix(ingest/bigquery): escape special characters for table descriptions (#9932)
|
2024-03-05 21:00:09 +05:30 |
|
AvaniSiddhapuraAPT
|
1b4f31bcfe
|
fix(ingest/json-schema): adding support descriptions for array (#9757)
|
2024-03-01 13:03:47 -08:00 |
|
david-leifker
|
ed10a8d8cc
|
feat(search): search access controls (#9892)
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
|
2024-02-28 16:57:26 -06:00 |
|
Harshal Sheth
|
1736edf8f5
|
feat(ingest): fix bugs in SqlParsingAggregator (#9926)
|
2024-02-28 15:06:33 +01:00 |
|
Aditya Malik
|
92b1cfa194
|
feat(ingest): Support for JSONL in s3 source with max_rows support (#9921)
Co-authored-by: Aditya <aditya.malik@quillbot.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
|
2024-02-28 15:05:30 +01:00 |
|
RyanHolstien
|
ddf0b7d2cd
|
feat(patch): refactor cll patch (#9922)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
|
2024-02-27 12:00:44 -06:00 |
|
Aseem Bansal
|
336d0543c1
|
feat(ingest/csv-enricher): add support for ownership type urn (#9935)
|
2024-02-27 17:47:04 +00:00 |
|
Tamas Nemeth
|
d2d9661a1e
|
fix(ingest/patch): Adding proper json patch path quoting (#9872)
|
2024-02-26 18:46:21 -08:00 |
|
Harshal Sheth
|
392158809d
|
feat(ingest/redshift): redshift lineage v2 (#9904)
|
2024-02-23 16:32:51 -08:00 |
|
Harshal Sheth
|
b01416c11b
|
feat(ingest): add timeout to sqlglot parser (#9868)
|
2024-02-23 11:11:02 -08:00 |
|
Harshal Sheth
|
ef3a8148ec
|
fix(ingest): bump sqlglot + add some debug info to tests (#9867)
|
2024-02-21 13:07:59 -08:00 |
|
Harshal Sheth
|
b15b352a00
|
fix(ingest): better logging line attribution (#9876)
|
2024-02-21 11:37:57 -08:00 |
|
Harshal Sheth
|
f13ae77966
|
feat(ingest): add escape hatch methods to SqlParsingAggregator (#9860)
|
2024-02-21 11:33:05 -08:00 |
|
Harshal Sheth
|
24da7a573b
|
test(ingest): use pytest-random-order for unit tests (#9753)
|
2024-02-09 18:20:05 -05:00 |
|
Harshal Sheth
|
0d780e5f8f
|
feat(ingest): sql parsing aggregator (#9786)
|
2024-02-09 16:27:45 -05:00 |
|
Harshal Sheth
|
f8f1af2735
|
feat(ingest/dbt): speed up test result only ingestion (#9791)
|
2024-02-08 23:17:32 +01:00 |
|
skrydal
|
bf1ce96ae6
|
feat(cli): Add support for custom ownership types to dataproduct CLI (#9762)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
|
2024-02-05 08:29:14 -08:00 |
|
Andrea Scarpino
|
f743d3c044
|
feat(ingest/metabase): Allow to configure a different url for links (#9727)
|
2024-02-05 17:36:50 +05:30 |
|
sid-acryl
|
533130408a
|
feat(ingestion/redshift): collapse lineage to permanent table (#9704)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
Co-authored-by: treff7es <treff7es@gmail.com>
|
2024-02-01 12:47:09 -08:00 |
|
sid-acryl
|
874c683f2a
|
fix(ingest/transformer): generate ownership aspect from handle_end_of_stream (#9720)
|
2024-01-31 14:25:08 -08:00 |
|
sid-acryl
|
ad2df22d78
|
feat(ingestion/dbt): multiple node owner separated by comma (#9740)
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
|
2024-01-31 16:38:26 +01:00 |
|
Aseem Bansal
|
3f9490d901
|
feat(cli): option to init via username password, add lint for smoke-test (#9675)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
|
2024-01-31 14:42:40 +05:30 |
|
Harshal Sheth
|
1498c36875
|
chore(cli): drop support for python 3.7 (#9731)
|
2024-01-29 10:50:47 -08:00 |
|
Tamas Nemeth
|
90c88082b1
|
fix(ingest/s3): Not sorting schema fields to keep original order (#9349)
|
2024-01-29 14:14:34 +01:00 |
|
Shubham Jagtap
|
f83a2fab44
|
fix(ingestion/bigquery): Table-view-snapshot Lineage Bug fix (#9579)
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
|
2024-01-25 18:48:41 +05:30 |
|
Harshal Sheth
|
9b051e38d6
|
feat(ingest/dbt): support aws config without region (#9650)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
|
2024-01-24 14:29:41 -08:00 |
|
Aseem Bansal
|
c4dec931a3
|
feat(ingest): handling for const in json schema (#9694)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
|
2024-01-24 06:44:14 +00:00 |
|
Harshal Sheth
|
19b76c3307
|
feat(ingest/sql-parser): test redshift temp tables (#9653)
|
2024-01-23 08:37:53 +01:00 |
|
Harshal Sheth
|
f14dc4ded2
|
feat(ingest): improve sql tests + dbt reporting (#9649)
|
2024-01-23 08:37:23 +01:00 |
|
Mayuri Nehate
|
f2e78db92e
|
feat(ingest/databricks): ingest hive metastore by default, more docs (#9601)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
|
2024-01-18 14:26:33 -08:00 |
|
ethan-cartwright
|
dfb2f7e596
|
feat(classifier): Add support for excluding list of exact column names (#9472)
Co-authored-by: Ethan Cartwright <ethan.cartwright@acryl.io>
|
2024-01-16 19:12:23 -08:00 |
|
Tamas Nemeth
|
757eeecc14
|
feat(ingest/dbt-cloud): Add way to customize dbt cloud access endpoint (#9633)
Co-authored-by: Andrew Sikowitz <andrew.sikowitz@acryl.io>
|
2024-01-16 16:59:56 -08:00 |
|
Harshal Sheth
|
98e3da42f5
|
feat(ingest/looker): add backpressure-aware executor (#9615)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
|
2024-01-12 18:54:08 +01:00 |
|
Mayuri Nehate
|
b0426ae94b
|
fix(ingest/nifi): make s3 dataset urn consistent with s3 source (#9599)
|
2024-01-12 11:07:53 +05:30 |
|
Harshal Sheth
|
f05056aed7
|
feat(ingest): key-partitioning for rest emitter (#9613)
|
2024-01-11 17:57:48 -05:00 |
|
Shubham Jagtap
|
cb8002413e
|
feat(ingestion/transformer): Add dataset dataproduct transformer (#9491)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
|
2024-01-05 17:03:22 -05:00 |
|
RyanHolstien
|
822d0eb014
|
feat(patch): add dashboardInfo and chartInfo support for patch (#9536)
|
2024-01-03 15:11:07 -06:00 |
|
Aseem Bansal
|
06bd9b988d
|
fix(cli): upsert for data product external url (#9534)
|
2023-12-29 21:34:06 +05:30 |
|