Austin SeungJun Park
|
41895fe24f
|
feat(ingest/s3): add table filtering (#12661)
|
2025-03-20 07:57:43 +01:00 |
|
Andrew Sikowitz
|
fa1164aa63
|
feat(ingest/s3): Support reading S3 file type (#11177)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
|
2024-08-30 12:15:12 +02:00 |
|
Tamas Nemeth
|
ef6a410091
|
feat(ingest/s3): Partition support improvements (#11083)
- Partition autodetection
- Option to find min/max/min-max partition of a dataset
- Generating Partition aspects
|
2024-08-22 17:55:43 +02:00 |
|
Tamas Nemeth
|
bdd4bc7b92
|
feat(ingest/s3) - Stateful ingestion and last-updated support (#8022)
|
2023-05-19 13:10:15 +02:00 |
|
Harsha Mandadi
|
bf36c935fa
|
feat(ingest/s3): support path_specs of different S3 buckets in the same recipe (#7514)
|
2023-03-14 21:55:57 -07:00 |
|
nachiket-juneja
|
e07cd2090b
|
Feat/s3 ingestion enhancement to update schema from latest partition (#7410)
Co-authored-by: Prashant Singh Thakur <prashant.thakur@nucleusteq.com>
|
2023-02-28 08:58:28 +01:00 |
|
Harshal Sheth
|
3c0f63c50a
|
fix(ingest): hide deprecated path_spec option from config (#5944)
|
2022-10-04 12:14:00 -07:00 |
|
Tamas Nemeth
|
56ee4d9651
|
feat(ingest): s3 - add support for multiple pathspecs in one recipe (#4777)
|
2022-05-05 10:09:47 -07:00 |
|
Jordan Wolinsky
|
bbac4a7a11
|
feat(ingestion): glue/s3 - Ingest Tags from s3 bucket on an AWS Glue job and S3 Data Lake Ingest Job (#4689)
|
2022-04-29 10:09:06 +02:00 |
|
MugdhaHardikar-GSLab
|
37aedfc87c
|
feat(s3): add s3 source (#4490)
* feat(data-lake): add containers and folder level dataset support
* docs(data-lake): Update readme for data lake
* doc(data-lake): fix examples, update doc
* lint fix
* feat(s3): add s3 source, restore old data-lake source
Co-authored-by: Mayuri N <mayuri.nehate@gslab.com>
|
2022-03-29 11:52:57 +02:00 |
|