6 Commits

Author	SHA1	Message	Date
Austin SeungJun Park	41895fe24f	feat(ingest/s3): add table filtering (#12661)	2025-03-20 07:57:43 +01:00
Austin SeungJun Park	5ed4b5bce9	feat(ingest/s3): ignore depth mismatched path (#12326)	2025-02-05 11:19:44 -08:00
Aditya Malik	92b1cfa194	feat(ingest): Support for JSONL in s3 source with max_rows support (#9921) ... Co-authored-by: Aditya <aditya.malik@quillbot.com> Co-authored-by: Harshal Sheth <hsheth2@gmail.com>	2024-02-28 15:05:30 +01:00
Tamas Nemeth	90c88082b1	fix(ingest/s3): Not sorting schema fields to keep original order (#9349)	2024-01-29 14:14:34 +01:00
Andrew Sikowitz	8a80e858a7	build(ingest): Bump avro pin: security vulnerability (#9042)	2023-10-25 13:06:12 -04:00
Kevin Hu	02fe05eb8f	feat(ingest): data-lake - remove spark requirement if not profiling (#4131)	2022-02-24 23:26:06 -08:00