Francisco J. Jurado Moreno
ae491f747f
[TASK-6295] Reduce memory footprint for S3 ingestion ( #6308 )
...
* Reduce memory footprint for parquet & CSV formats
* Add pagination, remove local var
* Add jsonl parser
2022-07-25 07:24:57 +02:00
Onkar Ravgan
8c9dc91ccf
Refactored Datalake and Deltalake for Topology ( #6034 )
...
* rebasing with main
* refactored deltalake for topology
* using requests instead of urllib
* formatting fixes
Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-07-19 06:37:27 +02:00
Mayur Singal
4b5b184177
Fix #6091 : Fix Datalake arrays must be of the same length ( #6092 )
2022-07-17 18:26:54 +02:00
Abhishek Pandey
e8975aac01
datalake-csv-files-ingestion-added ( #5343 )
...
datalake-csv-files-ingestion-added (#5343 )
2022-06-15 08:57:21 +02:00
