15 Commits

Author SHA1 Message Date
Hyejin Yoon
f986315582
doc: Acryl to DataHub, datahubproject.io to datahub.com (#13252)
Co-authored-by: Jay <159848059+jayacryl@users.noreply.github.com>
2025-04-28 10:34:33 -04:00
Andrew Sikowitz
d138a64a6a
ci(graphql,workflows): Format .md, .graphql, and workflow .yml files via prettier (#13220) 2025-04-16 16:55:51 -07:00
Tamas Nemeth
250b100a93
doc(ingestion/s3): Document permissions requirements for s3 source (#12816)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2025-04-04 18:28:42 +02:00
Tamas Nemeth
ef6a410091
feat(ingest/s3): Partition support improvements (#11083)
- Partition autodetection
- Option to find min/max/min-max partition of a dataset
- Generating Partition aspects
2024-08-22 17:55:43 +02:00
Joel Pinto Mata (KPN-DSH-DEX team)
13b6febce9
feat(ingest/abs): Adding azure blob storage ingestion source (#10813) 2024-07-17 11:06:05 +02:00
Andrew Sikowitz
46dbb10940
docs(ingest): Rename csv / s3 / file source and sink (#10675) 2024-06-11 11:44:13 -07:00
Aditya Malik
92b1cfa194
feat(ingest): Support for JSONL in s3 source with max_rows support (#9921)
Co-authored-by: Aditya <aditya.malik@quillbot.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-02-28 15:05:30 +01:00
Hyejin Yoon
31abf383d1
ci: add markdown-link-check (#8771) 2023-09-14 11:34:21 +09:00
Tamas Nemeth
d86b336e70
chore(ingest/s3) Bump Deequ and Pyspark version (#8638)
Co-authored-by: Andrew Sikowitz <andrew.sikowitz@acryl.io>
2023-08-29 18:11:37 +02:00
Mayuri Nehate
7bb4e7b90d
docs(ingest): update s3 and gcs doc with concept mapping (#8575) 2023-08-11 11:01:15 -07:00
Mayuri Nehate
dc8b9d3c4d
docs(ingest): add path spec examples for s3 (#6050) 2022-09-26 18:06:54 -07:00
Harshal Sheth
bee27e8468
fix(ingest): use AwsConnectionConfig instead of AwsSourceConfig (#5813) 2022-09-05 21:10:33 -07:00
Mugdha Hardikar
a449e8ba7d
feat(mssql): add multi database ingest support (#5516)
* feat(mssql): add multi database ingest support

* Delete older golden file.

* Update s3.md

* fix test setup
2022-08-15 21:37:47 -07:00
Tamas Nemeth
56ee4d9651
feat(ingest): s3 - add support for multiple pathspecs in one recipe (#4777) 2022-05-05 10:09:47 -07:00
Shirshanka Das
a9ad138172
feat(ingest): docs - overhaul source connector docs to make it code driven (#4798)
Co-authored-by: MugdhaHardikar-GSLab <mugdha.hardikar@gslab.com>
2022-05-02 00:18:15 -07:00