cragwolfe 87fd0d01dc

feat: Ingest refactors, doc updates (#243) ...

- Creates ABC's for ingest connectors
- Updates the s3_connector classes to inherit from ABC's
- Moves s3 test script to it's own file to establish pattern for additional connectors
- Rewrites the Ingest.md doc, including instructions how how to add a connector
- Updates the example s3 ingest script to use the new location for main.py

Note that there were no logic changes, this is essentially a refactoring PR.

Test instructions:

Run ./test_unstructured_ingest/test-ingest.sh and ./examples/ingest/s3-small-batch/ingest.sh.

2023-02-21 10:15:33 -08:00

..

ingest.sh

feat: Ingest refactors, doc updates (#243)

2023-02-21 10:15:33 -08:00