unstructured/docs/source/ingest/source_connectors.rst
John 3843af666e
feat: Enable remote chunking via unstructured-ingest (#2905)
Update: The cli shell script works when sending documents to the free
api, but the paid api is down, so waiting to test against it.

- The first commit adds docstrings and fixes type hints.
- The second commit reorganizes `test_unstructured_ingest` so it matches
the structure of `unstructured/ingest`.
- The third commit contains the primary changes for this PR.
- The `.chunk()` method responsible for sending elements to the correct
method is moved from `ChunkingConfig` to `Chunker` so that
`ChunkingConfig` acts as a config object instead of containing
implementation logic. `Chunker.chunk()` also now takes a json file
instead of a list of elements. This is done to avoid redundant
serialization if the file is to be sent to the api for chunking.

---------

Co-authored-by: Ahmet Melek <39141206+ahmetmeleq@users.noreply.github.com>
2024-04-25 00:24:58 +00:00

38 lines
1.1 KiB
ReStructuredText

Source Connectors
=================
Connect to your favorite data storage platforms for effortless batch processing of your files.
We are constantly adding new data connectors and if you don't see your favorite platform let us know
in our community `Slack. <https://short.unstructured.io/pzw05l7>`_
.. toctree::
:maxdepth: 1
source_connectors/airtable
source_connectors/azure
source_connectors/biomed
source_connectors/box
source_connectors/confluence
source_connectors/delta_table
source_connectors/discord
source_connectors/dropbox
source_connectors/elasticsearch
source_connectors/github
source_connectors/gitlab
source_connectors/google_cloud_storage
source_connectors/google_drive
source_connectors/jira
source_connectors/local_connector
source_connectors/mongodb
source_connectors/notion
source_connectors/onedrive
source_connectors/opensearch
source_connectors/outlook
source_connectors/reddit
source_connectors/s3
source_connectors/salesforce
source_connectors/sftp
source_connectors/sharepoint
source_connectors/slack
source_connectors/wikipedia