llama-hub/loader_hub/opendal_reader

OpenDAL Loader

This loader parses any file via OpenDAL.

All files are temporarily downloaded locally and subsequently parsed with SimpleDirectoryReader. Hence, you may also specify a custom file_extractor, relying on any of the loaders in this library (or your own)!

Usage

OpendalReader can read data from any supported storage services including s3, azblob, gcs and so on.

from llama_index import download_loader

OpendalReader = download_loader("OpendalReader")

loader = OpendalReader(
    scheme="s3",
    bucket='bucket',
    path='path/to/data/',
)
documents = loader.load_data()

We also provide Opendal[S3|Gcs|Azblob]Reader for convenience.

---

This loader is designed to be used as a way to load data into LlamaIndex and/or subsequently used as a Tool in a LangChain Agent. See here for examples.