mirror of
https://github.com/Unstructured-IO/unstructured.git
synced 2025-07-17 05:56:20 +00:00
bc791d53f4
Adds OpenSearch as a source and destination. Since OpenSearch is a fork of Elasticsearch, these connectors rely heavily on inheriting the Elasticsearch connectors whenever possible. - Adds OpenSearch source connector to be able to ingest documents from OpenSearch. - Adds OpenSearch destination connector to be able to ingest documents from any supported source, embed them and write the embeddings / documents into OpenSearch. - Defines an example unstructured elements schema for users to be able to setup their unstructured OpenSearch indexes easily. --------- Co-authored-by: potter-potter <david.potter@gmail.com>
11 lines
281 B
Python
11 lines
281 B
Python
import json
|
|
|
|
CLUSTER_URL = "http://localhost:9200"
|
|
INDEX_NAME = "ingest-test-destination"
|
|
USER = "admin"
|
|
PASSWORD = "admin"
|
|
MAPPING_PATH = "docs/source/ingest/destination_connectors/data/opensearch_elements_mappings.json"
|
|
|
|
with open(MAPPING_PATH) as f:
|
|
mappings = json.load(f)
|