mirror of
https://github.com/Unstructured-IO/unstructured.git
synced 2025-10-31 01:54:25 +00:00
bc791d53f4
Adds OpenSearch as a source and destination. Since OpenSearch is a fork of Elasticsearch, these connectors rely heavily on inheriting the Elasticsearch connectors whenever possible. - Adds OpenSearch source connector to be able to ingest documents from OpenSearch. - Adds OpenSearch destination connector to be able to ingest documents from any supported source, embed them and write the embeddings / documents into OpenSearch. - Defines an example unstructured elements schema for users to be able to setup their unstructured OpenSearch indexes easily. --------- Co-authored-by: potter-potter <david.potter@gmail.com>
14 lines
354 B
Bash
Executable File
14 lines
354 B
Bash
Executable File
#!/usr/bin/env bash
|
|
|
|
set -e
|
|
|
|
SCRIPT_DIR=$(dirname "$(dirname "$(realpath "$0")")")
|
|
|
|
# Create the Opensearch cluster
|
|
docker compose version
|
|
docker compose -f "$SCRIPT_DIR"/common/docker-compose.yaml up --wait
|
|
docker compose -f "$SCRIPT_DIR"/common/docker-compose.yaml ps
|
|
|
|
echo "Cluster is live."
|
|
python "$SCRIPT_DIR"/destination_connector/create_index.py
|