unstructured/scripts/opensearch-test-helpers/destination_connector/opensearch_cluster_config.py

import json

CLUSTER_URL = "http://localhost:9247"
INDEX_NAME = "ingest-test-destination"
USER = "admin"
PASSWORD = "admin"
MAPPING_PATH = "docs/source/ingest/destination_connectors/data/opensearch_elements_mappings.json"

with open(MAPPING_PATH) as f:
    mappings = json.load(f)
feat: add opensearch source and destination connector (#2349) Adds OpenSearch as a source and destination. Since OpenSearch is a fork of Elasticsearch, these connectors rely heavily on inheriting the Elasticsearch connectors whenever possible. - Adds OpenSearch source connector to be able to ingest documents from OpenSearch. - Adds OpenSearch destination connector to be able to ingest documents from any supported source, embed them and write the embeddings / documents into OpenSearch. - Defines an example unstructured elements schema for users to be able to setup their unstructured OpenSearch indexes easily. --------- Co-authored-by: potter-potter <david.potter@gmail.com> 2024-01-16 20:31:49 -08:00			`import json`

fix: change opensearch port (#2517) change opensearch port to see if fixes CI. We think there may be a conflict with the elasticsearch docker port. Also adding simple retry to vector query. --------- Co-authored-by: potter-potter <david.potter@gmail.com> 2024-02-07 13:25:04 -08:00			`CLUSTER_URL = "http://localhost:9247"`
feat: add opensearch source and destination connector (#2349) Adds OpenSearch as a source and destination. Since OpenSearch is a fork of Elasticsearch, these connectors rely heavily on inheriting the Elasticsearch connectors whenever possible. - Adds OpenSearch source connector to be able to ingest documents from OpenSearch. - Adds OpenSearch destination connector to be able to ingest documents from any supported source, embed them and write the embeddings / documents into OpenSearch. - Defines an example unstructured elements schema for users to be able to setup their unstructured OpenSearch indexes easily. --------- Co-authored-by: potter-potter <david.potter@gmail.com> 2024-01-16 20:31:49 -08:00			`INDEX_NAME = "ingest-test-destination"`
			`USER = "admin"`
			`PASSWORD = "admin"`
			`MAPPING_PATH = "docs/source/ingest/destination_connectors/data/opensearch_elements_mappings.json"`

			`with open(MAPPING_PATH) as f:`
			`mappings = json.load(f)`