Roman Isecke 59e850bbd9
Roman/downstream connector cli subcommand (#1302)
### Description
Update all other connectors to use the new downstream architecture that
was recently introduced for the s3 connector.

Closes #1313 and #1311
2023-09-11 11:40:56 -04:00

18 lines
503 B
Bash
Executable File

#!/usr/bin/env bash
# Ingests a discord text channel into a file.
# Structured outputs are stored in discord-example/
SCRIPT_DIR=$( cd -- "$( dirname -- "${BASH_SOURCE[0]}" )" &> /dev/null && pwd )
cd "$SCRIPT_DIR"/../../.. || exit 1
PYTHONPATH=. ./unstructured/ingest/main.py \
discord \
--channels 12345678 \
--token "$DISCORD_TOKEN" \
--download-dir discord-ingest-download \
--output-dir discord-example \
--preserve-downloads \
--verbose