mirror of
https://github.com/Unstructured-IO/unstructured.git
synced 2025-08-18 13:45:45 +00:00
cde11d1eb0
Adds source connector for SFTP which uses fsspec and paramiko via fsspec. Paramiko is the standard sftp package for python used in pysftp etc... ``` --username foo \ --password bar \ --remote-url sftp://localhost:47474/upload/ ``` Will only download a specifically requested file if it has an extension. (i.e. `--remote-url sftp://localhost:47474/upload/bob.zip`) It will treat any other remote_url as a folder path. This is intentional. --------- Co-authored-by: potter-potter <david.potter@gmail.com>
16 lines
385 B
Bash
Executable File
16 lines
385 B
Bash
Executable File
#!/usr/bin/env bash
|
|
|
|
SCRIPT_DIR=$(dirname "$(realpath "$0")")
|
|
|
|
# Upload nested folder path to sftp server
|
|
function upload(){
|
|
docker cp "$SCRIPT_DIR"/folder1/ sftp-test:/home/foo/upload/
|
|
}
|
|
|
|
# Create sftp server
|
|
docker compose version
|
|
docker compose -f "$SCRIPT_DIR"/docker-compose.yaml up --wait
|
|
docker compose -f "$SCRIPT_DIR"/docker-compose.yaml ps
|
|
|
|
echo "Cluster is live."
|
|
upload |