unstructured/scripts/sftp-test-helpers/docker-compose.yaml
David Potter cde11d1eb0
feat: Add sftp source connector (#2163)
Adds source connector for SFTP which uses fsspec and paramiko via
fsspec. Paramiko is the standard sftp package for python used in pysftp
etc...

```
--username foo \
--password bar \
--remote-url sftp://localhost:47474/upload/
```

Will only download a specifically requested file if it has an extension.
(i.e. `--remote-url sftp://localhost:47474/upload/bob.zip`) It will
treat any other remote_url as a folder path. This is intentional.

---------

Co-authored-by: potter-potter <david.potter@gmail.com>
2023-12-07 19:33:19 +00:00

12 lines
406 B
YAML

services:
sftp:
image: atmoz/sftp
container_name: sftp-test
ports:
- "47474:22" # rarely used port in case standard port is used in CI
command: foo:bar:::upload
healthcheck:
test: ["CMD-SHELL", "ssh -o 'BatchMode=true' -o 'StrictHostKeyChecking=no' healthcheck-invalid@localhost 2>&1 | grep -q 'Permission denied'"]
interval: 30s
timeout: 10s
retries: 3