mirror of
https://github.com/Unstructured-IO/unstructured.git
synced 2025-06-27 02:30:08 +00:00

### Description This PR resolved the following open issue: [bug/bedrock-encoder-not-supported-in-ingest](https://github.com/Unstructured-IO/unstructured/issues/2319). To do so, the following changes were made: * All aws configs were added as input parameters to the CLI * These were mapped to the bedrock embedder when an embedder is generated via `get_embedder` * An ingest test was added to call the aws bedrock service * Requirements for boto were bumped because the first version to introduce the bedrock runtime, which is required to hit the bedrock service, was introduced in version `1.34.63`, which was ahead of the version of boto pinned. --------- Co-authored-by: ryannikolaidis <1208590+ryannikolaidis@users.noreply.github.com> Co-authored-by: rbiseck3 <rbiseck3@users.noreply.github.com>
35 lines
769 B
YAML
35 lines
769 B
YAML
repos:
|
|
- repo: https://github.com/pre-commit/pre-commit-hooks
|
|
rev: "v4.3.0"
|
|
hooks:
|
|
- id: check-added-large-files
|
|
- id: check-toml
|
|
- id: check-yaml
|
|
- id: check-json
|
|
- id: check-xml
|
|
- id: end-of-file-fixer
|
|
exclude: \.json$
|
|
files: \.py$
|
|
- id: trailing-whitespace
|
|
- id: mixed-line-ending
|
|
|
|
- repo: https://github.com/psf/black
|
|
rev: 24.2.0
|
|
hooks:
|
|
- id: black
|
|
args: ["--line-length=100"]
|
|
language_version: python3
|
|
|
|
- repo: https://github.com/astral-sh/ruff-pre-commit
|
|
rev: v0.2.1
|
|
hooks:
|
|
- id: ruff
|
|
args:
|
|
["--fix"]
|
|
|
|
- repo: https://github.com/pycqa/flake8
|
|
rev: 7.0.0
|
|
hooks:
|
|
- id: flake8
|
|
language_version: python3
|