mirror of
https://github.com/deepset-ai/haystack.git
synced 2025-12-29 16:08:38 +00:00
f998bf4a4f
* Add Bedrock * Update supported models for Bedrock * Fix supports and add extract response in Bedrock * fix errors imports * improve and refactor supports * fix install * fix mypy * fix pylint * fix existing tests * Added Anthropic Bedrock * fix tests * fix sagemaker tests * add default prompt handler, constructor and supports tests * more tests * invoke refactoring * refactor model_kwargs * fix mypy * lstrip responses * Add streaming support * bump boto3 version * add class docstrings, better exception names * fix layer name * add tests for anthropic and cohere model adapters * update cohere params * update ai21 args and add tests * support cohere command light model * add tital tests * better class names * support meta llama 2 model * fix streaming support * more future-proof model adapter selection * fix import * fix mypy * fix pylint for preview * add tests for streaming * add release notes * Apply suggestions from code review Co-authored-by: Agnieszka Marzec <97166305+agnieszka-m@users.noreply.github.com> * fix format * fix tests after msg changes * fix streaming for cohere --------- Co-authored-by: tstadel <60758086+tstadel@users.noreply.github.com> Co-authored-by: tstadel <thomas.stadelmann@deepset.ai> Co-authored-by: Agnieszka Marzec <97166305+agnieszka-m@users.noreply.github.com>
17 lines
671 B
YAML
17 lines
671 B
YAML
---
|
|
prelude: >
|
|
Haystack now supports Amazon Bedrock models, including all existing and previously announced
|
|
models, like Llama-2-70b-chat. To use these models, simply pass the model ID in the
|
|
model_name_or_path parameter, like you do for any other model. For details, see
|
|
[Amazon Bedrock Docmentation](https://docs.aws.amazon.com/bedrock/latest/userguide/model-ids-arns.html).
|
|
|
|
For example, the following code loads the Llama 2 Chat 13B model:
|
|
```python
|
|
from haystack.nodes import PromptNode
|
|
|
|
prompt_node = PromptNode(model_name_or_path="meta.llama2-13b-chat-v1")
|
|
```
|
|
features:
|
|
- |
|
|
You can use Amazon Bedrock models in Haystack.
|