haystack/releasenotes/notes/hfapichatgenerator-51772e1f0d679b1c.yaml
Stefano Fiorucci 0dbb98c0a0
feat: HuggingFaceAPIChatGenerator (#7480)
* draft

* docstrings and more tests

* deprecation; reno

* pydoc config

* better error messages

* wip

* add test

* better docstrings

* deprecation; reno

* pylint

* typo

* rm unneeded else

* rm unneeded else

* fixes from feedback

* docstring showing the enum

* improve docstring

* make params mandatory

* Apply suggestions from code review

Co-authored-by: Madeesh Kannan <shadeMe@users.noreply.github.com>

* document enum

* Update haystack/utils/hf.py

Co-authored-by: Madeesh Kannan <shadeMe@users.noreply.github.com>

* mandatory params

* fix test

* fix test

---------

Co-authored-by: Madeesh Kannan <shadeMe@users.noreply.github.com>
2024-04-05 18:48:34 +02:00

15 lines
532 B
YAML

---
features:
- |
Introduce `HuggingFaceAPIChatGenerator`.
This text-generation component uses the ChatMessage format and supports different Hugging Face APIs:
- free Serverless Inference API
- paid Inference Endpoints
- self-hosted Text Generation Inference.
This generator will replace the `HuggingFaceTGIChatGenerator` in the future.
deprecations:
- |
Deprecate `HuggingFaceTGIChatGenerator`. This component will be removed in Haystack 2.3.0.
Use `HuggingFaceAPIChatGenerator` instead.