haystack/releasenotes/notes/add-hf-free-tier-checks-99384060139d5d30.yaml
Vladimir Blagojevic 9e6a2e3cf9
fix: HuggingFaceTGIGenerator gets stuck when model is not supported (#6915)
* HuggingFaceTGIGenerator/HuggingFaceTGIChatGenerator check if model is deployed on free-tier
2024-02-06 16:55:06 +01:00

8 lines
452 B
YAML

---
fixes:
- |
Resolves a bug where the HuggingFaceTGIGenerator and HuggingFaceTGIChatGenerator encountered issues if provided
with valid models that were not available on the HuggingFace inference API rate-limited tier. The fix, detailed
in [GitHub issue #6816](https://github.com/deepset-ai/haystack/issues/6816) and its GitHub PR, ensures these
components now correctly handle model availability, eliminating previous limitations.