yujunjun/haystack
1
0
Fork 0
mirror of https://github.com/deepset-ai/haystack.git synced 2025-06-26 22:00:13 +00:00
Code Issues Packages Projects Releases Wiki Activity
haystack/releasenotes/notes/hugging-face-async-streaming-handling-463f3a6cbd6b6f8c.yaml

5 lines
122 B
YAML
Raw Permalink Normal View History

feat: Add async streaming support in `HuggingFaceLocalChatGenerator` (#9405) * feat: Add async streaming support in hugging face generator * enforce streamingcallback to be async * refactor * fix: schedule and await async task in Event Loop * unenforce typecheck * add integration test * After merge fixes: - fix breaking tests - added component_info to AsyncHFTokenStreamingHandler * fix integration test * refactor: improve async handling in HuggingFaceLocalChatGenerator and update tests * fix typo * address review comments * refactors * typo * refactor
2025-06-11 20:20:25 +05:30
---
features:
- |
Add `AsyncHFTokenStreamingHandler` for async streaming support in `HuggingFaceLocalChatGenerator`
Reference in New Issue Copy Permalink