haystack/hugging-face-async-streaming-handling-463f3a6cbd6b6f8c.yaml at main - haystack - Gitea: Git with a cup of tea

yujunjun/haystack

mirror of https://github.com/deepset-ai/haystack.git synced 2025-06-26 22:00:13 +00:00

Mohammed Abdul Razak Wahab a28b2851d9

feat: Add async streaming support in HuggingFaceLocalChatGenerator (#9405 )

* feat: Add async streaming support in hugging face generator

* enforce streamingcallback to be async

* refactor

* fix: schedule and await async task in Event Loop

* unenforce typecheck

* add integration test

* After merge fixes:
- fix breaking tests
- added component_info to AsyncHFTokenStreamingHandler

* fix integration test

* refactor: improve async handling in HuggingFaceLocalChatGenerator and update tests

* fix typo

* address review comments

* refactors

* typo

* refactor

2025-06-11 14:50:25 +00:00

5 lines

122 B

YAML

Raw Permalink Blame History

 ---
 features:
   - |
     Add `AsyncHFTokenStreamingHandler` for async streaming support in `HuggingFaceLocalChatGenerator`