haystack/fix-openai-streaming-usage-c3dbad63fd9a8020.yaml at new-output-types-in-conditional-router - haystack - Gitea: Git with a cup of tea

yujunjun/haystack

mirror of https://github.com/deepset-ai/haystack.git synced 2025-06-26 22:00:13 +00:00

Silvano Cerza 3ef8c081be

fix: OpenAIChatGenerator and OpenAIGenerator crashing when streaming with usage tracking (#8558 )

* Fix OpenAIGenerator crashing with tracking usage with streaming enabled

* Fix OpenAIChatGenerator crashing with tracking usage with streaming enabled

* Add release notes

* Fix linting

2024-11-20 10:27:22 +01:00

5 lines

191 B

YAML

Raw Permalink Blame History

 ---
 fixes:
   - |
     Fix `OpenAIChatGenerator` and `OpenAIGenerator` crashing when using a `streaming_callback` and `generation_kwargs` contain `{"stream_options": {"include_usage": True}}`.