yujunjun/haystack
1
0
Fork 0
mirror of https://github.com/deepset-ai/haystack.git synced 2025-11-11 15:23:41 +00:00
Code Issues Packages Projects Releases Wiki Activity

fix: Support for Azure 16k gpt 35 deployment (#5804)

Browse Source 
* Support for Azure 16k gpt 35 deployment

* releasenote added

---------

Co-authored-by: user11999 <radugabrielchivereanu@gmail.com>
This commit is contained in:
Chivereanu Radu 2023-09-14 19:01:22 +03:00 committed by GitHub
parent c7971a809d
commit cab21da87b
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
2 changed files with 6 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
haystack/utils/openai_utils.py
View File

@ -77,7 +77,7 @@ def _openai_text_completion_tokenization_details(model_name: str):
if "text-davinci" in model_name: if "text-davinci" in model_name:
max_tokens_limit = 4097 max_tokens_limit = 4097
tokenizer_name = model_tokenizer tokenizer_name = model_tokenizer
elif model_name.startswith("gpt-3.5-turbo-16k"): elif model_name.startswith("gpt-3.5-turbo-16k") or model_name.startswith("gpt-35-turbo-16k"):
max_tokens_limit = 16384 max_tokens_limit = 16384
tokenizer_name = model_tokenizer tokenizer_name = model_tokenizer
elif model_name.startswith("gpt-3"): elif model_name.startswith("gpt-3"):

5
releasenotes/notes/support-azure-3.5-gpt-16k-model-ece0cfe03260748c.yaml Normal file
View File

@ -0,0 +1,5 @@
---
fixes:
- |
gpt-35-turbo-16k model from Azure can integrate correctly