9 Commits

Author	SHA1	Message	Date
ZanSara	462f3a5c99	feat: globally disable progress bars (#5207) ... * add SilenceableTqdm and update usage * pylint * rename module * add tests	2023-06-27 11:45:17 +02:00
Michael Feil	cfd703fa3e	fix: model_tokenizer in openai text completion tokenization details (#5104) ... * fix: model_tokenizer * Update test --------- Co-authored-by: Sebastian Husch Lee <sjrl423@gmail.com>	2023-06-22 14:23:19 +02:00
Ben Heckmann	1318ac5074	feat: Optional Content Moderation for OpenAI PromptNode & OpenAIAnswerGenerator (#5017) ... * #4071 implemented optional content moderation for OpenAI PromptNode * added two simple integration tests * improved documentation & renamed _invoke method to _execute_openai_request * added a flag to check_openai_policy_violation that will return a full dict of all text violations and their categories * re-implemented the tests as unit tests & without use of the OpenAI APIs * removed unused patch * changed check_openai_policy_violation back to only return a bool * fixed pylint and test error --------- Co-authored-by: Julian Risch <julian.risch@deepset.ai>	2023-06-19 13:27:11 +02:00
ZanSara	49e037a055	fix: rename requests.py into requests_utils.py (#5099) ... * requests.py -> requests_utils.py * fix tests * reimport requrests * fix more tests * review feedback	2023-06-12 12:40:21 +02:00
ZanSara	123ee55a5c	docstring (#4950)	2023-05-18 16:00:02 +02:00
Julian Risch	8cfeed095d	build: Remove mmh3 dependency (#4896) ... * build: Remove mmh3 dependency * resolve circular import * pylint * make mmh3.py sibling of schema.py * pylint import order * pylint * undo example changes * increase coverage in modeling module * increase coverage further * rename new unit tests	2023-05-17 21:31:08 +02:00
Farzad E	6eb251d1f0	fix: Support for gpt-4-32k (#4825) ... * Add step to loook up tokenizers by prefix in openai_utils * Updated tiktoken min version + openai_utils test * Added test case for GPT-4 and Azure model naming * Broken down tests * Added default case --------- Co-authored-by: ZanSara <sara.zanzottera@deepset.ai>	2023-05-12 19:02:12 +02:00
Silvano Cerza	f12e5a0127	fix: Fix missing error in openai_request retry strategy (#4802) ... * Fix missing error in openai_request retry strategy * Correctly handle OpenAIUnauthorizedError Co-authored-by: bogdankostic <bogdankostic@web.de> --------- Co-authored-by: bogdankostic <bogdankostic@web.de>	2023-05-10 10:31:07 +02:00
Silvano Cerza	5547e85bd5	feat: Add util method to make HTTP requests with configurable retry (#4627) ... * Add util method to make HTTP requests with configurable retry * Fix pylint * Remove unnecessary optional parameter	2023-04-11 10:35:39 +02:00