dkirsche
a34e4cc515
Refactor transform_messages ( #1631 )
...
* refactored code to simplify
* optimize function. Instead of iterating over each character, guess at size and then iterate by token.
* adding tests
* Add missing tests
* minor test fix
* simplified token truncation by using tiktoken to encode and decode
* updated truncated notification message
* Fix llm_config spec to use os.environ
* Add test case and fix bug in loop
---------
Co-authored-by: gagb <gagb@users.noreply.github.com>
2024-02-20 22:53:05 +00:00
..
2024-01-06 17:23:23 +00:00
2024-02-15 18:57:17 +00:00
2024-02-17 17:02:12 +00:00
2024-02-20 22:53:05 +00:00
2024-02-15 18:57:17 +00:00
2024-02-15 18:57:17 +00:00
2024-02-15 18:57:17 +00:00
2024-02-15 18:57:17 +00:00
2024-02-15 18:57:17 +00:00
2024-02-18 15:47:19 +00:00
2024-02-18 15:47:19 +00:00
2024-02-18 15:47:19 +00:00
2024-02-15 18:57:17 +00:00
2024-02-18 15:47:19 +00:00
2024-02-15 18:57:17 +00:00
2024-02-15 18:57:17 +00:00
2024-02-14 17:00:55 +00:00
2024-01-18 17:03:49 +00:00
2024-02-15 18:57:17 +00:00
2024-01-08 03:47:01 +00:00
2024-02-15 18:57:17 +00:00
2024-02-18 15:08:55 +00:00
2024-01-18 17:03:49 +00:00
2024-02-15 00:54:17 +00:00
2024-02-15 18:57:17 +00:00
2024-02-15 18:57:17 +00:00
2024-02-13 05:23:08 +00:00
2024-01-18 17:03:49 +00:00
2024-02-11 18:04:43 +00:00
2024-01-27 18:49:24 +00:00
2024-01-18 17:03:49 +00:00
2024-02-02 16:52:07 +00:00
2024-02-15 18:57:17 +00:00
2024-02-15 18:57:17 +00:00
2024-02-14 17:00:55 +00:00
2024-02-14 17:00:55 +00:00
2024-01-27 18:59:38 +00:00
2024-02-15 18:57:17 +00:00
2024-01-22 03:43:15 +00:00
2024-02-15 18:57:17 +00:00
2024-02-15 18:57:17 +00:00
2024-02-15 18:57:17 +00:00
2024-02-15 18:57:17 +00:00
2024-01-18 17:03:49 +00:00
2024-02-15 18:57:17 +00:00
2024-02-17 17:02:12 +00:00
2024-01-18 17:03:49 +00:00
2024-01-08 03:47:01 +00:00
2024-01-08 03:47:01 +00:00
2024-01-08 03:47:01 +00:00
2024-02-11 18:04:43 +00:00
2024-02-14 17:00:55 +00:00
2024-02-15 18:57:17 +00:00
2024-02-15 18:57:17 +00:00
2023-10-16 17:20:53 +00:00