2 Commits

Author SHA1 Message Date
Eric Zhu
c85da398a0 Cancellation for model client #90 (#240)
* Cancellation for model client #90

* format

* Use future
2024-07-22 10:59:16 -07:00
Eric Zhu
2041905acb Add token counting to chat completion client #220 (#239)
* Add token counting to chat completion client

* fix mypy

* ignore pyright for object type

* format
2024-07-19 18:44:22 -07:00