Eric Zhu
225eb9d0b2
feat: introduce ModelClientStreamingChunkEvent for streaming model output and update handling in agents and console ( #5208 )
...
Resolves #3983
* introduce `model_client_stream` parameter in `AssistantAgent` to
enable token-level streaming output.
* introduce `ModelClientStreamingChunkEvent` as a type of `AgentEvent`
to pass the streaming chunks to the application via `run_stream` and
`on_messages_stream`. Although this will not affect the inner messages
list in the final `Response` or `TaskResult`.
* handle this new message type in `Console`.
2025-01-29 02:49:02 +00:00
Eric Zhu
b441d5b43a
fix: Enhance OpenAI client to handle additional stop reasons and improve tool call validation in tests to address empty tool_calls list. ( #5223 )
...
Resolves #5222
2025-01-27 21:16:47 +00:00
Sachin Joglekar
8926206479
Implement default in-memory store for ChatCompletionCache ( #5188 )
2025-01-25 21:07:58 +00:00
Leonardo Pinheiro
db2410c705
Feature/azure ai inference client ( #5153 )
...
* Rebase to latest main branch
* Moved _azure module to azure
* Validate extra_create_args in and json response
* Added Support for Github Models
* Added normalize_name and assert_valid name
* Added Tests for AzureAIChatCompletionClient
* WIP: Azure AI Client
* Added: object-level usage data
* Added: doc string
* Added: check existing response_format value
* Added: _validate_config and _create_client
* lint
* merge dependencies
* add tests for img and function calling
* support actual tests through env vars
* address mypy errors
* doc example fix
* fmt
* fix doc fmt
* Update python/packages/autogen-ext/src/autogen_ext/models/azure/_azure_ai_client.py
---------
Co-authored-by: Rohan Thacker <thackerrohan4@gmail.com>
Co-authored-by: Eric Zhu <ekzhu@users.noreply.github.com>
Co-authored-by: Leonardo Pinheiro <lpinheiro@microsoft.com>
2025-01-25 08:26:48 +10:00
Eric Zhu
da1c2bf12e
fix: use tool_calls field to detect tool calls in OpenAI client; add integration tests for OpenAI and Gemini ( #5122 )
...
* fix: use tool_calls field to detect tool calls in OpenAI client
* Add unit tests for tool calling; and integration tests for openai and gemini
2025-01-21 09:06:19 -05:00
Eric Zhu
af420a83e2
fix: ensure proper handling of structured output in OpenAI client and improve test coverage for structured output ( #5116 )
2025-01-20 20:54:39 +00:00
Leonardo Pinheiro
918292f51e
Semantic kernel model adapter ( #4851 )
...
* initial sk model adapter implementation
* add sk tool module
* implement streaming and update tests
* update lock
* linting
* add semantic kernel extras
* add docstring and format
* update dependencies and format/lint
* add model info to sk constructor
* update uv.lock
* customize prompt settings
* update uv.lock
* add docs
* fix sk docstring linting
* update create docstrings
* fmt and improve tool docstring
* update sk tool docs
* coerce doc json serialization failure
---------
Co-authored-by: Leonardo Pinheiro <lpinheiro@microsoft.com>
2025-01-18 18:57:20 +10:00
Sachin Joglekar
8bd65c672f
Add ChatCompletionCache along with AbstractStore for caching completions ( #4924 )
...
* Add ChatCompletionCache along with AbstractStore for caching completions
* Addressing comments
* Improve interface for cachestore
* Improve documentation & revert protocol
* Make cache store typed, and improve docs
* remove unnecessary casts
2025-01-16 15:47:38 -08:00
Jack Gerrits
cb1633b501
feat!: Add support for model family specification ( #4856 )
...
* Add support for model family specification
* spelling mistake
* lint, etc
* fixes
2024-12-30 15:09:21 -05:00
Sachin Joglekar
3b4dd6e050
Support custom models with OpenAI client ( #4808 )
2024-12-24 13:04:23 -08:00
Leonardo Pinheiro
253fe216fd
Add models.openai and tools.langchain namespaces ( #4601 )
...
* add models.openai namespace
* refactor tools namespace
* update lock file
* revert pyproject changes
* update docs and add cast
* update ext models doc ref
* increase underline
* add reply models namespace
* update imports
* fix test
* linting
* fix missing conflicts
* revert pydantic changes
* rename to replay
* replay
* fix reply
* Fix test
* formatting
* example
---------
Co-authored-by: Leonardo Pinheiro <lpinheiro@microsoft.com>
Co-authored-by: Jack Gerrits <jack@jackgerrits.com>
Co-authored-by: Jack Gerrits <jackgerrits@users.noreply.github.com>
2024-12-09 19:18:09 -08:00
Jack Gerrits
218e84fd8e
Migrate remaining components ( #4626 )
2024-12-09 18:39:07 -08:00
Jack Gerrits
87011ae01b
Migrate model context and models modules out of components ( #4613 )
...
* Move model context out of components
* move models out of components
* rename docs file
2024-12-09 10:00:08 -08:00
Jack Gerrits
2b878763f8
Move grpc runtimes to ext, flatten application ( #4553 )
...
* Move grpc runtimes to ext, flatten application
* rename to grpc
* fmt
2024-12-04 16:23:20 -08:00
Victor Dibia
777f2abbd7
Load and Save state in AgentChat ( #4436 )
...
1. convert dataclass types to pydantic basemodel
2. add save_state and load_state for ChatAgent
3. state types for AgentChat
---------
Co-authored-by: Eric Zhu <ekzhu@users.noreply.github.com>
2024-12-04 16:14:41 -08:00
Jack Gerrits
3022369eeb
Flatten core base and components ( #4513 )
...
* Flatten core base and components
* remove extra files
* dont export from deprecated locations
* format
* fmt
2024-12-03 17:00:44 -08:00
Jack Gerrits
b2ae4d1203
Add warnings for deprecated azure oai config changes ( #4317 )
...
* Add warnings for deprecated azure oai config changes
* Update docs and usages, simplify capabilities
2024-11-25 09:34:52 -08:00
Leonardo Pinheiro
ac53961bc8
Delete autogen-ext refactor deprecations ( #4305 )
...
* delete files and update dependencies
* add explicit config exports
* ignore mypy error on nb
---------
Co-authored-by: Leonardo Pinheiro <lpinheiro@microsoft.com>
Co-authored-by: Jack Gerrits <jackgerrits@users.noreply.github.com>
2024-11-22 11:29:39 -05:00
Mohammad Mazraeh
570471bed7
Add reply chat completion client ( #4096 )
...
* initial implementation of reply chat completion client
---------
Signed-off-by: Mohammad Mazraeh <mazraeh.mohammad@gmail.com>
Co-authored-by: Eric Zhu <ekzhu@users.noreply.github.com>
2024-11-11 15:33:44 -05:00
Anthony Uphof
87bd1de396
Fix: provide valid Prompt and Completion Token usage counts from create_stream ( #3972 )
...
* Fix: `create_stream` to return valid usage token counts
* documentation
---------
Co-authored-by: Eric Zhu <ekzhu@users.noreply.github.com>
2024-10-29 16:20:03 -07:00
Leonardo Pinheiro
38f62e1609
migrate models ( #3848 )
...
* migrate models
* Update python/packages/autogen-agentchat/src/autogen_agentchat/agents/_tool_use_assistant_agent.py
Co-authored-by: Eric Zhu <ekzhu@users.noreply.github.com>
* refactor missing imports
* ignore type check errors
* Update python/packages/autogen-ext/src/autogen_ext/models/_openai/_model_info.py
Co-authored-by: Eric Zhu <ekzhu@users.noreply.github.com>
* update packages index page
---------
Co-authored-by: Leonardo Pinheiro <lpinheiro@microsoft.com>
Co-authored-by: Eric Zhu <ekzhu@users.noreply.github.com>
2024-10-22 11:40:41 -04:00
