yujunjun/autogen
1
0
Fork 0
mirror of https://github.com/microsoft/autogen.git synced 2025-07-03 15:10:15 +00:00
Code Issues Packages Projects Releases Wiki Activity
autogen/python/packages/agbench/benchmarks
History
Leonardo Pinheiro 38f62e1609
migrate models (#3848) 
* migrate models

* Update python/packages/autogen-agentchat/src/autogen_agentchat/agents/_tool_use_assistant_agent.py

Co-authored-by: Eric Zhu <ekzhu@users.noreply.github.com>

* refactor missing imports

* ignore type check errors

* Update python/packages/autogen-ext/src/autogen_ext/models/_openai/_model_info.py

Co-authored-by: Eric Zhu <ekzhu@users.noreply.github.com>

* update packages index page

---------

Co-authored-by: Leonardo Pinheiro <lpinheiro@microsoft.com>
Co-authored-by: Eric Zhu <ekzhu@users.noreply.github.com>
2024-10-22 11:40:41 -04:00
..
AssistantBench
migrate models (#3848)
2024-10-22 11:40:41 -04:00
GAIA
migrate models (#3848)
2024-10-22 11:40:41 -04:00
HumanEval
migrate models (#3848)
2024-10-22 11:40:41 -04:00
WebArena
migrate models (#3848)
2024-10-22 11:40:41 -04:00
.gitignore
Adding Benchmarks to agbench (#3803)
2024-10-18 06:33:33 +02:00
process_logs.py
Adding Benchmarks to agbench (#3803)
2024-10-18 06:33:33 +02:00
README.md
Adding Benchmarks to agbench (#3803)
2024-10-18 06:33:33 +02:00

README.md

Benchmarking Agents

This directory provides ability to benchmarks agents (e.g., built using Autogen) using AgBench. Use the instructions below to prepare your environment for benchmarking. Once done, proceed to relevant benchmarks directory (e.g., benchmarks/GAIA) for further scenario-specific instructions.

Setup on WSL

  1. Install Docker Desktop. After installation, restart is needed, then open Docker Desktop, in Settings, Ressources, WSL Integration, Enable integration with additional distros – Ubuntu

  2. Clone autogen and export AUTOGEN_REPO_BASE. This environment variable enables the Docker containers to use the correct version agents.

    git clone git@github.com:microsoft/autogen.git
export AUTOGEN_REPO_BASE=<path_to_autogen>

  3. Install agbench. AgBench is currently a tool in the Autogen repo.

    cd autogen/python/packages/agbench
pip install -e .