yujunjun/autogen
1
0
Fork 0
mirror of https://github.com/microsoft/autogen.git synced 2025-10-31 17:59:50 +00:00
Code Issues Packages Projects Releases Wiki Activity
autogen/python/packages/agbench/benchmarks
History
Enhao Zhang 0e4efd0efc
Add example for parallel agents (#6311) 
This PR adds an example of `parallel-agents` that runs multiple
instances of Magentic-One in parallel, with support for early
termination and final answer aggregation.

---------

Co-authored-by: Eric Zhu <ekzhu@users.noreply.github.com>
2025-04-18 08:48:56 -07:00
..
GAIA
Add example for parallel agents (#6311)
2025-04-18 08:48:56 -07:00
HumanEval
Improvements to agbench (#5776)
2025-03-16 09:13:12 -07:00
.gitignore
Adding Benchmarks to agbench (#3803)
2024-10-18 06:33:33 +02:00
process_logs.py
Adding Benchmarks to agbench (#3803)
2024-10-18 06:33:33 +02:00
README.md
Adding Benchmarks to agbench (#3803)
2024-10-18 06:33:33 +02:00

README.md

Benchmarking Agents

This directory provides ability to benchmarks agents (e.g., built using Autogen) using AgBench. Use the instructions below to prepare your environment for benchmarking. Once done, proceed to relevant benchmarks directory (e.g., benchmarks/GAIA) for further scenario-specific instructions.

Setup on WSL

  1. Install Docker Desktop. After installation, restart is needed, then open Docker Desktop, in Settings, Ressources, WSL Integration, Enable integration with additional distros – Ubuntu

  2. Clone autogen and export AUTOGEN_REPO_BASE. This environment variable enables the Docker containers to use the correct version agents.

    git clone git@github.com:microsoft/autogen.git
export AUTOGEN_REPO_BASE=<path_to_autogen>

  3. Install agbench. AgBench is currently a tool in the Autogen repo.

    cd autogen/python/packages/agbench
pip install -e .