mirror of
https://github.com/microsoft/autogen.git
synced 2025-07-03 07:04:16 +00:00
e11d84b996
* Move from tomllib to tomli * added example code for magentic-one + code comments * adding benchmarks temporarily * add license for datasets * revert changes to magentic-one * change license location --------- Co-authored-by: Ryan Sweet <rysweet@microsoft.com>
18 lines
929 B
Markdown
18 lines
929 B
Markdown
# Benchmarking Agents
|
||
|
||
This directory provides ability to benchmarks agents (e.g., built using Autogen) using AgBench. Use the instructions below to prepare your environment for benchmarking. Once done, proceed to relevant benchmarks directory (e.g., `benchmarks/GAIA`) for further scenario-specific instructions.
|
||
|
||
## Setup on WSL
|
||
|
||
1. Install Docker Desktop. After installation, restart is needed, then open Docker Desktop, in Settings, Ressources, WSL Integration, Enable integration with additional distros – Ubuntu
|
||
2. Clone autogen and export `AUTOGEN_REPO_BASE`. This environment variable enables the Docker containers to use the correct version agents.
|
||
```bash
|
||
git clone git@github.com:microsoft/autogen.git
|
||
export AUTOGEN_REPO_BASE=<path_to_autogen>
|
||
```
|
||
3. Install `agbench`. AgBench is currently a tool in the Autogen repo.
|
||
|
||
```bash
|
||
cd autogen/python/packages/agbench
|
||
pip install -e .
|
||
``` |