35 Commits

Author SHA1 Message Date
afourney
b10e065456
Bump autogenbench version. (#1485) 2024-01-31 21:32:41 +00:00
Preston Badeer
26a0694886
Correct small typos in system messages (#1410)
* Update utils.ts - fix small typo in default system message

* Fix typos in system messages

---------

Co-authored-by: Preston Badeer <467756+pbadeer@users.noreply.github.com>
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
2024-01-27 19:02:59 +00:00
Chi Wang
fd0094ce51
bump version to 0.2.9 (#1430)
* Fixed rounding bug.

* bump version to 0.2.9

* fix format error

* simplify contrib tests

---------

Co-authored-by: Adam Fourney <adamfo@microsoft.com>
2024-01-27 18:49:24 +00:00
afourney
cd199c7ab7
Introduces AutoGenBench (#1048)
* Initial commit of AutoGenBench

* wording

* typo

* pre-commit reformulation

* Updated README to point to contributor's guide earlier.

* Simplified the description of the JSON format.

* Added print statements to indicate when run.sh and scenario.py are starting.

* Added SocietyOfMind scenario to GAIA.

* Pointing autogenbench clone command to the latest branch.

* Temporarily disable subsample option.

* Updated the GAIA readme to specify how to define a BING API key.

* Fixed and re-enabled the subsample option.

* Added a draft of a blog post.

* Updated authors.

* Incorporating Gagan's feedback.

* Fixed code formatting.

* Updated the help string in the docs.

* Light editing of the AutoGenBench blogpost.

* Support filtering on model tags.

* Added websurfer dependencies to Dockerfile.

* Renamed testbed -> autogenbench

* Attempting to fix formatting.

* Added more gracefull handling of task timeouts (the script is allowed to terminate before Docker is stopped).

* Updated the blogpost based on Saleema's and Julia's feedback.

* Fixed formatting... again.

* Added a main MANIFEST to list available scenarios.

* Limit main manifest to directories.

* Manifests now use relative paths.

* All manifests are now relative.

* Updated the contributing guide, and address windows path issues.

* Updated the version. Fixed formatting.

* Fixed formatting.

* De-listing Examples, since it has no clear tabulate criteria.

* Updated email in pyproject

* typo in blogpost

* wording

---------

Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>
Co-authored-by: Qingyun Wu <qingyun0327@gmail.com>
2024-01-26 00:46:58 +00:00
gagb
598a634665
Cleanup and unify Dockerfiles (#1333)
* Create studio subfolder in devcontainer

* Update to follow readme instructions

* Move dockerfiles from samples to .devcontainer

* Fix typo in file name

* Update readme

* update doc

* Remove base dockerfile and update readme

---------

Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>
Co-authored-by: Davor Runje <davor@airt.ai>
2024-01-23 20:25:36 +00:00
Victor Dibia
30b84d4254
Autogenstudio - Add GroupChat Support to UI (#1352)
* support groupchat, other QOL fixes

* remove gallery success toast

* Update website/blog/2023-12-01-AutoGenStudio/index.mdx

Co-authored-by: Chi Wang <wang.chi@microsoft.com>

---------

Co-authored-by: Chi Wang <wang.chi@microsoft.com>
2024-01-23 19:59:58 +00:00
Olivier Mertens
23d6e1ec8a
Update README.md (#1306)
Correct error in link for autogenstudio/utils/dbdefaults.json extra T :)
2024-01-17 15:01:49 +00:00
Suhaha
39182ccb6b
[AutoGen Studio] Fix the process of new workflow (#1181)
Co-authored-by: Victor Dibia <victordibia@microsoft.com>
2024-01-17 01:59:21 +00:00
R3d91ll
135bca41de
Docker Documentation (#1251)
* Updates to the Dockerfiles making them more secure. update to the installation.md file and a start.sh file for the Dockerfile.dev to start the document server. Not ready for pull request.

* updates to the docker documentation

* clean up before commit

* added docker instructions on how to test  documentation prior to commit.

* fixed the title heading in the installation.md

* removed alternate yarn install from Dockerfile.dev

* Update sidebars.js

removed un-related change from website/sidebars.js

* cleaned up the lint errors from the pre-commit-check.

* removed bad edit from sidebars.js

* fixing git conflict with sidebars.js file

* Update Installation.md

added the missing sections back. However, do we still want the docker section under the Optional Dependencies? That looks like it would go better in the Dockerfiles.md file.

* Update Installation.md

Added mount your code back and added mount your directory for better clarity.

* Update Installation.md

Lint cleanup

* Update Installation.md

removed the relative path to samples/dockers/Dockerfiles.md with a proper URL to where it will exist

* fixed bad link to Dockerfiles.md

* Fix trailing whitespace and formatting issues

* Update link to Dockerfiles.md

* somtimes its really hard to find that lost i.

* trailing whitespace and EOF issues resolved

* fixed broken link

* trailing space an broken link

* removed broken links. will update one merged.

* fixed glaring error about building an image from a particular branch Contribute.md

* removed tic mark typo from contribute.md

---------

Co-authored-by: Todd W Bucy <todd.bucy@rackspace>
2024-01-15 17:15:59 +00:00
gagb
2134c60f4b
Update studio README.md with badges (#1225) 2024-01-13 04:29:28 +00:00
Davor Runje
1c4ae3d303
nbqa adedd to pre-commit, added black and ruff for notebooks (#1171)
* nbqa adedd to pre-commit, added black and ruff for notebooks

* polishing

* polishing

* polishing
2024-01-08 03:47:01 +00:00
Qingyun Wu
643a031062
guide on the usage of docker (#1111)
* docker documentation

* docker doc

* clean contribute.md

* minor change

* Add more detailed description

* add docker instructions

* more dockerfiles

* readme update

* latest python

* dev docker python version

* add version

* readme

* improve doc

* improve doc

* path name

* naming

* Update website/docs/Installation.md

Co-authored-by: Chi Wang <wang.chi@microsoft.com>

* Update website/docs/Installation.md

Co-authored-by: Chi Wang <wang.chi@microsoft.com>

* Add suggestion to install colima for Mac users

* Update website/docs/Installation.md

Co-authored-by: Chi Wang <wang.chi@microsoft.com>

* Update website/docs/Installation.md

Co-authored-by: olgavrou <olgavrou@gmail.com>

* update doc

* typo

* improve doc

* add more options in dev file

* contrib

* add link to doc

* add link

* Update website/docs/Installation.md

Co-authored-by: Chi Wang <wang.chi@microsoft.com>

* Update website/docs/Installation.md

Co-authored-by: Chi Wang <wang.chi@microsoft.com>

* instruction

* Update website/docs/FAQ.md

Co-authored-by: Chi Wang <wang.chi@microsoft.com>

* FAQ

* comment autogen studio

---------

Co-authored-by: Yuandong Tian <yuandong@fb.com>
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
Co-authored-by: olgavrou <olgavrou@gmail.com>
2024-01-08 02:36:04 +00:00
Davor Runje
8f065e06e4
Add codespell to pre-commit hooks and fix spelling of existing files (#1161)
* fixed spelling, minor errors and reformatted using black

* polishing

* added codespell to pre-commit hooks, fixed a number of spelling errors and a few minor bugs in the code

* update autogen library version in notebooks

* update autogen library version in notebooks

* update autogen library version in notebooks

* update autogen library version in notebooks

* update autogen library version in notebooks
2024-01-07 01:41:33 +00:00
Ikko Eltociear Ashimine
7c2c923443
Update tutorial.ipynb (#1119)
runnning -> running
2024-01-03 05:16:37 +00:00
Dragos Campean
98d148046b
[AutoGen Studio] Allow multiline strings in chat input (#1105)
* [AutoGen Studio] Allow multiline strings in chat input

* make cogicon spin/animate during loading. minor fix to header issue.

---------

Co-authored-by: Victor Dibia <victordibia@microsoft.com>
2024-01-03 00:24:24 +00:00
brotsky
f39c3a7355
dev alias for frontend develop (#1083)
Co-authored-by: Victor Dibia <victordibia@microsoft.com>
2023-12-30 13:43:10 +00:00
Ram Rachum
70cc1f439d
Fix exception causes all over the codebase (#1014) 2023-12-25 20:15:38 +00:00
Victor Dibia
26b7aff2dc
Update AutoGen Sample App | Rename AutoGen Assistant -> AutoGen Studio (#998)
* add new autogen-studio renamed folder

* remove old autogen-assistant files

* formatting updates

* add support for upsert/updates to agents and workflows

* version bump, general fixes

* support deleting db items

* add support for summary method to flowmanager

* formatting updates

* update serverl urls

* version bump

* add support for updated metadata messages object to include sender information

* formatting updates

* update documentation and blog post

* blog post update

* add description field example to agent workflow spec

* readme and blog update

* Update website/blog/2023-12-01-AutoGenStudio/index.mdx

Co-authored-by: Chi Wang <wang.chi@microsoft.com>

* add fix to ensure working directory is cleared after each run

* update version

* minor updates

* formatting updates

---------

Co-authored-by: Chi Wang <wang.chi@microsoft.com>
2023-12-24 12:20:59 +00:00
KazooTTT
a122ffe541
Fix/typo (#1034)
* fix: typo

* fix: typo

* fix: typo of function name

* fix: typo of function name of test file

* Update test_token_count.py

---------

Co-authored-by: Eric Zhu <ekzhu@users.noreply.github.com>
2023-12-22 16:00:46 +00:00
Yiran Wu
aa946b3507
Add MATH tests to testbed (#914)
* add MATH eval to testbed

* update

---------

Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>
2023-12-18 14:37:28 +00:00
Dragos Campean
056bf0154b
Add missing assistant UI documentation steps (#935)
* Add missing assistant UI documentation steps

* Format documentation page for consistency

* Add missing step for installing the autogenra library
2023-12-18 03:18:52 +00:00
Kartik Mandaville
67ca9969df
fixed a typo fron -> from (#992) 2023-12-15 21:48:33 +00:00
afourney
4dcb41531f
Allow users to specify the Docker image to use with Testbed (#986)
* Allow users to specify the Docker image to use (or build a good AutoGen default image if not specified).

* Added lmm and graphs to dockerfile
2023-12-15 20:37:22 +00:00
LeoLjl
2ee944df37
Add collate file and more tests from autogpt into testbed (#915)
* Add collate file.

* Add requirements.txt, Fix typo, Add tests

* More tests.

* Update check.py

* Update scenario.py

* Update prepare_autogpt.py

* Update prepare_autogpt.py

* More tasks for testset.

* Add more tests.

* Update docs.

* Optimize file organize.
2023-12-14 16:26:30 +00:00
danyrouh
3a768c3189
Simple chat app (#921)
* Add file

Initial implementation

* Add file

Implementation

* 1. update readme 2. update web example 3. update code

* update readme

* remove working dir

* update

---------

Co-authored-by: “skzhang1” <“shaokunzhang529@gmail.com”>
Co-authored-by: Shaokun Zhang <shaokunzhang529@gmail.com>
2023-12-12 01:27:40 +00:00
afourney
f8b4b4259b
Adds the GAIA benchark to the Testbed. This PR depends on #792 (#810)
* Re-added completion logging when using older versions of autogen.

* Extended scenario definitions and templating to include folders.

* Prepare collate_human_eval.py for working with group chat scenarios.

* Converted HumanEval to the folder-based approach, and added GroupChat scenarios.

* Fixed the default termination message.

* Fixed another termination condition.

* Updated compatible autogen versions.

* Added initial support for GAIA benchmark.

* Fixed a bug in executing the finalize scripts.

* Generalized the template further to support multiple folder copy operations.

* Refined GAIA support, and broke scenarios down by difficulty.

* Added some experimental scripts for computing metrics over GAIA. This is a first version, and will likely need refinement.

* Added instructions for cloning GAIA

* Updated README to fix some typos.

* Added a script to format GAIA reslts for the leaderboard.

* Update samples/tools/testbed/scenarios/GAIA/Templates/BasicTwoAgents/scenario.py

Co-authored-by: LeoLjl <3110503618@qq.com>

---------

Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>
Co-authored-by: LeoLjl <3110503618@qq.com>
2023-12-06 01:46:10 +00:00
afourney
a107233e23
Testbed can now read the OPENAI_API_KEY in addition to the OAI_CONFIG_LIST (#848)
Co-authored-by: Victor Dibia <victordibia@microsoft.com>
2023-12-04 22:14:00 +00:00
Victor Dibia
5547e3b919
Improvements to AutoGen Assistant (#828)
* improve template for files, integreate files in db

* ui update, improvements to file display grid

* add new global skill for image generation

* update readme to address #739

* utils.py refactor, separate db uitls for ease of development

* db utils

* add support for sessions both in backend api and ui

* improve implementation for session support

* add early v1 support for a gallery and publishing to a gallery

* rewrite logic for file storage representation. Store only file references on in db

* update generate image logic

* update ui layout

* fix light dark mode bug

* v1 support for showing items added to gallery

* remove viewer as it is merged in gallery

* formatting updates

* QOL refactoring

* readme and general updates

* add example notebook on assistant api

* imporve naming conventions and formatting

* readme update

* Update samples/apps/autogen-assistant/pyproject.toml

Co-authored-by: Chi Wang <wang.chi@microsoft.com>

* Update samples/apps/autogen-assistant/notebooks/tutorial.ipynb

Co-authored-by: Chi Wang <wang.chi@microsoft.com>

---------

Co-authored-by: Chi Wang <wang.chi@microsoft.com>
2023-12-02 00:22:02 +00:00
afourney
45c2a78970
Testbed folders (#792)
* Re-added completion logging when using older versions of autogen.

* Extended scenario definitions and templating to include folders.

* Prepare collate_human_eval.py for working with group chat scenarios.

* Converted HumanEval to the folder-based approach, and added GroupChat scenarios.

* Fixed the default termination message.

* Fixed another termination condition.

* Updated compatible autogen versions.

* Fixed a bug in executing the finalize scripts.

* Generalized the template further to support multiple folder copy operations.

* Add tests from AutoGPT.

* Update README.md

* Fix typo

* Update samples/tools/testbed/README.md

---------

Co-authored-by: LeoLjl <3110503618@qq.com>
Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>
2023-11-30 16:43:03 +00:00
Victor Dibia
143e49c6e8
Sample Web Application Built with AutoGen (#695)
* Adding research assistant code

* Adding research assistant code

* checking in RA files

* Remove used text file

* Update README.md to include Saleema's name to the Contributors list.

* remove extraneous files

* update gitignore

* improve structure on global skills

* fix linting error

* readme update

* readme update

* fix wrong function bug

* readme update

* update ui build

* cleanup, remove unused modules

* readme and docs updates

* set default user

* ui build update

* add screenshot to improve instructions

* remove logout behaviour, replace with note to developers to add their own logout logic

* Create blog and edit ARA README

* Added the stock prices example in the readme for ARA

* Include edits from review with Saleema

* fix format issues

* Cosmetic changes for betting debug messages

* edit authors

* remove references to request_timeout to support autogen v0.0.2

* update bg color for UI

* readme update

* update research assistant blog post

* omit samples folder from codecov

* ui build update + precommit refactor

* formattiing updates  fromo pre-commit

* readme update

* remove compiled source files

* update gitignore

* refactor, file removals

* refactor for improved structure - datamodel, chat and db helper

* update gitignore

* refactor, file removals

* refactor for improved structure - datamodel, chat and db helper

* refactor skills view

* general refactor

* gitignore update and general refactor

* skills update

* general refactor

* ui folder structure refactor

* improve support for skills loading

* add fetch profile default skill

* refactor chat to autogenchat

* qol refactor

* improve metadata display

* early support for autogenflow in ui

* docs update general refactor

* general refactor

* readme update

* readme update

* readme and cli update

* pre-commit updates

* precommit update

* readme update

* add steup.py for older python build versions

* add manifest.in, update app icon

* in-progress changes to agent specification

* remove use_cache refs

* update datamodel, and fix for default serverurl

* request_timeout

* readme update, fix autogen values

* fix pyautogen version

* precommit formatting and other qol items

* update folder structure

* req update

* readme and docs update

* docs update

* remove duplicate in yaml file

* add support for explicit skills addition

* readme and documentation updates

* general refactor

* remove blog post, schedule for future PR

* readme update, add info on llmconfig

* make use_cache False by default unless set

* minor ui updates

* upgrade ui to use latest uatogen lib version 0.2.0b5

* Ui refactor, support for adding arbitrary model specifications

* formatting/precommit checks

* update readme, utils default skill

---------

Co-authored-by: Piali Choudhury <pialic@microsoft.com>
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
2023-11-20 18:40:30 +00:00
afourney
f790109271
Re-added completion logging when using older versions of autogen. (#701) 2023-11-18 17:11:25 +00:00
afourney
b0a6d72b8c
Addresses issue 635, relating to newlines in Windows. (#678) 2023-11-15 22:27:10 +00:00
afourney
72f488e4d7
Allows users to specify a different requirements.txt file to install in Docker, to test other versions or branches of Autogen. Closes #662 (#671) 2023-11-15 00:33:09 +00:00
afourney
c37453735a
Sets the umask before executing the task in Docker. (#593)
* Sets the umask before executing the task in Docker.

* Added version backward compatibility for disabling cache and setting timeouts.
2023-11-14 21:14:38 +00:00
afourney
1c4a5e6a1a
Added a simple Testbed tool for repeatedly running templated Autogen scenarios with tightly-controlled initial conditions. (#455)
* Initial commit of the autogen testbed environment.

* Fixed some typos in the Testbed README.md

* Added some stricter termination logic to the two_agent scenario, and swiched the logo task from finding Autogen's logo, to finding Microsoft's (it's easier)

* Added documentation to testbed code in preparation for PR

* Added a variation of HumanEval to the Testbed. It is also a reasonable example of how to integrate other benchmarks.

* Removed ChatCompletion.start_logging and related features. Added an explicit TERMINATE output to HumanEval to save 1 turn in each conversation.

* Added metrics utils script for HumanEval

* Updated the requirements in the README.

* Added documentation for HumanEval csv schemas

* Standardized on how the OAI_CONFIG_LIST is handled.

* Removed dot-slash from 'includes' path for cross-platform compatibility

* Missed a file.

* Updated readme to include known-working versions.
2023-11-04 10:38:43 +00:00