* update colab link
* typo
* upload file instruction
* update system message and notebooks
* update notebooks
* notebook test
* aoai api version and exclusion
* gpt-3.5-turbo
* dict check
* change model for test
* endpoints, cache_path and func description update
* model list
* gitter -> discord
* add funccall example and doc
* revise to comments
* Update website/docs/Use-Cases/Auto-Generation.md
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
* revise
* update
* minor update
* add test notebook
* update
---------
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
* update funccall
* code format
* update to comments
* update notebook
* remove test for py3.7
* allow funccall to class functions
* add test and clean up notebook
* revise notebook and test
* update
* update mathagent
* Update flaml/autogen/agent/agent.py
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
* Update flaml/autogen/agent/user_proxy_agent.py
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
* revise to comments
* revise function call design, notebook and test. add doc
* code format
* ad message_to_dict function
* update mathproxyagent
* revise docstr
* update
* Update flaml/autogen/agent/math_user_proxy_agent.py
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
* Update flaml/autogen/agent/math_user_proxy_agent.py
Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>
* Update flaml/autogen/agent/user_proxy_agent.py
Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>
* simply funccall in userproxyagent, rewind auto-gen.md, revise to comments
* code format
* update
* remove notebook for another pr
* revise oai_conversation part in agent, revise function exec in user_proxy_agent
* update test_funccall
* update
* update
* fix pydantic version
* Update test/autogen/test_agent.py
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
* fix bug
* fix bug
* update
* update is_termination_msg to accept dict
---------
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>
Co-authored-by: Li Jiang <bnujli@gmail.com>
* add agent notebook and documentation
* fix bug
* set flush to True when printing msg in agent
* add a math problem in agent notebook
* remove
* header
* improve notebook doc
* notebook update
* improve notebook example
* improve doc
* improve notebook doc
* improve print
* doc
* human_input_mode
* human_input_mode str
* indent
* indent
* Update flaml/autogen/agent/user_proxy_agent.py
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
* Update notebook/autogen_agent.ipynb
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
* Update notebook/autogen_agent.ipynb
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
* Update notebook/autogen_agent.ipynb
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
* renaming and doc format
* typo
---------
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
* version update post release v1.2.2
* automl option
* import pandas
* remove automl.utils
* default
* test
* type hint and version update
* dependency update
* link to open in colab
* use packging.version to close#725
---------
Co-authored-by: Li Jiang <lijiang1@microsoft.com>
Co-authored-by: Li Jiang <bnujli@gmail.com>
* response filter
* rewrite implement based on the filter
* multi responses
* abs path
* code handling
* option to not use docker
* context
* eval_only -> raise_error
* notebook
* utils
* utils
* separate tests
* test
* test
* test
* test
* test
* test
* test
* test
* **config in test()
* test
* test
* filename
* math utils in autogen
* cleanup
* code utils
* remove check function from code response
* comment out test
* GPT-4
* increase request timeout
* name
* logging and error handling
* better doc
* doc
* codegen optimized
* GPT series
* text
* no demo example
* math
* import openai
* import openai
* azure model name
* azure model name
* openai version
* generate assertion if necessary
* condition to generate assertions
* init region key
* rename
* comments about budget
* prompt
---------
Co-authored-by: Susan Xueqing Liu <liususan091219@users.noreply.github.com>
* improve max_valid_n and doc
* Update README.md
Co-authored-by: Li Jiang <lijiang1@microsoft.com>
* add support for chatgpt
* notebook
* newline at end of file
* chatgpt notebook
* ChatGPT in Azure
* doc
* math
* warning, timeout, log file name
* handle import error
* doc update; default value
* paper
* doc
* docstr
* eval_func
* add a test func in completion
* update notebook
* update math notebook
* improve notebok
* lint and handle exception
* flake8
* exception in test
* add agg_method
* NameError
* refactor
* Update flaml/integrations/oai/completion.py
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
* Update flaml/integrations/oai/completion.py
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
* add example
* merge files from oai_eval_test
* Revert "merge files from oai_eval_test"
This reverts commit 1e6a550f913bb94df6e9680934ccb7175d00702e.
* merge
* save results to notebook_output
* update version and cache
* update doc
* save nb cell results to file
* fix typo in model name
* code improvements
* improve docstr
* docstr
* docstr on the Returns of test
---------
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
Co-authored-by: Li Jiang <lijiang1@microsoft.com>
Co-authored-by: Susan Xueqing Liu <liususan091219@users.noreply.github.com>
* add basic support to Spark dataframe
add support to SynapseML LightGBM model
update to pyspark>=3.2.0 to leverage pandas_on_Spark API
* clean code, add TODOs
* add sample_train_data for pyspark.pandas dataframe, fix bugs
* improve some functions, fix bugs
* fix dict change size during iteration
* update model predict
* update LightGBM model, update test
* update SynapseML LightGBM params
* update synapseML and tests
* update TODOs
* Added support to roc_auc for spark models
* Added support to score of spark estimator
* Added test for automl score of spark estimator
* Added cv support to pyspark.pandas dataframe
* Update test, fix bugs
* Added tests
* Updated docs, tests, added a notebook
* Fix bugs in non-spark env
* Fix bugs and improve tests
* Fix uninstall pyspark
* Fix tests error
* Fix java.lang.OutOfMemoryError: Java heap space
* Fix test_performance
* Update test_sparkml to test_0sparkml to use the expected spark conf
* Remove unnecessary widgets in notebook
* Fix iloc java.lang.StackOverflowError
* fix pre-commit
* Added params check for spark dataframes
* Refactor code for train_test_split to a function
* Update train_test_split_pyspark
* Refactor if-else, remove unnecessary code
* Remove y from predict, remove mem control from n_iter compute
* Update workflow
* Improve _split_pyspark
* Fix test failure of too short training time
* Fix typos, improve docstrings
* Fix index errors of pandas_on_spark, add spark loss metric
* Fix typo of ndcgAtK
* Update NDCG metrics and tests
* Remove unuseful logger
* Use cache and count to ensure consistent indexes
* refactor for merge maain
* fix errors of refactor
* Updated SparkLightGBMEstimator and cache
* Updated config2params
* Remove unused import
* Fix unknown parameters
* Update default_estimator_list
* Add unit tests for spark metrics
* Refactor into automl subpackage
Moved some of the packages into an automl subpackage to tidy before the
task-based refactor. This is in response to discussions with the group
and a comment on the first task-based PR.
Only changes here are moving subpackages and modules into the new
automl, fixing imports to work with this structure and fixing some
dependencies in setup.py.
* Fix doc building post automl subpackage refactor
* Fix broken links in website post automl subpackage refactor
* Fix broken links in website post automl subpackage refactor
* Remove vw from test deps as this is breaking the build
* Move default back to the top-level
I'd moved this to automl as that's where it's used internally, but had
missed that this is actually part of the public interface so makes sense
to live where it was.
* Re-add top level modules with deprecation warnings
flaml.data, flaml.ml and flaml.model are re-added to the top level,
being re-exported from flaml.automl for backwards compatability. Adding
a deprecation warning so that we can have a planned removal later.
* Fix model.py line-endings
* WIP
* WIP - Notes below
Got to the point where the methods from AutoML are pulled to
GenericTask. Started removing private markers and removing the passing
of automl to these methods. Done with decide_split_type, started on
prepare_data. Need to do the others after
* Re-add generic_task
* Fix tests: add Task.__str__
* Fix tests: test for ray.ObjectRef
* Hotwire TS_Sklearn wrapper to fix test fail
* Remove unused data size field from Task
* Fix import for CLASSIFICATION in notebook
* Update flaml/automl/data.py
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
* Fix review comments
* Fix task -> str in custom learner constructor
* Remove unused CLASSIFICATION imports
* Hotwire TS_Sklearn wrapper to fix test fail by setting
optimizer_for_horizon == False
* Revert changes to the automl_classification and pin FLAML version
* Fix imports in reverted notebook
* Fix FLAML version in automl notebooks
* Fix ml.py line endings
* Fix CLASSIFICATION task import in automl_classification notebook
* Uncomment pip install in notebook and revert import
Not convinced this will work because of installing an older version of
the package into the environment in which we're running the tests, but
let's see.
* Revert c6a5dd1a0
* Revert "Revert c6a5dd1a0"
This reverts commit e55e35adea03993de87b23f092b14c6af623d487.
* Black format model.py
* Bump version to 1.1.2 in automl_xgboost
* Add docstrings to the Task ABC
* Fix import in custom_learner
* fix 'optimize_for_horizon' for ts_sklearn
* remove debugging print statements
* Check for is_forecast() before is_classification() in decide_split_type
* Attempt to fix formatting fail
* Another attempt to fix formatting fail
* And another attempt to fix formatting fail
* Add type annotations for task arg in signatures and docstrings
* Fix formatting
* Fix linting
---------
Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>
Co-authored-by: EgorKraevTransferwise <egor.kraev@transferwise.com>
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
Co-authored-by: Kevin Chen <chenkevin.8787@gmail.com>
* improve max_valid_n and doc
* Update README.md
Co-authored-by: Li Jiang <lijiang1@microsoft.com>
* add support for chatgpt
* notebook
* newline at end of file
* chatgpt notebook
* ChatGPT in Azure
* doc
* math
* warning, timeout, log file name
* handle import error
* doc update; default value
* paper
* doc
* docstr
* eval_func
* prompt and messages
* remove confusing words
* notebook name
---------
Co-authored-by: Li Jiang <lijiang1@microsoft.com>
Co-authored-by: Susan Xueqing Liu <liususan091219@users.noreply.github.com>
* improve max_valid_n and doc
* Update README.md
Co-authored-by: Li Jiang <lijiang1@microsoft.com>
* newline at end of file
* doc
---------
Co-authored-by: Li Jiang <lijiang1@microsoft.com>
Co-authored-by: Susan Xueqing Liu <liususan091219@users.noreply.github.com>
Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>
* add cost budget; move loc of make_dir
* support openai completion
* install pytest in workflow
* skip openai test
* test openai
* path for docs rebuild
* install datasets
* signal
* notebook
* notebook in workflow
* optional arguments and special params
* key -> k
* improve readability
* assumption
* optimize for model selection
* larger range of max_tokens
* notebook
* python package workflow
* skip on win
* notebook test
* add ipykernel, remove except
* only create dir if not empty
* Stop sequential tuning when result is None
* fix reproducibility of global search
* save gs seed
* use get to avoid KeyError
* test
* make performance test reproducible
* fix test error
* Doc update and disable logging
* document random_state and version
* remove hardcoded budget
* fix test error and dependency; close#777
* iloc
* Pending changes exported from your codespace
* Update flaml/automl.py
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
* Update flaml/automl.py
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
* Update flaml/ml.py
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
* Update flaml/ml.py
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
* Update website/docs/Examples/Integrate - Scikit-learn Pipeline.md
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
* added documentation for new metric
* Update flaml/ml.py
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
* minor notebook changes
* Update Integrate - Scikit-learn Pipeline.md
* Update notebook/automl_classification.ipynb
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
* Update integrate_azureml.ipynb
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
* install editable package in codespace
* fix test error in test_forecast
* fix test error in test_space
* openml version
* break tests; pre-commit
* skip on py10+win32
* install mlflow in test
* install mlflow in [test]
* skip test in windows
* import
* handle PermissionError
* skip test in windows
* skip test in windows
* skip test in windows
* skip test in windows
* remove ts_forecast_panel from doc
* added a link to documentation webpage in notebook time_series_forcast
* added a link to documentation webpage in notebook time_series_forcast
* Update notebook/automl_time_series_forecast.ipynb
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
* complete output
* added all cell output
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
Co-authored-by: zsk <shaokunzhang529@gmail.com>
Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>
