97 Commits

Author SHA1 Message Date
Shaokun
10303854e2
Update website/docs/Examples/Tune-Lexicographic-objectives.md
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
2022-12-07 13:04:55 -05:00
Shaokun
28c7626e99
Update Tune-Lexicographic-objectives.md 2022-12-07 10:57:33 -05:00
skzhang1
5adce62857 update 2022-12-06 20:42:06 -05:00
Mark Harley
44ddf9e104
Refactor into automl subpackage (#809)
* Refactor into automl subpackage

Moved some of the packages into an automl subpackage to tidy before the
task-based refactor. This is in response to discussions with the group
and a comment on the first task-based PR.

Only changes here are moving subpackages and modules into the new
automl, fixing imports to work with this structure and fixing some
dependencies in setup.py.

* Fix doc building post automl subpackage refactor

* Fix broken links in website post automl subpackage refactor

* Fix broken links in website post automl subpackage refactor

* Remove vw from test deps as this is breaking the build

* Move default back to the top-level

I'd moved this to automl as that's where it's used internally, but had
missed that this is actually part of the public interface so makes sense
to live where it was.

* Re-add top level modules with deprecation warnings

flaml.data, flaml.ml and flaml.model are re-added to the top level,
being re-exported from flaml.automl for backwards compatability. Adding
a deprecation warning so that we can have a planned removal later.

* Fix model.py line-endings

* Pin pytorch-lightning to less than 1.8.0

We're seeing strange lightning related bugs from pytorch-forecasting
since the release of lightning 1.8.0. Going to try constraining this to
see if we have a fix.

* Fix the lightning version pin

Was optimistic with setting it in the 1.7.x range, but that isn't
compatible with python 3.6

* Remove lightning version pin

* Revert dependency version changes

* Minor change to retrigger the build

* Fix line endings in ml.py and model.py

Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>
Co-authored-by: EgorKraevTransferwise <egor.kraev@transferwise.com>
2022-12-06 15:46:08 -05:00
Chi Wang
92b79221b6
make performance test reproducible (#837)
* make performance test reproducible

* fix test error

* Doc update and disable logging

* document random_state and version

* remove hardcoded budget

* fix test error and dependency; close #777

* iloc
2022-12-06 10:13:39 -08:00
Shreyas
3b3b0bfa8e
roc_auc_weighted metric addition (#827)
* Pending changes exported from your codespace

* Update flaml/automl.py

Co-authored-by: Chi Wang <wang.chi@microsoft.com>

* Update flaml/automl.py

Co-authored-by: Chi Wang <wang.chi@microsoft.com>

* Update flaml/ml.py

Co-authored-by: Chi Wang <wang.chi@microsoft.com>

* Update flaml/ml.py

Co-authored-by: Chi Wang <wang.chi@microsoft.com>

* Update website/docs/Examples/Integrate - Scikit-learn Pipeline.md

Co-authored-by: Chi Wang <wang.chi@microsoft.com>

* added documentation for new metric

* Update flaml/ml.py

Co-authored-by: Chi Wang <wang.chi@microsoft.com>

* minor notebook changes

* Update Integrate - Scikit-learn Pipeline.md

* Update notebook/automl_classification.ipynb

Co-authored-by: Chi Wang <wang.chi@microsoft.com>

* Update integrate_azureml.ipynb

Co-authored-by: Chi Wang <wang.chi@microsoft.com>
2022-12-02 19:27:32 -08:00
Chi Wang
595af7a04f
install editable package in codespace (#826)
* install editable package in codespace

* fix test error in test_forecast

* fix test error in test_space

* openml version

* break tests; pre-commit

* skip on py10+win32

* install mlflow in test

* install mlflow in [test]

* skip test in windows

* import

* handle PermissionError

* skip test in windows

* skip test in windows

* skip test in windows

* skip test in windows

* remove ts_forecast_panel from doc
2022-11-27 14:22:54 -05:00
Shaokun Zhang
586afe0d6b
fix typo (#823) 2022-11-22 11:58:02 -05:00
Sayan Roy
289f4d61d3
Merge branch 'microsoft:main' into main 2022-11-07 01:34:15 +05:30
Sayan Roy
f1d4adf4ff
limiting the scope to tabular data.
limiting the scope to tabular data.
2022-11-07 01:29:12 +05:30
zsk
958432190f
Merge branch 'main' into main 2022-11-04 23:07:13 -04:00
ElinaAndreeva
723662c502 Fixed typo 2022-11-04 12:06:07 +04:00
satya-vinay
ddebfaea1c Removed extra | in documentation 2022-11-03 13:30:42 +05:30
Nicolas Beltran-Velez
65ad6508ce
Docs (#765)
* Small docstring change for clarity

* Added tentative changes to docs

* Update website/docs/Use-Cases/Task-Oriented-AutoML.md

Co-authored-by: Chi Wang <wang.chi@microsoft.com>

* Update flaml/model.py

Co-authored-by: Chi Wang <wang.chi@microsoft.com>

* Updated model.py to reflect `n_jobs = None` suggestion

* Updated tutorial to reflect `n_jobs=None` suggestion

* Update model.py

Improved string

Co-authored-by: Chi Wang <wang.chi@microsoft.com>
Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>
2022-11-01 15:14:08 -04:00
evensure
4d4e6ba499
Added hint to escape brackets for pip setup
As described in #777, I had trouble executing the setup using zsh.
Eventually, I noticed that I had to escape the brackets.

My proposed change includes both brackets to be escaped, however for me it was enough to escape the opening one only, since as far as I know a trailing non-escaped closing bracket will then be recognized, accordingly.
2022-10-31 17:51:11 +01:00
Kirito
b63f1bc8b8
Indentation corrected (#778) 2022-10-29 21:15:46 -07:00
Anonymous-submission-repo
79c479ae46 update 2022-10-18 23:18:09 +00:00
Anonymous-submission-repo
2f8f8ba9d8 update 2022-10-18 14:48:04 +00:00
Anonymous-submission-repo
e42cfabf21 fix 2022-10-18 13:45:23 +00:00
Anonymous-submission-repo
0869e9e99a clean up 2022-10-18 13:33:37 +00:00
Anonymous-submission-repo
2daaa4c637 clean up 2022-10-15 03:53:08 +00:00
Anonymous-submission-repo
44883f7463 update 2022-10-15 03:42:23 +00:00
Anonymous-submission-repo
30520da559
Update website/docs/Use-Cases/Tune-User-Defined-Function.md
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
2022-10-14 22:51:50 -04:00
Anonymous-submission-repo
0257f3df46 update 2022-10-15 00:28:50 +00:00
Anonymous-submission-repo
a1d9e333fe update 2022-10-14 23:48:05 +00:00
Anonymous-submission-repo
585bde1ce6 Merge branch 'LexiFlow' of https://github.com/Anonymous-submission-repo/FLAML into LexiFlow 2022-10-14 20:43:50 +00:00
Anonymous-submission-repo
bf81912f09 update 2022-10-14 20:40:49 +00:00
Chi Wang
cafb67123a
Merge branch 'main' into LexiFlow 2022-10-14 11:04:18 -07:00
Susan Xueqing Liu
2ebddd67ae
Remove NLP classification head (#756)
* rm classification head in nlp

* rm classification head in nlp

* rm classification head in nlp

* adding test cases for switch classification head

* adding test cases for switch classification head

* Update test/nlp/test_autohf_classificationhead.py

Co-authored-by: Chi Wang <wang.chi@microsoft.com>

* adding test cases for switch classification head

* run each test separately

* skip classification head test on windows

* disabling wandb reporting

* fix test nlp custom metric

* fix test nlp custom metric

* fix test nlp custom metric

* fix test nlp custom metric

* fix test nlp custom metric

* fix test nlp custom metric

* fix test nlp custom metric

* fix test nlp custom metric

* fix test nlp custom metric

* fix test nlp custom metric

* fix test nlp custom metric

* Update website/docs/Examples/AutoML-NLP.md

Co-authored-by: Chi Wang <wang.chi@microsoft.com>

* Update website/docs/Examples/AutoML-NLP.md

Co-authored-by: Chi Wang <wang.chi@microsoft.com>

* fix test nlp custom metric

Co-authored-by: Chi Wang <wang.chi@microsoft.com>
2022-10-12 17:04:42 -07:00
Anonymous-submission-repo
2d18c49cdd update 2022-10-12 04:31:51 +00:00
Anonymous-submission-repo
c8d52ab3ae Merge branch 'main' into LexiFlow 2022-10-10 13:40:59 +00:00
Anonymous-submission-repo
e2c8c3544f doc 2022-10-10 01:17:42 +00:00
Chi Wang
f97c233dc5
Update Contribute (#741) 2022-10-09 11:40:45 -07:00
Anonymous-submission-repo
9bc32acafb first 2022-10-09 11:39:29 -04:00
Jason Swinehart
74557472ec
Fix issue 728 add hyperlink to GitHub location (#731)
* added hyperlink to github of example code
2022-09-14 10:01:12 -07:00
Vijaya Lakshmi Venkatraman
a89efb552f
Update Contribute.md (#716)
Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>
2022-09-08 00:20:23 -04:00
Chi Wang
e5c8a16fab Update Research.md 2022-08-22 18:17:07 -07:00
Qingyun Wu
f3bfc68412
talks and tutorials (#694) 2022-08-22 00:02:10 -04:00
Chi Wang
47e034d203
LightGBM notebook update (#690)
* version update in notebook

* comment about optuna install

* monotone constraints
2022-08-20 07:43:06 -07:00
Qingyun Wu
e3d26c0650
add guideline collection (#687)
* add guideline collection

* remove redundancy
2022-08-20 09:18:35 -04:00
Qingyun Wu
8b3c6e4d7b
VW version requirement and documentation on config_constraints vs metric_constraints (#686)
* add vw version requirement

* vw version

* version range

* add documentation

* vw version range

* skip test on py3.10

* vw version

* rephrase

* don't install vw on py 3.10

* move import location

* remove inherit

* 3.10 in version

Co-authored-by: Chi Wang <wang.chi@microsoft.com>
2022-08-15 20:16:11 -07:00
Kevin Chen
2e8e3937ef
update time series forecast notebook (#682)
* update forecasting with exogeneous variables example

Signed-off-by: Kevin Chen <chenkevin.8787@gmail.com>

* update forecasting with exogeneous variables example on website

Signed-off-by: Kevin Chen <chenkevin.8787@gmail.com>

* rerun automl_time_series_forecast with new predict function for tft

Signed-off-by: Kevin Chen <chenkevin.8787@gmail.com>

* correct spelling error

Signed-off-by: Kevin Chen <chenkevin.8787@gmail.com>

Signed-off-by: Kevin Chen <chenkevin.8787@gmail.com>
2022-08-13 18:58:45 -07:00
jmrichardson
e43485607a
Disable shuffle for custom CV (#659)
* Disable shuffle for custom CV

* Add custom fold shuffle test

* Update test_split.py

* Update test_split.py
2022-08-12 17:05:32 -07:00
Kevin Chen
f718d18b5e
time series forecasting with panel datasets (#541)
* time series forecasting with panel datasets
- integrate Temporal Fusion Transformer as a learner based on pytorchforecasting

Signed-off-by: Kevin Chen <chenkevin.8787@gmail.com>

* update setup.py

Signed-off-by: Kevin Chen <chenkevin.8787@gmail.com>

* update test_forecast.py

Signed-off-by: Kevin Chen <chenkevin.8787@gmail.com>

* update setup.py

Signed-off-by: Kevin Chen <chenkevin.8787@gmail.com>

* update setup.py

Signed-off-by: Kevin Chen <chenkevin.8787@gmail.com>

* update model.py and test_forecast.py
- remove blank lines

Signed-off-by: Kevin Chen <chenkevin.8787@gmail.com>

* update model.py to prevent errors

Signed-off-by: Kevin Chen <chenkevin.8787@gmail.com>

* update automl.py and data.py
- change forecast task name
- update documentation for fit() method

Signed-off-by: Kevin Chen <chenkevin.8787@gmail.com>

* update test_forecast.py

Signed-off-by: Kevin Chen <chenkevin.8787@gmail.com>

* update test_forecast.py
- add performance test
- use 'fit_kwargs_by_estimator'

Signed-off-by: Kevin Chen <chenkevin.8787@gmail.com>

* add time index function

Signed-off-by: Kevin Chen <chenkevin.8787@gmail.com>

* update test_forecast.py performance test

Signed-off-by: Kevin Chen <chenkevin.8787@gmail.com>

* update data.py

Signed-off-by: Kevin Chen <chenkevin.8787@gmail.com>

* update automl.py

Signed-off-by: Kevin Chen <chenkevin.8787@gmail.com>

* update data.py to prevent type error

Signed-off-by: Kevin Chen <chenkevin.8787@gmail.com>

* update setup.py

Signed-off-by: Kevin Chen <chenkevin.8787@gmail.com>

* update for pytorch forecasting tft on panel datasets

Signed-off-by: Kevin Chen <chenkevin.8787@gmail.com>

* update automl.py documentations

Signed-off-by: Kevin Chen <chenkevin.8787@gmail.com>

* - rename estimator
- add 'gpu_per_trial' for tft estimator

Signed-off-by: Kevin Chen <chenkevin.8787@gmail.com>

* update test_forecast.py

Signed-off-by: Kevin Chen <chenkevin.8787@gmail.com>

* include ts panel forecasting as an example

Signed-off-by: Kevin Chen <chenkevin.8787@gmail.com>

* update model.py

Signed-off-by: Kevin Chen <chenkevin.8787@gmail.com>

* update documentations

Signed-off-by: Kevin Chen <chenkevin.8787@gmail.com>

* update automl_time_series_forecast.ipynb

Signed-off-by: Kevin Chen <chenkevin.8787@gmail.com>

* update documentations

Signed-off-by: Kevin Chen <chenkevin.8787@gmail.com>

* "weights_summary" argument deprecated and removed for pl.Trainer()

Signed-off-by: Kevin Chen <chenkevin.8787@gmail.com>

* update model.py tft estimator prediction method

Signed-off-by: Kevin Chen <chenkevin.8787@gmail.com>

* update model.py

Signed-off-by: Kevin Chen <chenkevin.8787@gmail.com>

* update `fit_kwargs` documentation

Signed-off-by: Kevin Chen <chenkevin.8787@gmail.com>

* update automl.py

Signed-off-by: Kevin Chen <chenkevin.8787@gmail.com>

Signed-off-by: Kevin Chen <chenkevin.8787@gmail.com>
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
2022-08-12 08:39:22 -07:00
Qingyun Wu
b436459e47
Documentation on search space and parallel/sequential tuning (#675)
* add search space doc

* remove redundancy

* add parallel and sequential guidelines

* add caveats

* update doc

* add code example

* wording

* revise example

* add a tutorial link in readme

* wording change

* update readme

* remove redundancy

* Update website/docs/Use-Cases/Task-Oriented-AutoML.md

Co-authored-by: Xueqing Liu <liususan091219@users.noreply.github.com>

* Update website/docs/Use-Cases/Task-Oriented-AutoML.md

Co-authored-by: Xueqing Liu <liususan091219@users.noreply.github.com>

Co-authored-by: Xueqing Liu <liususan091219@users.noreply.github.com>
2022-08-12 01:17:31 -04:00
Xueqing Liu
809639f723
Update Research.md (#672)
* Update Research.md

Update Research.md

* Update website/docs/Research.md

Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>

* Update Research.md

Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>
2022-08-11 23:16:33 -04:00
Rui Zhuang
b6e8b9ccca
Add pipeline tuner component and dependencies. (#671)
* add pipeline tuner component and dependencies.

* clean code.

* do not need force rerun.

* replace the resources.

* update metrics retrieving.

* Update test/pipeline_tuning_example/requirements.txt

* Update test/pipeline_tuning_example/train/env.yaml

* Update test/pipeline_tuning_example/tuner/env.yaml

* Update test/pipeline_tuning_example/tuner/tuner_func.py

* Update test/pipeline_tuning_example/data_prep/env.yaml

* fix issues found by lint with flake8.

* add documentation

* add data.

* do not need AML resource for local run.

* AML -> AzureML

* clean code.

* Update website/docs/Examples/Tune-AzureML pipeline.md

* rename and add pip install.

* update figure name.

* align docs with code.

* remove extra line.
2022-08-10 20:20:21 -07:00
Xueqing Liu
5eb5d43d7f
Fix HPO evaluation bug (#645)
* fix eval automl metric bug on val_loss inconsistency

* updating starting point search space to continuous

* shortening notebok
2022-07-28 23:08:42 -04:00
Luis Quintanilla
d649fefa6b
Update .NET documentation (#643)
* Updated install instructions

* Update website/docs/Installation.md

* Updated install and README
2022-07-26 16:53:49 -07:00
skzhang1
d88c7390ce ignore engine 2022-07-21 14:48:21 -04:00