14 Commits

Author	SHA1	Message	Date
Susan Xueqing Liu	2ebddd67ae	Remove NLP classification head (#756) ... * rm classification head in nlp * rm classification head in nlp * rm classification head in nlp * adding test cases for switch classification head * adding test cases for switch classification head * Update test/nlp/test_autohf_classificationhead.py Co-authored-by: Chi Wang <wang.chi@microsoft.com> * adding test cases for switch classification head * run each test separately * skip classification head test on windows * disabling wandb reporting * fix test nlp custom metric * fix test nlp custom metric * fix test nlp custom metric * fix test nlp custom metric * fix test nlp custom metric * fix test nlp custom metric * fix test nlp custom metric * fix test nlp custom metric * fix test nlp custom metric * fix test nlp custom metric * fix test nlp custom metric * Update website/docs/Examples/AutoML-NLP.md Co-authored-by: Chi Wang <wang.chi@microsoft.com> * Update website/docs/Examples/AutoML-NLP.md Co-authored-by: Chi Wang <wang.chi@microsoft.com> * fix test nlp custom metric Co-authored-by: Chi Wang <wang.chi@microsoft.com>	2022-10-12 17:04:42 -07:00
Xueqing Liu	21fa6c10ec	Fixing the issue that FLAML trial number is significantly smaller than Transformers.hyperparameter_search (#657) ... * fix 636 * adding low cost config * update padding; update tokenization output y type (series -> DF); update low cost init config * updating todf; updating metric_loss_score	2022-08-03 00:11:29 -04:00
Xueqing Liu	6108493e0b	fix ner bug; refactor post processing of TransformersEstimator prediction (#615) ... * fix ner bug; refactor post processing * fix too many values to unpack * supporting id/token label for NER	2022-07-05 13:38:21 -04:00
Xueqing Liu	ca35fa969f	refactoring TransformersEstimator to support default and custom_hp (#511) ... * refactoring TransformersEstimator to support default and custom_hp * handling starting_points not in search space * addressing starting point more than max_iter * fixing upper < lower bug	2022-04-28 14:06:29 -04:00
Xueqing Liu	5f97532986	adding evaluation (#495) ... * adding automl.score * fixing the metric name in train_with_config * adding pickle after score * fixing a bug in automl.pickle	2022-03-25 17:00:08 -04:00
Xueqing Liu	af423463c3	fixing bug for ner (#463) ... * fixing bug for ner * removing global var * adding class for trial counter * adding notebook * adding use_ray dict * updating documentation for nlp	2022-03-20 22:03:02 -04:00
Xueqing Liu	438ccaa0c9	adding catch for HTTP error (#432)	2022-01-29 22:53:32 -08:00
Xueqing Liu	4814091d87	remove redundant imports (#426) ... * remove redundant imports * getting ride of hf dataset	2022-01-24 14:24:14 -08:00
Xueqing Liu	dda4ac90a1	moving intermediate_results logging from model.py to huggingface/trainer.py (#403) ... * replacing val_loss with automl_metric	2022-01-14 17:26:10 -08:00
Chi Wang	569908fbe6	fix issues in logging, bug in space.py, constraint sign, and improve code coverage (#388) ... * console log handler * version update * doc * skippable steps * notebook update * constraint sign * doc for constraints * bug fix: define-by-run and unflatten_hierarchical * const * handle nested space in indexof() * test grid search * test suggestion * model test * >1 ckpts * always increase iter count * log total # iterations * security patch * make iter_per_learner consistent	2022-01-14 13:39:09 -08:00
Xueqing Liu	f41f1c2198	Logging multiple checkpoints (#394)	2022-01-12 19:50:39 -08:00
Chi Wang	612668e8ed	serialize TransformerEstimator (#381) ... * serialize TransformerEstimator * check has_attr * custom metric needs trainer * skip test on mac	2022-01-06 10:28:19 -08:00
Xueqing Liu	b2900f4b22	fixing custom metric (#357) ... * fixing the error for custom metric	2021-12-24 16:23:09 -05:00
Xueqing Liu	dcfd218108	Fixing the bug in custom metric (#356) ... * fixing the bug for custom metric	2021-12-23 18:44:53 -05:00