yujunjun/autogen
1
0
Fork 0
mirror of https://github.com/microsoft/autogen.git synced 2025-09-08 15:56:13 +00:00
Code Issues Packages Projects Releases Wiki Activity

update notebook

Browse Source
This commit is contained in:
Xueqing Liu 2021-06-23 01:20:16 -04:00 committed by GitHub
parent 83080d94bb
commit da9fc51e62
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 2 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
notebook/research/acl2021.ipynb
View File

@ -774,7 +774,7 @@
" \"learning_rate\": {\"l\": 3e-5, \"u\": 1.5e-4, \"space\": \"log\"},\n",
" \"warmup_ratio\": [0.1],\n",
" \"num_train_epochs\": [3],\n",
" \"per_device_train_batch_size\": [16, 32, 64],\n",
" \"per_device_train_batch_size\": [32],\n",
" \"weight_decay\": [0.0],\n",
" \"attention_probs_dropout_prob\": [0.1],\n",
" \"hidden_dropout_prob\": [0.1],\n",
@ -786,7 +786,7 @@
"cell_type": "markdown",
"metadata": {},
"source": [
"The validation F1/accuracy we got was 93.2/90.4, where the accuracy outperforms grid search. The test F1/accuracy was 90.9/87.4. As a result, random search with 4*GST and the minimal search space `hpo_space_min` has outperformed grid search. We stop the troubleshooting process."
"The validation F1/accuracy we got was 93.5/91.1, where the accuracy outperforms grid search. The test F1/accuracy was 90.1/86.1. As a result, random search with 4*GST and the minimum space overfits. We stop the troubleshooting process because the search space cannot be further reduced."
]
}
],