HyperparameterOptimization

Hyper-parameter optimization is an im- portant problem in natural language pro- cessing (NLP) and machine learning. Re- cently, a group of studies has focused on using sequential Bayesian Optimization to …...

AbstractThe performance of fine-tuning pre-trained language models largely depends on the hyperparameter configuration. In this paper, we investigate the performance of modern hyperparameter optimization methods (HPO) on fine-tuning pre-trained language …...