Cloze Distillation
method
ID: clozedistillation
Related Papers
Cloze Distillation: Improving Neural Language Models with Human Next-Word Prediction
AbstractContemporary autoregressive language models (LMs) trained purely on corpus data have been shown to capture numerous features of human incremental processing. However, past work has also suggested dissociations between corpus …...