Сөз тәртібі туралы ақпарат
otherentity
ID: wordorderinformation
Related Papers
An Empirical Exploration of Local Ordering Pre-training for Structured Prediction
AbstractRecently, pre-training contextualized encoders with language model (LM) objectives has been shown an effective semi-supervised method for structured prediction. In this work, we empirically explore an alternative pre-training method for …...
Word Order Does Matter and Shuffled Language Models Know It
AbstractRecent studies have shown that language models pretrained and/or fine-tuned on randomly permuted sentences exhibit competitive performance on GLUE, putting into question the importance of word order information. Somewhat counter-intuitively, …...