Контекстуалды кодтаушыларды алдын ала оқыту
method
ID: pretrainingcontextualizedencoders
Related Papers
An Empirical Exploration of Local Ordering Pre-training for Structured Prediction
AbstractRecently, pre-training contextualized encoders with language model (LM) objectives has been shown an effective semi-supervised method for structured prediction. In this work, we empirically explore an alternative pre-training method for …...