Самонаблюдаемый
method
ID: selfsupervised
Related Papers
Augmenting BERT-style Models with Predictive Coding to Improve Discourse-level Representations
AbstractCurrent language models are usually trained using a self-supervised scheme, where the main focus is learning representations at the word or sentence level. However, there has been limited progress in …...