Электр
method
ID: electric
Related Papers
Pre-Training Transformers as Energy-Based Cloze Models
AbstractWe introduce Electric, an energy-based cloze model for representation learning over text. Like BERT, it is a conditional generative model of tokens given their contexts. However, Electric does not use …...