Айна WiC
method
ID: mirrorwic
Related Papers
MirrorWiC: On Eliciting Word-in-Context Representations from Pretrained Language Models
AbstractRecent work indicated that pretrained language models (PLMs) such as BERT and RoBERTa can be transformed into effective sentence and word encoders even via simple self-supervised techniques. Inspired by this …...