Контекстуализированные языковые модели
method
ID: contextualisedlanguagemodels
Related Papers
Modelling Commonsense Properties Using Pre-Trained Bi-Encoders
AbstractGrasping the commonsense properties of everyday concepts is an important prerequisite to language understanding. While contextualised language models are reportedly capable of predicting such commonsense properties with human-level accuracy, we …...
Unsupervised Attention-based Sentence-Level Meta-Embeddings from Contextualised Language Models
AbstractA variety of contextualised language models have been proposed in the NLP community, which are trained on diverse corpora to produce numerous Neural Language Models (NLMs). However, different NLMs have …...