Предварительно обученная языковая модель с дополненной памятью

AbstractGeneral pre-trained language models (PLMs), such as BERT, have achieved remarkable performance on various NLP tasks. Recently, domain-specific PLMs have been proposed to boost the task performance of specific domains …...