Ненаблюдаемая предобучение
Related Papers
Unsupervised Pre-training With Seq2Seq Reconstruction Loss for Deep Relation Extraction Models
Relation extraction models based on deep learning have been attracting a lot of at- tention recently. Little research is carried out to reduce their need of labeled training data. In …...
Cross-Domain Training for Goal-Oriented Conversational Agents
AbstractGoal-Oriented Chatbots in fields such as customer support, providing certain information or general help with bookings or reservations, suffer from low performance partly due to the difficulty of obtaining large …...
Multilingual Constituency Parsing with Self-Attention and Pre-Training
AbstractWe show that constituency parsing benefits from unsupervised pre-training across a variety of languages and a range of pre-training conditions. We first compare the benefits of no pre-training, fastText, ELMo, …...
Pretraining Methods for Dialog Context Representation Learning
AbstractThis paper examines various unsupervised pretraining objectives for learning dialog context representations. Two novel methods of pretraining dialog context encoders are proposed, and a total of four methods are examined. …...
UHH-LT at SemEval-2019 Task 6: Supervised vs. Unsupervised Transfer Learning for Offensive Language Detection
AbstractWe present a neural network based approach of transfer learning for offensive language detection. For our system, we compare two types of knowledge transfer: supervised and unsupervised pre-training. Supervised pre-training …...
Maximal Multiverse Learning for Promoting Cross-Task Generalization of Fine-Tuned Language Models
AbstractLanguage modeling with BERT consists of two phases of (i) unsupervised pre-training on unlabeled text, and (ii) fine-tuning for a specific supervised task. We present a method that leverages the …...