Нейрондық маска генераторы
method
ID: neuralmaskgenerator
Related Papers
Neural Mask Generator: Learning to Generate Adaptive Word Maskings for Language Model Adaptation
AbstractWe propose a method to automatically generate a domain- and task-adaptive maskings of the given text for self-supervised pre-training, such that we can effectively adapt the language model to a …...