Rule-based Masking
method
ID: rulebasedmasking
Related Papers
Neural Mask Generator: Learning to Generate Adaptive Word Maskings for Language Model Adaptation
AbstractWe propose a method to automatically generate a domain- and task-adaptive maskings of the given text for self-supervised pre-training, such that we can effectively adapt the language model to a …...