Жұмсақ маскалау
method
ID: softmasking
Related Papers
Adapting a Language Model While Preserving its General Knowledge
AbstractDomain-adaptive pre-training (or DA-training for short), also known as post-training, aimsto train a pre-trained general-purpose language model (LM) using an unlabeled corpus of aparticular domain to adapt the LM so …...