ConvBERT
method
ID: convbert
Related Papers
Pre-training and Evaluating Transformer-based Language Models for Icelandic
AbstractIn this paper, we evaluate several Transformer-based language models for Icelandic on four downstream tasks: Part-of-Speech tagging, Named Entity Recognition. Dependency Parsing, and Automatic Text Summarization. We pre-train four types …...