Екі бағытты трансформатор
method
ID: bidirectionaltransformer
Related Papers
LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attention
AbstractEntity representations are useful in natural language tasks involving entities. In this paper, we propose new pretrained contextualized representations of words and entities based on the bidirectional transformer. The proposed …...