Матрицы самовнимания
otherentity
ID: selfattentionmatrices
Related Papers
Predicting Discourse Trees from Transformer-based Neural Summarizers
AbstractPrevious work indicates that discourse information benefits summarization. In this paper, we explore whether this synergy between discourse and summarization is bidirectional, by inferring document-level discourse trees from pre-trained neural …...
Towards Understanding Large-Scale Discourse Structures in Pre-Trained and Fine-Tuned Language Models
AbstractIn this paper, we extend the line of BERTology work by focusing on the important, yet less explored, alignment of pre-trained and fine-tuned PLMs with large-scale discourse structures. We propose …...