Эффективные внимания
method
ID: efficientattentions
Related Papers
Simple Local Attentions Remain Competitive for Long-Context Tasks
AbstractMany NLP tasks require processing long contexts beyond the length limit of pretrained models. In order to scale these models to longer text sequences, many efficient long-range attention variants have …...