QDS Трансформер
method
ID: qdstransformer
Related Papers
Long Document Ranking with Query-Directed Sparse Transformer
AbstractThe computing cost of transformer self-attention often necessitates breaking long documents to fit in pretrained models in document ranking tasks. In this paper, we design Query-Directed Sparse attention that induces …...