Long Document Summarization
task
ID: longdocumentsummarization
Related Papers
Globalizing BERT-based Transformer Architectures for Long Document Summarization
AbstractFine-tuning a large language model on downstream tasks has become a commonly adopted process in the Natural Language Processing (NLP) (CITATION). However, such a process, when associated with the current …...
ReadOnce Transformers: Reusable Representations of Text for Transformers
AbstractWe present ReadOnce Transformers, an approach to convert a transformer-based model into one that can build an information-capturing, task-independent, and compressed representation of text. The resulting representation is reusable across …...
Sparsifying Transformer Models with Trainable Representation Pooling
AbstractWe propose a novel method to sparsify attention in the Transformer model by learning to select the most-informative token representations during the training process, thus focusing on the task-specific parts …...