SparseSelfAttentionFineTuningModel
method
ID: sparseselfattentionfinetuningmodel
Related Papers
Fine-tune BERT with Sparse Self-Attention Mechanism
AbstractIn this paper, we develop a novel Sparse Self-Attention Fine-tuning model (referred as SSAF) which integrates sparsity into self-attention mechanism to enhance the fine-tuning performance of BERT. In particular, sparsity …...