Matrix Sketching
otherentity
ID: matrixsketching
Related Papers
Sketching as a Tool for Understanding and Accelerating Self-attention for Long Sequences
AbstractTransformer-based models are not efficient in processing long sequences due to the quadratic space and time complexity of the self-attention modules. To address this limitation, Linformer and Informer reduce the …...