Sequence Level Parallelization
task
ID: sequencelevelparallelization
Related Papers
Multi-Head Highly Parallelized LSTM Decoder for Neural Machine Translation
AbstractOne of the reasons Transformer translation models are popular is that self-attention networks for context modelling can be easily parallelized at sequence level. However, the computational complexity of a self-attention …...