Сэндвич-трансформатор
method
ID: sandwichtransformer
Related Papers
Improving Transformer Models by Reordering their Sublayers
AbstractMultilayer transformer networks consist of interleaved self-attention and feedforward sublayers. Could ordering the sublayers in a different pattern lead to better performance? We generate randomly ordered transformers and train them …...