Dynamic Pooling

Recently, there is rising interest in modelling the interactions of two sentences with deep neural networks. However, most of the exist- ing methods encode two sequences with sepa- rate encoders, …...

AbstractTransformers achieve unrivalled performance in modelling language, but remain inefficient in terms of memory and time complexity. A possible remedy is to reduce the sequence length in the intermediate layers …...