Recurrence Memory
method
ID: recurrencememory
Related Papers
LaMemo: Language Modeling with Look-Ahead Memory
AbstractAlthough Transformers with fully connected self-attentions are powerful to model long-term dependencies, they are struggling to scale to long texts with thousands of words in language modeling. One of the …...