method ID: informer

Related Papers

∞-former: Infinite Memory Transformer

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractTransformers are unable to model long-term memories effectively, since the amount of computation they need to perform grows with the context length. While variations of efficient transformers have been proposed, …...

39006