Үздіксіз кеңістік назар
method
ID: continuousspaceattention
Related Papers
∞-former: Infinite Memory Transformer
AbstractTransformers are unable to model long-term memories effectively, since the amount of computation they need to perform grows with the context length. While variations of efficient transformers have been proposed, …...