Shortformer: Better Language Modeling using Shorter Inputs

8270

Knowledge Triples

Source Entity	Relationship	Target Entity
Position Embeddings Material	improves	Recurrence Methods Method
Recurrence Methods Method	enhances	Transformers Method
WikiText 103 Material	usedIn	Language Modeling Task