Пайдалы ақпарат
metric
ID: usableinformation
Related Papers
What Context Features Can Transformer Language Models Use?
AbstractTransformer-based language models benefit from conditioning on contexts of hundreds to thousands of previous tokens. What aspects of these contexts contribute to accurate model prediction? We describe a series of …...