Контекстное кондиционирование
method
ID: contextconditioning
Related Papers
What Context Features Can Transformer Language Models Use?
AbstractTransformer-based language models benefit from conditioning on contexts of hundreds to thousands of previous tokens. What aspects of these contexts contribute to accurate model prediction? We describe a series of …...