Эффективность вывода
metric
ID: inferenceefficiency
Related Papers
Autoregressive Reasoning over Chains of Facts with Transformers
AbstractThis paper proposes an iterative inference algorithm for multi-hop explanation regeneration, that retrieves relevant factual evidence in the form of text snippets, given a natural language question and its answer. …...
Almost Free Semantic Draft for Neural Machine Translation
AbstractTranslation quality can be improved by global information from the required target sentence because the decoder can understand both past and future information. However, the model needs additional cost to …...
Sparsifying Transformer Models with Trainable Representation Pooling
AbstractWe propose a novel method to sparsify attention in the Transformer model by learning to select the most-informative token representations during the training process, thus focusing on the task-specific parts …...