Скорость вывода
Related Papers
Simple and Effective Text Matching with Richer Alignment Features
AbstractIn this paper, we present a fast and strong neural approach for general purpose text matching applications. We explore what is sufficient to build a fast and well-performed text matching …...
Simplify the Usage of Lexicon in Chinese NER
AbstractRecently, many works have tried to augment the performance of Chinese named entity recognition (NER) using word lexicons. As a representative, Lattice-LSTM has achieved new benchmark results on several public …...
Defending Pre-trained Language Models from Adversarial Word Substitution Without Performance Sacrifice
Pre-trained contextualized language models (PrLMs) have led to strong performance gains in downstream natural language understand- ing tasks. However, PrLMs can still be easily fooled by adversarial word substitution, which …...
Improving Non-Autoregressive Neural Machine Translation via Modeling Localness
AbstractNon-autoregressive translation (NAT) models, which eliminate the sequential dependencies within the target sentence, have achieved remarkable inference speed, but suffer from inferior translation quality. Towards exploring the underlying causes, we …...
The RoyalFlush System for the WMT 2022 Efficiency Task
AbstractThis paper describes the submission of the RoyalFlush neural machine translation system for the WMT 2022 translation efficiency task. Unlike the commonly used autoregressive translation system, we adopted a two-stage …...
Two-Step Question Retrieval for Open-Domain QA
AbstractThe retriever-reader pipeline has shown promising performance in open-domain QA but suffers from a very slow inference speed. Recently proposed question retrieval models tackle this problem by indexing question-answer pairs …...
Parameter-Efficient Fine-Tuning without Introducing New Latency
AbstractParameter-efficient fine-tuning (PEFT) of pre-trained language models has recently demonstrated remarkable achievements, effectively matching the performance of full fine-tuning while utilizing significantly fewer trainable parameters, and consequently addressing the storage …...
RE-Matching: A Fine-Grained Semantic Matching Method for Zero-Shot Relation Extraction
AbstractSemantic matching is a mainstream paradigm of zero-shot relation extraction, which matches a given input with a corresponding label description. The entities in the input should exactly match their hypernyms …...