Скорость вывода

metric ID: inferencespeed

Related Papers

Simple and Effective Text Matching with Richer Alignment Features

Authors: nan

Publication: TIPSTER (2019)

DOI: nan

AbstractIn this paper, we present a fast and strong neural approach for general purpose text matching applications. We explore what is sufficient to build a fast and well-performed text matching …...

39499

Simplify the Usage of Lexicon in Chinese NER

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractRecently, many works have tried to augment the performance of Chinese named entity recognition (NER) using word lexicons. As a representative, Lattice-LSTM has achieved new benchmark results on several public …...

37450

Defending Pre-trained Language Models from Adversarial Word Substitution Without Performance Sacrifice

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

Pre-trained contextualized language models (PrLMs) have led to strong performance gains in downstream natural language understand- ing tasks. However, PrLMs can still be easily fooled by adversarial word substitution, which …...

33896

Improving Non-Autoregressive Neural Machine Translation via Modeling Localness

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractNon-autoregressive translation (NAT) models, which eliminate the sequential dependencies within the target sentence, have achieved remarkable inference speed, but suffer from inferior translation quality. Towards exploring the underlying causes, we …...

4761

The RoyalFlush System for the WMT 2022 Efficiency Task

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractThis paper describes the submission of the RoyalFlush neural machine translation system for the WMT 2022 translation efficiency task. Unlike the commonly used autoregressive translation system, we adopted a two-stage …...

27488

Two-Step Question Retrieval for Open-Domain QA

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractThe retriever-reader pipeline has shown promising performance in open-domain QA but suffers from a very slow inference speed. Recently proposed question retrieval models tackle this problem by indexing question-answer pairs …...

32774

Parameter-Efficient Fine-Tuning without Introducing New Latency

Authors: nan

Publication: TIPSTER (2023)

DOI: nan

AbstractParameter-efficient fine-tuning (PEFT) of pre-trained language models has recently demonstrated remarkable achievements, effectively matching the performance of full fine-tuning while utilizing significantly fewer trainable parameters, and consequently addressing the storage …...

38629

RE-Matching: A Fine-Grained Semantic Matching Method for Zero-Shot Relation Extraction

Authors: nan

Publication: TIPSTER (2023)

DOI: nan

AbstractSemantic matching is a mainstream paradigm of zero-shot relation extraction, which matches a given input with a corresponding label description. The entities in the input should exactly match their hypernyms …...

38494