Задержка
Related Papers
MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices
AbstractNatural Language Processing (NLP) has recently achieved great success by using huge pre-trained models with hundreds of millions of parameters. However, these models suffer from heavy model sizes and high …...
Simultaneous Translation Policies: From Fixed to Adaptive
AbstractAdaptive policies are better than fixed policies for simultaneous translation, since they can flexibly balance the tradeoff between translation quality and latency based on the current context information. But previous …...
Start-Before-End and End-to-End: Neural Speech Translation by AppTek and RWTH Aachen University
AbstractAppTek and RWTH Aachen University team together to participate in the offline and simultaneous speech translation tracks of IWSLT 2020. For the offline task, we create both cascaded and end-to-end …...
XtremeDistil: Multi-stage Distillation for Massive Multilingual Models
AbstractDeep and large pre-trained language models are the state-of-the-art for various natural language processing tasks. However, the huge size of these models could be a deterrent to using them in …...
Direct Simultaneous Speech-to-Text Translation Assisted by Synchronized Streaming ASR
Simultaneous speech-to-text translation is widely useful in many scenarios. The con- ventional cascaded approach uses a pipeline of streaming ASR followed by simultaneous MT, but suffers from error propagation and …...
Exploiting Multimodal Reinforcement Learning for Simultaneous Machine Translation
AbstractThis paper addresses the problem of simultaneous machine translation (SiMT) by exploring two main concepts: (a) adaptive policies to learn a good trade-off between high translation quality and low latency; …...
Findings of the WMT 2021 Shared Task on Efficient Translation
AbstractThe machine translation efficiency task challenges participants to make their systems faster and smaller with minimal impact on translation quality. How much quality to sacrifice for efficiency depends upon the …...
Large-Scale English-Japanese Simultaneous Interpretation Corpus: Construction and Analyses with Sentence-Aligned Data
AbstractThis paper describes the construction of a new large-scale English-Japanese Simultaneous Interpretation (SI) corpus and presents the results of its analysis. A portion of the corpus contains SI data from …...
Streaming Models for Joint Speech Recognition and Translation
AbstractUsing end-to-end models for speech translation (ST) has increasingly been the focus of the ST community. These models condense the previously cascaded systems by directly converting sound waves into translated …...
Universal Simultaneous Machine Translation with Mixture-of-Experts Wait-k Policy
AbstractSimultaneous machine translation (SiMT) generates translation before reading the entire source sentence and hence it has to trade off between translation quality and latency. To fulfill the requirements of different …...
A Template-based Method for Constrained Neural Machine Translation
AbstractMachine translation systems are expected to cope with various types of constraints in many practical scenarios. While neural machine translation (NMT) has achieved strong performance in unconstrained cases, it is …...
Anticipation-Free Training for Simultaneous Machine Translation
AbstractSimultaneous machine translation (SimulMT) speeds up the translation process by starting to translate before the source sentence is completely available. It is difficult due to limited context and word order …...
CUNI-KIT System for Simultaneous Speech Translation Task at IWSLT 2022
AbstractIn this paper, we describe our submission to the Simultaneous Speech Translation at IWSLT 2022. We explore strategies to utilize an offline model in a simultaneous setting without the need …...
Efficient Cluster-Based k-Nearest-Neighbor Machine Translation
Abstractk-Nearest-Neighbor Machine Translation (kNN-MT) has been recently proposed as a non-parametric solution for domain adaptation in neural machine translation (NMT). It aims to alleviate the performance degradation of advanced MT …...
FiE: Building a Global Probability Space by Leveraging Early Fusion in Encoder for Open-Domain Question Answering
AbstractGenerative models have recently started to outperform extractive models in Open Domain Question Answering, largely by leveraging their decoder to attend over multiple encoded passages and combining their information. However, …...
Pseudo-Relevance for Enhancing Document Representation
AbstractThis paper studies how to enhance the document representation for the bi-encoder approach in dense document retrieval. The bi-encoder, separately encoding a query and a document as a single vector, …...
Structured Pruning Learns Compact and Accurate Models
AbstractThe growing size of neural language models has led to increased attention in model compression. The two predominant approaches are pruning, which gradually removes weights from a pre-trained model, and …...
Teaching BERT to Wait: Balancing Accuracy and Latency for Streaming Disfluency Detection
AbstractIn modern interactive speech-based systems, speech is consumed and transcribed incrementally prior to having disfluencies removed. While this post-processing step is crucial for producing clean transcripts and high performance on …...
Toward Interactive Dictation
AbstractVoice dictation is an increasingly important text input modality. Existing systems that allow both dictation and editing-by-voice restrict their command language to flat templates invoked by trigger words. In this …...