metric ID: latency

Related Papers

MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractNatural Language Processing (NLP) has recently achieved great success by using huge pre-trained models with hundreds of millions of parameters. However, these models suffer from heavy model sizes and high …...

38063

Simultaneous Translation Policies: From Fixed to Adaptive

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractAdaptive policies are better than fixed policies for simultaneous translation, since they can flexibly balance the tradeoff between translation quality and latency based on the current context information. But previous …...

37941

Start-Before-End and End-to-End: Neural Speech Translation by AppTek and RWTH Aachen University

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractAppTek and RWTH Aachen University team together to participate in the offline and simultaneous speech translation tracks of IWSLT 2020. For the offline task, we create both cascaded and end-to-end …...

20608

XtremeDistil: Multi-stage Distillation for Massive Multilingual Models

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractDeep and large pre-trained language models are the state-of-the-art for various natural language processing tasks. However, the huge size of these models could be a deterrent to using them in …...

38048

Direct Simultaneous Speech-to-Text Translation Assisted by Synchronized Streaming ASR

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

Simultaneous speech-to-text translation is widely useful in many scenarios. The con- ventional cascaded approach uses a pipeline of streaming ASR followed by simultaneous MT, but suffers from error propagation and …...

33778

Exploiting Multimodal Reinforcement Learning for Simultaneous Machine Translation

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractThis paper addresses the problem of simultaneous machine translation (SiMT) by exploring two main concepts: (a) adaptive policies to learn a good trade-off between high translation quality and low latency; …...

42538

Findings of the WMT 2021 Shared Task on Efficient Translation

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractThe machine translation efficiency task challenges participants to make their systems faster and smaller with minimal impact on translation quality. How much quality to sacrifice for efficiency depends upon the …...

27726

Large-Scale English-Japanese Simultaneous Interpretation Corpus: Construction and Analyses with Sentence-Aligned Data

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractThis paper describes the construction of a new large-scale English-Japanese Simultaneous Interpretation (SI) corpus and presents the results of its analysis. A portion of the corpus contains SI data from …...

20708

Streaming Models for Joint Speech Recognition and Translation

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractUsing end-to-end models for speech translation (ST) has increasingly been the focus of the ST community. These models condense the previously cascaded systems by directly converting sound waves into translated …...

42599

Universal Simultaneous Machine Translation with Mixture-of-Experts Wait-k Policy

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractSimultaneous machine translation (SiMT) generates translation before reading the entire source sentence and hence it has to trade off between translation quality and latency. To fulfill the requirements of different …...

31380

A Template-based Method for Constrained Neural Machine Translation

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractMachine translation systems are expected to cope with various types of constraints in many practical scenarios. While neural machine translation (NMT) has achieved strong performance in unconstrained cases, it is …...

31130

Anticipation-Free Training for Simultaneous Machine Translation

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractSimultaneous machine translation (SimulMT) speeds up the translation process by starting to translate before the source sentence is completely available. It is difficult due to limited context and word order …...

20702

CUNI-KIT System for Simultaneous Speech Translation Task at IWSLT 2022

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractIn this paper, we describe our submission to the Simultaneous Speech Translation at IWSLT 2022. We explore strategies to utilize an offline model in a simultaneous setting without the need …...

20667

Efficient Cluster-Based k-Nearest-Neighbor Machine Translation

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

Abstractk-Nearest-Neighbor Machine Translation (kNN-MT) has been recently proposed as a non-parametric solution for domain adaptation in neural machine translation (NMT). It aims to alleviate the performance degradation of advanced MT …...

39224

FiE: Building a Global Probability Space by Leveraging Early Fusion in Encoder for Open-Domain Question Answering

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractGenerative models have recently started to outperform extractive models in Open Domain Question Answering, largely by leveraging their decoder to attend over multiple encoded passages and combining their information. However, …...

31033

Pseudo-Relevance for Enhancing Document Representation

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractThis paper studies how to enhance the document representation for the bi-encoder approach in dense document retrieval. The bi-encoder, separately encoding a query and a document as a single vector, …...

29892

Structured Pruning Learns Compact and Accurate Models

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractThe growing size of neural language models has led to increased attention in model compression. The two predominant approaches are pruning, which gradually removes weights from a pre-trained model, and …...

39269

Teaching BERT to Wait: Balancing Accuracy and Latency for Streaming Disfluency Detection

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractIn modern interactive speech-based systems, speech is consumed and transcribed incrementally prior to having disfluencies removed. While this post-processing step is crucial for producing clean transcripts and high performance on …...

21420

Toward Interactive Dictation

Authors: nan

Publication: TIPSTER (2023)

DOI: nan

AbstractVoice dictation is an increasingly important text input modality. Existing systems that allow both dictation and editing-by-voice restrict their command language to flat templates invoked by trigger words. In this …...

37592