Сөйлеуді аудару
Related Papers
INVITED TALK: Qualitative and Quantitative Designs for Speech Translation
This paper compares a qualitative reasoning model of translation with a quantitative statistical model. We consider these models within the context of two hy- pothetical speech translation systems, starting with …...
Prospects for advanced speech translation
AbstractSpeech communication includes many important issues on natural language processing and they are related with desirable advanced speech translation systems. Advanced systems need to be able to handle the interaction …...
Translation systems under the C-STAR framework
AbstractThis talk will review our work on Speech Translation under the recent worldwide C-STAR demonstration. C-STAR is the Consortium for Speech Translation Advanced Research and now includes 6 partners and …...
Precise measurement method of a speech translation system’s capability with a paired comparison method between the system and humans
AbstractThe main goal of the present paper is to propose new schemes for the overall evaluation of a speech translation system. These schemes are expected to support and improve the …...
Splitting Input Sentence for Machine Translation Using Language Model with Sentence Similarity
In order to boost the translation quality of corpus-based MT systems for speech transla- tion, the technique of splitting an input sen- tence appears promising. In previous re- search, many …...
Using multiple recognition hypotheses to improve speech translation
This paper describes our recent work on integrating speech recognition and machine translation for improving speech translation performance. Two approaches are applied and their performance are evaluated in the workshop …...
A User Interface-Level Integration Method for Multiple Automatic Speech Translation Systems
. We propose a new method to integrate multiple speech translation systems based on user interface-level integration. Users can select the result of free-sentence speech translation or that of registered …...
On the Robustness of Syntactic and Semantic Features for Automatic MT Evaluation
Linguistic metrics based on syntactic and semantic information have proven very effective for Automatic MT Evaluation. However, no results have been presented so far on their performance when applied to …...
The IWSLT 2011 Evaluation Campaign on Automatic Talk Translation
AbstractWe report here on the eighth evaluation campaign organized in 2011 by the IWSLT workshop series. That IWSLT 2011 evaluation focused on the automatic translation of public talks and included …...
The KIT Lecture Corpus for Speech Translation
AbstractAcademic lectures offer valuable content, but often do not reach their full potential audience due to the language barrier. Human translations of lectures are too expensive to be widely used. …...
Simultaneous Translation using Optimized Segmentation
Previous simultaneous translation approaches either use a separate segmentation step followed by a machine translation decoder or rely on the decoder to segment and translate without training the segmenter to …...
Speech Translation Systems as a Solution for a Wireless Earpiece
AbstractThe advances of deep learning approaches in automatic speech recognition (ASR) and machine translation (MT) have allowed for levels of accuracy that move speech translation closer to being a commercially …...
The JHU/KyotoU Speech Translation System for IWSLT 2018
AbstractThis paper describes the Johns Hopkins University (JHU) and Kyoto University submissions to the Speech Translation evaluation campaign at IWSLT2018. Our end-to-end speech translation systems are based on ESPnet and …...
Fluent Translations from Disfluent Speech in End-to-End Speech Translation
AbstractSpoken language translation applications for speech suffer due to conversational speech phenomena, particularly the presence of disfluencies. With the rise of end-to-end speech translation models, processing steps such as disfluency …...
On Using SpecAugment for End-to-End Speech Translation
AbstractThis work investigates a simple data augmentation technique, SpecAugment, for end-to-end speech translation. SpecAugment is a low-cost implementation method applied directly to the audio input features and it consists of …...
Self-Attentional Models for Lattice Inputs
AbstractLattices are an efficient and effective method to encode ambiguity of upstream systems in natural language processing tasks, for example to compactly capture multiple speech recognition hypotheses, or to represent …...
DiDi Labs’ End-to-end System for the IWSLT 2020 Offline Speech TranslationTask
AbstractThis paper describes the system that was submitted by DiDi Labs to the offline speech translation task for IWSLT 2020. We trained an end-to-end system that translates audio from English …...
Gender in Danger? Evaluating Speech Translation Technology on the MuST-SHE Corpus
AbstractTranslating from languages without productive grammatical gender like English into gender-marked languages is a well-known difficulty for machines. This difficulty is also due to the fact that the training data …...
Improved Speech Representations with Multi-Target Autoregressive Predictive Coding
AbstractTraining objectives based on predictive coding have recently been shown to be very effective at learning meaningful representations from unlabeled speech. One example is Autoregressive Predictive Coding (Chung et al., …...
Is 42 the Answer to Everything in Subtitling-oriented Speech Translation?
AbstractSubtitling is becoming increasingly important for disseminating information, given the enormous amounts of audiovisual content becoming available daily. Although Neural Machine Translation (NMT) can speed up the process of translating …...
Speech Translation and the End-to-End Promise: Taking Stock of Where We Are
AbstractOver its three decade history, speech translation has experienced several shifts in its primary research themes; moving from loosely coupled cascades of speech recognition and machine translation, to exploring questions …...
Between Flexibility and Consistency: Joint Generation of Captions and Subtitles
AbstractSpeech translation (ST) has lately received growing interest for the generation of subtitles without the need for an intermediate source language transcription and timing (i.e. captions). However, the joint generation …...
Cascade versus Direct Speech Translation: Do the Differences Still Make a Difference?
AbstractFive years after the first published proofs of concept, direct approaches to speech translation (ST) are now competing with traditional cascade solutions. In light of this steady progress, can we …...
End-to-end ASR to jointly predict transcriptions and linguistic annotations
AbstractWe propose a Transformer-based sequence-to-sequence model for automatic speech recognition (ASR) capable of simultaneously transcribing and annotating audio with linguistic information such as phonemic transcripts or part-of-speech (POS) tags. Since …...
Improving Speech Translation by Understanding and Learning from the Auxiliary Text Translation Task
AbstractPretraining and multitask learning are widely used to improve the speech translation performance. In this study, we are interested in training a speech translation model along with an auxiliary text …...
Multilingual Speech Translation KIT @ IWSLT2021
AbstractThis paper contains the description for the submission of Karlsruhe Institute of Technology (KIT) for the multilingual TEDx translation task in the IWSLT 2021 evaluation campaign. Our main approach is …...
Searchable Hidden Intermediates for End-to-End Models of Decomposable Sequence Tasks
AbstractEnd-to-end approaches for sequence tasks are becoming increasingly popular. Yet for complex sequence tasks, like speech translation, systems that cascade several models trained on sub-tasks have shown to be superior, …...
Speechformer: Reducing Information Loss in Direct Speech Translation
AbstractTransformer-based models have gained increasing popularity achieving state-of-the-art performance in many research fields including speech translation. However, Transformer’s quadratic complexity with respect to the input sequence length prevents its adoption …...
Stacked Acoustic-and-Textual Encoding: Integrating the Pre-trained Models into Speech Translation Encoders
AbstractEncoder pre-training is promising in end-to-end Speech Translation (ST), given the fact that speech-to-translation data is scarce. But ST encoders are not simple instances of Automatic Speech Recognition (ASR) or …...
Streaming Models for Joint Speech Recognition and Translation
AbstractUsing end-to-end models for speech translation (ST) has increasingly been the focus of the ST community. These models condense the previously cascaded systems by directly converting sound waves into translated …...
Evaluating Gender Bias in Speech Translation
AbstractThe scientific community is increasingly aware of the necessity to embrace pluralism and consistently represent major and minor social groups. Currently, there are no standard evaluation techniques for different types …...
NVIDIA NeMo Offline Speech Translation Systems for IWSLT 2022
AbstractThis paper provides an overview of NVIDIA NeMo’s speech translation systems for the IWSLT 2022 Offline Speech Translation Task. Our cascade system consists of 1) Conformer RNN-T automatic speech recognition …...
ON-TRAC Consortium Systems for the IWSLT 2022 Dialect and Low-resource Speech Translation Tasks
AbstractThis paper describes the ON-TRAC Consortium translation systems developed for two challenge tracks featured in the Evaluation Campaign of IWSLT 2022: low-resource and dialect speech translation. For the Tunisian Arabic-English …...
Post-editing in Automatic Subtitling: A Subtitlers’ perspective
AbstractRecent developments in machine translation and speech translation are opening up opportunities for computer-assisted translation tools with extended automation functions. Subtitling tools are recently being adapted for post-editing by providing …...
Pretrained Speech Encoders and Efficient Fine-tuning Methods for Speech Translation: UPC at IWSLT 2022
AbstractThis paper describes the submissions of the UPC Machine Translation group to the IWSLT 2022 Offline Speech Translation and Speech-to-Speech Translation tracks. The offline task involves translating English speech to …...
STEMM: Self-learning with Speech-text Manifold Mixup for Speech Translation
AbstractHow to learn a better speech representation for end-to-end speech-to-text translation (ST) with limited labeled data? Existing techniques often attempt to transfer powerful machine translation (MT) capabilities to ST, but …...
The NiuTrans’s Submission to the IWSLT22 English-to-Chinese Offline Speech Translation Task
AbstractThis paper describes NiuTrans’s submission to the IWSLT22 English-to-Chinese (En-Zh) offline speech translation task. The end-to-end and bilingual system is built by constrained English and Chinese data and translates the …...
Under the Morphosyntactic Lens: A Multifaceted Evaluation of Gender Bias in Speech Translation
AbstractGender bias is largely recognized as a problematic phenomenon affecting language technologies, with recent studies underscoring that it might surface differently across languages. However, most of current evaluation practices adopt …...
Who Are We Talking About? Handling Person Names in Speech Translation
AbstractRecent work has shown that systems for speech translation (ST) – similarly to automatic speech recognition (ASR) – poorly handle person names. This shortcoming does not only lead to errors …...
KIT’s Multilingual Speech Translation System for IWSLT 2023
AbstractMany existing speech translation benchmarks focus on native-English speech in high-quality recording conditions, which often do not match the conditions in real-life use-cases. In this paper, we describe our speech …...
QUESPA Submission for the IWSLT 2023 Dialect and Low-resource Speech Translation Tasks
AbstractThis article describes the QUESPA team speech translation (ST) submissions for the Quechua to Spanish (QUE–SPA) track featured in the Evaluation Campaign of IWSLT 2023: low-resource and dialect speech translation. …...
Simple and Effective Unsupervised Speech Translation
AbstractThe amount of labeled data to train models for speech tasks is limited for most languages, however, the data scarcity is exacerbated for speech translation which requires labeled data covering …...