Сөйлеуді аудару

task ID: speechtranslation

Related Papers

INVITED TALK: Qualitative and Quantitative Designs for Speech Translation

Authors: nan

Publication: TIPSTER (1994)

DOI: nan

This paper compares a qualitative reasoning model of translation with a quantitative statistical model. We consider these models within the context of two hy- pothetical speech translation systems, starting with …...

26626

Prospects for advanced speech translation

Authors: nan

Publication: TIPSTER (1999)

DOI: nan

AbstractSpeech communication includes many important issues on natural language processing and they are related with desirable advanced speech translation systems. Advanced systems need to be able to handle the interaction …...

17334

Translation systems under the C-STAR framework

Authors: nan

Publication: TIPSTER (1999)

DOI: nan

AbstractThis talk will review our work on Speech Translation under the recent worldwide C-STAR demonstration. C-STAR is the Consortium for Speech Translation Advanced Research and now includes 6 partners and …...

17332

Precise measurement method of a speech translation system’s capability with a paired comparison method between the system and humans

Authors: nan

Publication: TIPSTER (2001)

DOI: nan

AbstractThe main goal of the present paper is to propose new schemes for the overall evaluation of a speech translation system. These schemes are expected to support and improve the …...

13252

Splitting Input Sentence for Machine Translation Using Language Model with Sentence Similarity

Authors: nan

Publication: TIPSTER (2004)

DOI: nan

In order to boost the translation quality of corpus-based MT systems for speech transla- tion, the technique of splitting an input sen- tence appears promising. In previous re- search, many …...

6139

Using multiple recognition hypotheses to improve speech translation

Authors: nan

Publication: TIPSTER (2005)

DOI: nan

This paper describes our recent work on integrating speech recognition and machine translation for improving speech translation performance. Two approaches are applied and their performance are evaluated in the workshop …...

20478

A User Interface-Level Integration Method for Multiple Automatic Speech Translation Systems

Authors: nan

Publication: TIPSTER (2006)

DOI: nan

. We propose a new method to integrate multiple speech translation systems based on user interface-level integration. Users can select the result of free-sentence speech translation or that of registered …...

19537

On the Robustness of Syntactic and Semantic Features for Automatic MT Evaluation

Authors: nan

Publication: TIPSTER (2009)

DOI: nan

Linguistic metrics based on syntactic and semantic information have proven very effective for Automatic MT Evaluation. However, no results have been presented so far on their performance when applied to …...

26956

The IWSLT 2011 Evaluation Campaign on Automatic Talk Translation

Authors: nan

Publication: TIPSTER (2012)

DOI: nan

AbstractWe report here on the eighth evaluation campaign organized in 2011 by the IWSLT workshop series. That IWSLT 2011 evaluation focused on the automatic translation of public talks and included …...

13349

The KIT Lecture Corpus for Speech Translation

Authors: nan

Publication: TIPSTER (2012)

DOI: nan

AbstractAcademic lectures offer valuable content, but often do not reach their full potential audience due to the language barrier. Human translations of lectures are too expensive to be widely used. …...

13353

Simultaneous Translation using Optimized Segmentation

Authors: nan

Publication: TIPSTER (2018)

DOI: nan

Previous simultaneous translation approaches either use a separate segmentation step followed by a machine translation decoder or rely on the decoder to segment and translate without training the segmenter to …...

29022

Speech Translation Systems as a Solution for a Wireless Earpiece

Authors: nan

Publication: TIPSTER (2018)

DOI: nan

AbstractThe advances of deep learning approaches in automatic speech recognition (ASR) and machine translation (MT) have allowed for levels of accuracy that move speech translation closer to being a commercially …...

2837

The JHU/KyotoU Speech Translation System for IWSLT 2018

Authors: nan

Publication: TIPSTER (2018)

DOI: nan

AbstractThis paper describes the Johns Hopkins University (JHU) and Kyoto University submissions to the Speech Translation evaluation campaign at IWSLT2018. Our end-to-end speech translation systems are based on ESPnet and …...

20612

Fluent Translations from Disfluent Speech in End-to-End Speech Translation

Authors: nan

Publication: TIPSTER (2019)

DOI: nan

AbstractSpoken language translation applications for speech suffer due to conversational speech phenomena, particularly the presence of disfluencies. With the rise of end-to-end speech translation models, processing steps such as disfluency …...

21998

On Using SpecAugment for End-to-End Speech Translation

Authors: nan

Publication: TIPSTER (2019)

DOI: nan

AbstractThis work investigates a simple data augmentation technique, SpecAugment, for end-to-end speech translation. SpecAugment is a low-cost implementation method applied directly to the audio input features and it consists of …...

20659

Self-Attentional Models for Lattice Inputs

Authors: nan

Publication: TIPSTER (2019)

DOI: nan

AbstractLattices are an efficient and effective method to encode ambiguity of upstream systems in natural language processing tasks, for example to compactly capture multiple speech recognition hypotheses, or to represent …...

39845

DiDi Labs’ End-to-end System for the IWSLT 2020 Offline Speech TranslationTask

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractThis paper describes the system that was submitted by DiDi Labs to the offline speech translation task for IWSLT 2020. We trained an end-to-end system that translates audio from English …...

20605

Gender in Danger? Evaluating Speech Translation Technology on the MuST-SHE Corpus

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractTranslating from languages without productive grammatical gender like English into gender-marked languages is a well-known difficulty for machines. This difficulty is also due to the fact that the training data …...

37359

Improved Speech Representations with Multi-Target Autoregressive Predictive Coding

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractTraining objectives based on predictive coding have recently been shown to be very effective at learning meaningful representations from unlabeled speech. One example is Autoregressive Predictive Coding (Chung et al., …...

38013

Is 42 the Answer to Everything in Subtitling-oriented Speech Translation?

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractSubtitling is becoming increasingly important for disseminating information, given the enormous amounts of audiovisual content becoming available daily. Although Neural Machine Translation (NMT) can speed up the process of translating …...

20536

Speech Translation and the End-to-End Promise: Taking Stock of Where We Are

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractOver its three decade history, speech translation has experienced several shifts in its primary research themes; moving from loosely coupled cascades of speech recognition and machine translation, to exploring questions …...

37316

Between Flexibility and Consistency: Joint Generation of Captions and Subtitles

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractSpeech translation (ST) has lately received growing interest for the generation of subtitles without the need for an intermediate source language transcription and timing (i.e. captions). However, the joint generation …...

20709

Cascade versus Direct Speech Translation: Do the Differences Still Make a Difference?

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractFive years after the first published proofs of concept, direct approaches to speech translation (ST) are now competing with traditional cascade solutions. In light of this steady progress, can we …...

8658

End-to-end ASR to jointly predict transcriptions and linguistic annotations

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractWe propose a Transformer-based sequence-to-sequence model for automatic speech recognition (ASR) capable of simultaneously transcribing and annotating audio with linguistic information such as phonemic transcripts or part-of-speech (POS) tags. Since …...

21725

Improving Speech Translation by Understanding and Learning from the Auxiliary Text Translation Task

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractPretraining and multitask learning are widely used to improve the speech translation performance. In this study, we are interested in training a speech translation model along with an auxiliary text …...

8456

Multilingual Speech Translation KIT @ IWSLT2021

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractThis paper contains the description for the submission of Karlsruhe Institute of Technology (KIT) for the multilingual TEDx translation task in the IWSLT 2021 evaluation campaign. Our main approach is …...

20719

Searchable Hidden Intermediates for End-to-End Models of Decomposable Sequence Tasks

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractEnd-to-end approaches for sequence tasks are becoming increasingly popular. Yet for complex sequence tasks, like speech translation, systems that cascade several models trained on sub-tasks have shown to be superior, …...

21722

Speechformer: Reducing Information Loss in Direct Speech Translation

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractTransformer-based models have gained increasing popularity achieving state-of-the-art performance in many research fields including speech translation. However, Transformer’s quadratic complexity with respect to the input sequence length prevents its adoption …...

31972

Stacked Acoustic-and-Textual Encoding: Integrating the Pre-trained Models into Speech Translation Encoders

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractEncoder pre-training is promising in end-to-end Speech Translation (ST), given the fact that speech-to-translation data is scarce. But ST encoders are not simple instances of Automatic Speech Recognition (ASR) or …...

7664

Streaming Models for Joint Speech Recognition and Translation

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractUsing end-to-end models for speech translation (ST) has increasingly been the focus of the ST community. These models condense the previously cascaded systems by directly converting sound waves into translated …...

42599

Evaluating Gender Bias in Speech Translation

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractThe scientific community is increasingly aware of the necessity to embrace pluralism and consistently represent major and minor social groups. Currently, there are no standard evaluation techniques for different types …...

15807

NVIDIA NeMo Offline Speech Translation Systems for IWSLT 2022

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractThis paper provides an overview of NVIDIA NeMo’s speech translation systems for the IWSLT 2022 Offline Speech Translation Task. Our cascade system consists of 1) Conformer RNN-T automatic speech recognition …...

20679

ON-TRAC Consortium Systems for the IWSLT 2022 Dialect and Low-resource Speech Translation Tasks

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractThis paper describes the ON-TRAC Consortium translation systems developed for two challenge tracks featured in the Evaluation Campaign of IWSLT 2022: low-resource and dialect speech translation. For the Tunisian Arabic-English …...

20662

Post-editing in Automatic Subtitling: A Subtitlers’ perspective

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractRecent developments in machine translation and speech translation are opening up opportunities for computer-assisted translation tools with extended automation functions. Subtitling tools are recently being adapted for post-editing by providing …...

3049

Pretrained Speech Encoders and Efficient Fine-tuning Methods for Speech Translation: UPC at IWSLT 2022

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractThis paper describes the submissions of the UPC Machine Translation group to the IWSLT 2022 Offline Speech Translation and Speech-to-Speech Translation tracks. The offline task involves translating English speech to …...

20668

STEMM: Self-learning with Speech-text Manifold Mixup for Speech Translation

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractHow to learn a better speech representation for end-to-end speech-to-text translation (ST) with limited labeled data? Existing techniques often attempt to transfer powerful machine translation (MT) capabilities to ST, but …...

38897

The NiuTrans’s Submission to the IWSLT22 English-to-Chinese Offline Speech Translation Task

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractThis paper describes NiuTrans’s submission to the IWSLT22 English-to-Chinese (En-Zh) offline speech translation task. The end-to-end and bilingual system is built by constrained English and Chinese data and translates the …...

20672

Under the Morphosyntactic Lens: A Multifaceted Evaluation of Gender Bias in Speech Translation

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractGender bias is largely recognized as a problematic phenomenon affecting language technologies, with recent studies underscoring that it might surface differently across languages. However, most of current evaluation practices adopt …...

39250

Who Are We Talking About? Handling Person Names in Speech Translation

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractRecent work has shown that systems for speech translation (ST) – similarly to automatic speech recognition (ASR) – poorly handle person names. This shortcoming does not only lead to errors …...

20701

KIT’s Multilingual Speech Translation System for IWSLT 2023

Authors: nan

Publication: TIPSTER (2023)

DOI: nan

AbstractMany existing speech translation benchmarks focus on native-English speech in high-quality recording conditions, which often do not match the conditions in real-life use-cases. In this paper, we describe our speech …...

20589

QUESPA Submission for the IWSLT 2023 Dialect and Low-resource Speech Translation Tasks

Authors: nan

Publication: TIPSTER (2023)

DOI: nan

AbstractThis article describes the QUESPA team speech translation (ST) submissions for the Quechua to Spanish (QUE–SPA) track featured in the Evaluation Campaign of IWSLT 2023: low-resource and dialect speech translation. …...

20553

Simple and Effective Unsupervised Speech Translation

Authors: nan

Publication: TIPSTER (2023)

DOI: nan

AbstractThe amount of labeled data to train models for speech tasks is limited for most languages, however, the data scarcity is exacerbated for speech translation which requires labeled data covering …...

38087