Метод от начала до конца

AbstractDirectly translating from speech to text using an end-to-end approach is still challenging for many language pairs due to insufficient data. Although pretraining the encoder parameters using the Automatic Speech …...

AbstractVisually-grounded models of spoken language understanding extract semantic information directly from speech, without relying on transcriptions. This is useful for low-resource languages, where transcriptions can be expensive or impossible to …...

Simultaneous speech-to-text translation is widely useful in many scenarios. The con- ventional cascaded approach uses a pipeline of streaming ASR followed by simultaneous MT, but suffers from error propagation and …...