Consistency
Related Papers
Bringing humans into the loop: Localization with MT at Traslán
Trasl´an makes full use of MT during our translation workflow, where the raw output from our Machine Translation (MT) system is passed onto human translators who perform post-editing (if necessary) …...
A High Recall Error Identification Tool for Hindi Treebank Validation
AbstractThis paper describes the development of a hybrid tool for a semi-automated process for validation of treebank annotation at various levels. The tool is developed for error detection at the …...
Automatic Evaluation of Local Topic Quality
AbstractTopic models are typically evaluated with respect to the global topic distributions that they generate, using metrics such as coherence, but without regard to local (token-level) topic assignments. Token-level assignments …...
MEGATRON-CNTRL: Controllable Story Generation with External Knowledge Using Large-Scale Language Models
AbstractExisting pre-trained large language models have shown unparalleled generative capabilities. However, they are not controllable. In this paper, we propose MEGATRON-CNTRL, a novel framework that uses large-scale language models and …...
Exposure Bias versus Self-Recovery: Are Distortions Really Incremental for Autoregressive Text Generation?
AbstractExposure bias has been regarded as a central problem for auto-regressive language models (LM). It claims that teacher forcing would cause the test-time generation to be incrementally distorted due to …...
Streaming Models for Joint Speech Recognition and Translation
AbstractUsing end-to-end models for speech translation (ST) has increasingly been the focus of the ST community. These models condense the previously cascaded systems by directly converting sound waves into translated …...
DialSummEval: Revisiting Summarization Evaluation for Dialogues
AbstractDialogue summarization is receiving increasing attention from researchers due to its extraordinary difficulty and unique application value. We observe that current dialogue summarization models have flaws that may not be …...
Joint Generation of Captions and Subtitles with Dual Decoding
AbstractAs the amount of audio-visual content increases, the need to develop automatic captioning and subtitling solutions to match the expectations of a growing international audience appears as the only viable …...
Measuring Consistency in Text-based Financial Forecasting Models
AbstractFinancial forecasting has been an important and active area of machine learning research, as even the most modest advantages in predictive accuracy can be parlayed into significant financial gains. Recent …...