Consistency

metric ID: consistency

Related Papers

Bringing humans into the loop: Localization with MT at Traslán

Authors: nan

Publication: TIPSTER (2008)

DOI: nan

Trasl´an makes full use of MT during our translation workflow, where the raw output from our Machine Translation (MT) system is passed onto human translators who perform post-editing (if necessary) …...

29161

A High Recall Error Identification Tool for Hindi Treebank Validation

Authors: nan

Publication: TIPSTER (2010)

DOI: nan

AbstractThis paper describes the development of a hybrid tool for a semi-automated process for validation of treebank annotation at various levels. The tool is developed for error detection at the …...

7864

Automatic Evaluation of Local Topic Quality

Authors: nan

Publication: TIPSTER (2019)

DOI: nan

AbstractTopic models are typically evaluated with respect to the global topic distributions that they generate, using metrics such as coherence, but without regard to local (token-level) topic assignments. Token-level assignments …...

39884

MEGATRON-CNTRL: Controllable Story Generation with External Knowledge Using Large-Scale Language Models

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractExisting pre-trained large language models have shown unparalleled generative capabilities. However, they are not controllable. In this paper, we propose MEGATRON-CNTRL, a novel framework that uses large-scale language models and …...

30612

Exposure Bias versus Self-Recovery: Are Distortions Really Incremental for Autoregressive Text Generation?

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractExposure bias has been regarded as a central problem for auto-regressive language models (LM). It claims that teacher forcing would cause the test-time generation to be incrementally distorted due to …...

31688

Streaming Models for Joint Speech Recognition and Translation

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractUsing end-to-end models for speech translation (ST) has increasingly been the focus of the ST community. These models condense the previously cascaded systems by directly converting sound waves into translated …...

42599

DialSummEval: Revisiting Summarization Evaluation for Dialogues

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractDialogue summarization is receiving increasing attention from researchers due to its extraordinary difficulty and unique application value. We observe that current dialogue summarization models have flaws that may not be …...

20994

Joint Generation of Captions and Subtitles with Dual Decoding

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractAs the amount of audio-visual content increases, the need to develop automatic captioning and subtitling solutions to match the expectations of a growing international audience appears as the only viable …...

20699

Measuring Consistency in Text-based Financial Forecasting Models

Authors: nan

Publication: TIPSTER (2023)

DOI: nan

AbstractFinancial forecasting has been an important and active area of machine learning research, as even the most modest advantages in predictive accuracy can be parlayed into significant financial gains. Recent …...

37761