Quality
Related Papers
JEIDA’s test - sets for quality evaluation of MT systems
This paper describes a method of evaluating quality for developers of machine translation systems to easily check imperfections in their own systems. This evaluation method is a systematic, objective method …...
CogentHelp: NLG meets SE in a tool for authoring dynamically generated on-line help
CogentHelp is a prototype tool for au- thoring dynamically generated on-line help for applications with graphical user inter- faces, embodying the "evolution-friendly" properties of tools in the literate program- ming …...
Achieving commercial-quality translation with example-based methods
AbstractWe describe MSR-MT, a large-scale example-based machine translation system under development for several language pairs. Trained on aligned English-Spanish technical prose, a blind evaluation shows that MSR-MT’s integration of rule-based …...
Alternative approaches for Generating Bodies of Grammar Rules
We compare two approaches for describing and gen- erating bodies of rules used for natural language parsing. In today’s parsers rule bodies do not ex- ist a priori but are …...
Incorporate Credibility into Context for the Best Social Media Answers
. In this paper, we focus on the task of identifying the best answer for a user- generated question in Collaborative Question Answering (CQA) services. Given that most existing research …...
Evaluating the effects of interactivity in a post-editing workbench
AbstractThis paper describes the field trial and subsequent evaluation of a post-editing workbench which is currently under development in the EU-funded CasMaCat project. Based on user evaluations of the initial …...
Chatbot Technology with Synthetic Voices in the Acquisition of an Endangered Language: Motivation, Development and Evaluation of a Platform for Irish
AbstractThis paper describes the development and evaluation of a chatbot platform designed for the teaching/learning of Irish. The chatbot uses synthetic voices developed for the dialects of Irish. Speech-enabled chatbot …...
MayAnd at SemEval-2016 Task 5: Syntactic and word2vec-based approach to aspect-based polarity detection in Russian
This paper describes aspect-based polarity de- tection system for Russian, used in aspect- based sentiment analysis task (ABSA) of SemEval-2016 (Task 5, subtask 1, slot 3). The system consists of …...
Fˆ2-Softmax: Diversifying Neural Text Generation via Frequency Factorized Softmax
AbstractDespite recent advances in neural text generation, encoding the rich diversity in human language remains elusive. We argue that the sub-optimal text generation is mainly attributable to the imbalanced token …...
Generating Fact Checking Explanations
AbstractMost existing work on automated fact checking is concerned with predicting the veracity of claims based on metadata, social network spread, language used in claims, and, more recently, evidence supporting …...
Exploiting Multimodal Reinforcement Learning for Simultaneous Machine Translation
AbstractThis paper addresses the problem of simultaneous machine translation (SiMT) by exploring two main concepts: (a) adaptive policies to learn a good trade-off between high translation quality and low latency; …...
Exposure Bias versus Self-Recovery: Are Distortions Really Incremental for Autoregressive Text Generation?
AbstractExposure bias has been regarded as a central problem for auto-regressive language models (LM). It claims that teacher forcing would cause the test-time generation to be incrementally distorted due to …...
Large-Scale English-Japanese Simultaneous Interpretation Corpus: Construction and Analyses with Sentence-Aligned Data
AbstractThis paper describes the construction of a new large-scale English-Japanese Simultaneous Interpretation (SI) corpus and presents the results of its analysis. A portion of the corpus contains SI data from …...
Sentence-Permuted Paragraph Generation
AbstractGenerating paragraphs of diverse contents is important in many applications. Existing generation models produce similar contents from homogenized contexts due to the fixed left-to-right sentence order. Our idea is permuting …...
Swords: A Benchmark for Lexical Substitution with Improved Data Coverage and Quality
AbstractWe release a new benchmark for lexical substitution, the task of finding appropriate substitutes for a target word in a context. For writing, lexical substitution systems can assist humans by …...
An Exploration of Post-Editing Effectiveness in Text Summarization
AbstractAutomatic summarization methods are efficient but can suffer from low quality. In comparison, manual summarization is expensive but produces higher quality. Can humans and AI collaborate to improve summarization performance? …...
Generating Biographies on Wikipedia: The Impact of Gender Bias on the Retrieval-Based Generation of Women Biographies
AbstractGenerating factual, long-form text such as Wikipedia articles raises three key challenges: how to gather relevant evidence, how to structure information into well-formed text, and how to ensure that the …...
QuALITY: Question Answering with Long Input Texts, Yes!
AbstractTo enable building and testing models on long-document comprehension, we introduce QuALITY, a multiple-choice QA dataset with context passages in English that have an average length of about 5,000 tokens, …...
DimonGen: Diversified Generative Commonsense Reasoning for Explaining Concept Relationships
AbstractIn this paper, we propose DimonGen, which aims to generate diverse sentences describing concept relationships in various everyday scenarios. To support this, we first create a benchmark dataset for this …...
Do Neural Topic Models Really Need Dropout? Analysis of the Effect of Dropout in Topic Modeling
AbstractDropout is a widely used regularization trick to resolve the overfitting issue in large feedforward neural networks trained on a small dataset, which performs poorly on the held-out test subset. …...