Test Data
Related Papers
A first evaluation of logic form identification systems
This paper presents a first experience with evalu- ating sytems that address the issue of Logic Form Identification (LFi). A Gold Standard approach was used in which experts provide solutions …...
Adaptive Feedback Message Generation for Second Language Learners of Arabic
This paper addresses issues related to generat- ing feedback messages to errors related to Ar- abic verbs made by second language learners (SLLs). The proposed approach allows for in- dividualization. …...
ATA-Sem: Chunk-based Determination of Semantic Text Similarity
This paper describes investigations into using syntactic chunk information as the basis for determining the similarity of candidate texts at the semantic level. Two approaches were con- sidered. The first …...
Enhancing Grammatical Cohesion: Generating Transitional Expressions for SMT
Transitional expressions provide glue that holds ideas together in a text and enhance the logical organization, which together help im- prove readability of a text. However, in most current statistical …...
Large-scale Exact Decoding: The IMS-TTT submission to WMT14
We present the IMS-TTT submission to WMT14, an experimental statistical tree- to-tree machine translation system based on the multi-bottom up tree transducer in- cluding rule extraction, tuning and decod- ing. …...
A Shared Task for Spoken CALL?
AbstractWe argue that the field of spoken CALL needs a shared task in order to facilitate comparisons between different groups and methodologies, and describe a concrete example of such a …...
Fine-tuning on Clean Data for End-to-End Speech Translation: FBK @ IWSLT 2018
AbstractThis paper describes FBK’s submission to the end-to-end English-German speech translation task at IWSLT 2018. Our system relies on a state-of-the-art model based on LSTMs and CNNs, where the CNNs …...
Combination of Neural Machine Translation Systems at WMT20
AbstractThis paper presents neural machine translation systems and their combination built for the WMT20 English-Polish and Japanese->English translation tasks. We show that using a Transformer Big architecture, additional training data …...
UIC-NLP at SemEval-2020 Task 10: Exploring an Alternate Perspective on Evaluation
AbstractIn this work we describe and analyze a supervised learning system for word emphasis selection in phrases drawn from visual media as a part of the Semeval 2020 Shared Task …...
HateCheck: Functional Tests for Hate Speech Detection Models
AbstractDetecting online hate is a difficult task that even state-of-the-art models struggle with. Typically, hate speech detection models are evaluated by measuring their performance on held-out test data using metrics …...
“Hi, how can I help you?” Improving Machine Translation of Conversational Content in a Business Context
AbstractThis paper addresses the automatic translation of conversational content in a business context, for example support chat dialogues. While such use cases share characteristics with other informal machine translation scenarios, …...