Evaluation Data
Related Papers
SemEval-2007 Task 12: Turkish Lexical Sample Task
This paper presents the task definition, re- sources, and the single participant system for Task 12: Turkish Lexical Sample Task (TLST), which was organized in the Se- mEval-2007 evaluation exercise. …...
Assumptions, expectations and outliers in post-editing
As a multilingual vendor, we have access to machine translation (MT) scoring and other evaluation data on a wide range of language combinations and content types; we also have experience …...
Named Entity Tagging a Very Large Unbalanced Corpus: Training and Evaluating NE Classifiers
AbstractWe describe a systematic and application-oriented approach to training and evaluating named entity recognition and classification (NERC) systems, the purpose of which is to identify an optimal system and to …...
ShrdLite: Semantic Parsing Using a Handmade Grammar
This paper describes my approach for parsing robot commands, which was task 6 at SemEval 2014. My solution is to manually create a compact unifica- tion grammar. The grammar is …...
SU-FMI: System Description for SemEval-2014 Task 9 on Sentiment Analysis in Twitter
We describe the submission of the team of the Sofia University to SemEval-2014 Task 9 on Sentiment Analysis in Twit- ter. We participated in subtask B, where the participating systems …...
CNRC at SemEval-2016 Task 1: Experiments in Crosslingual Semantic Textual Similarity
We describe the systems entered by the National Research Council Canada in the SemEval-2016 Task1: Crosslingual Semantic Textual Similarity. We tried two approaches: One computes a true crosslingual similarity based …...
ELMD: An Automatically Generated Entity Linking Gold Standard Dataset in the Music Domain
AbstractIn this paper we present a gold standard dataset for Entity Linking (EL) in the Music Domain. It contains thousands of musical named entities such as Artist, Song or Record …...
Finely Tuned, 2 Billion Token Based Word Embeddings for Portuguese
A distributional semantics model — also known as word embeddings — is a major asset for any language as the research results reported in the literature have consistently shown that …...
Linguistic Appropriateness and Pedagogic Usefulness of Reading Comprehension Questions
AbstractAutomatic generation of reading comprehension questions is a topic receiving growing interest in the NLP community, but there is currently no consensus on evaluation metrics and many approaches focus on …...
Evaluation Datasets for Cross-lingual Semantic Textual Similarity
AbstractSemantic textual similarity (STS) systems estimate the degree of the meaning similarity between two sentences. Cross-lingual STS systems estimate the degree of the meaning similarity between two sentences, each in …...