Articles

In this paper we describe an automatic prosody labeling framework that exploits both language and speech information. We model the syntactic-prosodic informa- tion with a maximum entropy model that achieves an accuracy of 85.2% and 91.5% for pitch accent and boundary tone la- beling on the Boston University Radio News …...

This task tries to establish the relative qual- ity of available semantic resources (derived by manual or automatic means). The qual- ity of each large-scale knowledge resource is indirectly evaluated on a Word Sense Dis- ambiguation task. In particular, we use Senseval-3 and SemEval-2007 English Lex- ical Sample tasks as …...

The TempEval task proposes a simple way to evaluate automatic extraction of temporal relations. It avoids the pitfalls of evaluat- ing a graph of inter-related labels by defin- ing three sub tasks that allow pairwise eval- uation of temporal relations. The task not only allows straightforward evaluation, it also avoids …...

The “Affective Text” task focuses on the classification of emotions and valence (pos- itive/negative polarity) in news headlines, and is meant as an exploration of the connec- tion between emotions and lexical seman- tics. In this paper, we describe the data set used in the evaluation and the results ob- …...

This paper presents the task definition, re- sources, participation, and comparative re- sults for the Web People Search task, which was organized as part of the SemEval-2007 evaluation exercise. This task consists of clustering a set of documents that mention an ambiguous person name according to the actual entities referred …...

We made use of parallel texts to gather train- ing and test examples for the English lexi- cal sample task. Two tracks were organized for our task. The first track used examples gathered from an LDC corpus, while the second track used examples gathered from a Web corpus. In this …...

This paper presents the task definition, re- sources, and the single participant system for Task 12: Turkish Lexical Sample Task (TLST), which was organized in the Se- mEval-2007 evaluation exercise. The methodology followed for developing the specific linguistic resources necessary for the task has been described in this context. A …...

In this paper we describe the English Lexical Substitution task for SemEval. In the task, annotators and systems find an alternative substitute word or phrase for a target word in context. The task involves both finding the synonyms and disambiguating the context. Participating systems are free to use any lex- …...

In this paper we describe SemEval-2007 task number 9 (Multilevel Semantic Annotation of Catalan and Spanish). In this task, we aim at evaluating and comparing automatic systems for the annotation of several seman- tic linguistic levels for Catalan and Spanish. Three semantic levels are considered: noun sense disambiguation, named entity …...

This paper presents the coarse-grained En- glish all-words task at SemEval-2007. We describe our experience in producing a coarse version of the WordNet sense inven- tory and preparing the sense-tagged corpus for the task. We present the results of par- ticipating systems and discuss future direc- tions. 1...

The SemEval-2007 task to disambiguate prepositions was designed as a lexical sample task. A set of over 25,000 instances was developed, covering 34 of the most frequent English prepositions, with two-thirds of the instances for training and one-third as the test set. Each instance identified a preposition to be tagged …...

The Multilingual Chinese-English lexical sample task at SemEval-2007 provides a framework to evaluate Chinese word sense disambiguation and to promote research. This paper reports on the task preparation and the results of six participants. 1...

We provide an overview of the metonymy resolution shared task organised within SemEval-2007. We describe the problem, the data provided to participants, and the evaluation measures we used to assess per- formance. We also give an overview of the systems that have taken part in the task, and discuss possible …...

The goal of this task is to allow for com- parison across sense-induction and discrim- ination systems, and also to compare these systems to other supervised and knowledge- based systems. In total there were 6 partic- ipating systems. We reused the SemEval- 2007 English lexical sample subtask of task 17, …...

This paper presents a first attempt of an application-driven evaluation exercise of WSD. We used a CLIR testbed from the Cross Lingual Evaluation Forum. The ex- pansion, indexing and retrieval strategies where fixed by the organizers. The par- ticipants had to return both the topics and documents tagged with WordNet …...

In morphologically rich languages, should morphological and syntactic disambiguation be treated sequentially or as a sin- gle problem? We describe several efficient, probabilistically- interpretable ways to apply joint inference to morphological and syntactic disambiguation using lattice parsing. Joint infer- ence is shown to compare favorably to pipeline parsing methods across …...

Trigram language models are compressed using a Golomb coding method inspired by the original Unix spell program. Compression methods trade off space, time and accuracy (loss). The proposed HashTBO method optimizes space at the expense of time and accuracy. Trigram language models are normally considered memory hogs, but with HashTBO, …...

The increasing use of large open-domain document sources is exacerbating the problem of ambiguity in named entities. This paper explores the use of a range of syntactic and semantic features in unsu- pervised clustering of documents that re- sult from ad hoc queries containing names. From these experiments, we find …...

Traditional research on spelling correction in natural language processing and infor- mation retrieval literature mostly relies on pre-defined lexicons to detect spelling er- rors. But this method does not work well for web query spelling correction, because there is no lexicon that can cover the vast amount of terms occurring …...

This paper assesses the role of multi-label classification in modelling polysemy for lan- guage acquisition tasks. We focus on the ac- quisition of semantic classes for Catalan ad- jectives, and show that polysemy acquisition naturally suits architectures used for multi- label classification. Furthermore, we ex- plore the performance of information …...