Analysis of a Hand-Tagging Task

Analysis of a Hand-Tagging Task Christiane Fellbaum*t, Joachim Grabowski~, Shari Landes* *Cognitive Science Laboratory Princeton University tRider University :~Department of Psychology University of Mannheim, Germany Abstract We analyze the results of a semantic an- notation task performed by novice taggers as part of the WordNet SemCor project (Landes et al., in press). Each polysemous content word in a text was matched to a sense from WordNet. Comparing the per- formance of the novice taggers with that of experienced lexicographers, we find that the degree of polysemy, part of speech, and the position within the WordNet entry of the target words played a role in the tag- gers' choices. The taggers agreed on a sense choice more often than they agreed with two lexicographers, suggesting an effect of experience on sense distinction. Evidence indicates that taggers selecting senses from a list ordered by frequency of occurrence, where salient, core senses are found at the beginning of the entry, use a different strat- egy than taggers working with a randomly ordered list of senses. 1 Introduction Our present understanding of how the meanings of polysemous words are represented in speakers' minds and accessed during language use is poor. One model of the mental lexicon, implicit in much of computational linguistics, likens it to a dictionary, with a discrete entry for each word form and each sense of a polysemous word form. Language produc- tion and comprehension then would simply require "looking up" the appropriate entry and selecting the intended meaning. If this model of the mental lexi- con, with its discrete and non-overlapping sense rep- resentations, were correct, both the creation and the use of dictionaries would be straightforward. Lexicographers collect large numbers of occur- rences of words from a corpus. Interpreting the dif- 34 ferent meanings of polysemous words from the cor- pus presents no dit~culty, since lexicographers sim- ply do what they do as competent speakers of the language. The step that is particular to lexicogra- phy is transforming the corpus occurrences of a given word form into a number of discrete senses in the format of dictionary entries. Cross-dictionary com- parisons show that carving up the different meanings of a polysemous word into discrete dictionary senses is difficult. The number of senses for a polysemous word often differs, reflecting "lumping" versus "split- ting" strategies; some senses are absent from one but not another dictionary. Yet postulating different mental lexicons seems unwarranted, given our rapid and successful communication. Rather, the mapping process from occurrence to dictionary entry may give rise to difficulties and discrepancies across dictionar- ies because speakers' meaning representations may not resemble those of dictionaries with their fiat and discrete senses, thus making lexicography an artifi- cial and therefore challenging task. Semantic tagging is the inverse of lexicography, in that taggers identify and interpret dictionary entries with respect to words occurring in a text. Taggers, like lexicographers, first interpret the target word in the text, and then match the meaning they have identified for a given occurrence of …

Content truncated to 500 words