Augmenting Lexicons Automatically: Clustering Semantically Related Adjectives

Augmenting Lexicons Automatically: Clustering Semantically Related Adjectives Kathleen McKeown Vasileios Hatzivassiloglou Department of Computer Science 450 Computer Science Building Columbia University New York, N.Y. 10027 ABSTRACT Our work focuses on identifying various types of lexical data in large corpora through statistical analysis. In this paper, we present a method for grouping adjectives according to their mean- ing, as a step towards the automatic identification of adjectival scales. We describe how our system exploits two sources of linguistic knowledge in a corpus to compute a measure of similarity between two adjectives, using statistical techniques and a clustering algorithm for grouping. We evaluate the significance of the results produced by our system for a sample set of adjec- fives. 1. INTRODUCTION A linguistic scale is a set of words, of the same gram- matical category, which can be ordered by their semantic strength or degree of informativeness [1]. For example, "lukewarm," "warm", "hot" fall along a single adjec- tival scale since they indicate a variation in the intensity of temperature of the modified noun. Linguistic properties of scales derive both from conventional logical entailment on the linear ordering of their elements and from Gricean scalar implicature [1]. Despite these properties and their potential usefulness in both understanding and generating natural language text, dictionary entries are largely incom- plete for adjectives in this regard. Yet, if systems are to use the information encoded in adjectival scales for generation or interpretation (e.g. for selecting an adjective with a par- ticular degree of semantic strength, or for handling nega- tion), they must have access to the sets of words compris- ing a scale. While linguists have presented various tests for accepting or rejecting a particular scalar relationship between any two adjectives (e.g., [2], [3]), the common problem with these methods is that they are designed to be applied by a human who incorporates the two adjectives in specific sen- tential frames (e.g. "X is warm, even hot") and assesses the semantic validity of the resulting sentences. Such tests cannot be used computationally to identify scales in a domain, since the specific sentences do not occur fre- quently enough in a corpus to produce an adequate description of the adjectival scales in the domain [4]. As scales vary across domains, the task of compiling such information is compounded. In this paper we describe a technique for automatically grouping adjectives according to their meaning based on a given text corpus, so that all adjectives placed in one group describe different values of the same property. Our method is based on statistical techniques, augmented with linguis- tic information derived from the corpus, and is completely domain independent. It demonstrates how high-level semantic knowledge can be computed from large amounts of low-level knowledge (essentially plain text, part-of- speech rules, and optionally syntactic relations). While our current system does not distinguish between scalar and non-scalar adjectives, it is a first step in the automatic identification of adjectival scales, since the scales can be subsequently ordered and the non-scalar adjectives filtered …

Content truncated to 500 words