The Use of a Commercial Natural Language Interface in the ATIS Task

THE USE OF A COMMERCIAL NATURAL LANGUAGE INTERFACE IN THE ATIS TASK Evelyne Tzoukermann AT&T Bell Laboratories 600 Mountain Avenue Murray Hill, NJ 07974 Abstract A natural language interface for relational databases has been utilized at AT&T Bell Laboratories as the natu- ral language component of the DARPA ATIS common task. This is a part of a larger project that consists of in- corporating a natural language component into the Bell Laboratories Speech Recognizer. The commercially available system used in this project was developed by Natural Language Incorporation (NLI), in particular by J. Ginsparg [Ginsparg, 1976]. We relate our experience in adapting the NLI interface to handle domain dependent ATIS queries. The results of this allowed the exploration of several important issues in speech and natural language: 1. the feasabilitiy of using an off-the-shelf commercial product for a language understanding front end to a speech recognizer, 2. the constraints of using a general-purpose product for a specific task. 1 Introduction The ATIS common task was designed by DARPA and the members of the DARPA community to build and evaluate a system capable of handling continuous and spontaneous speech recognition as well as natural lan- guage understanding. Although the evaluation task is still not fully defined, the ATIS common task presents the opportunity to develop reliable and measurable crite- ria. The present paper focuses on the natural language component only, the integration with speech being re- ported in other papers [Pieraccini and Levin, 1991]. The domain of the task is on the Air Travel Information Ser- vice (ATIS). The project touches on a wide range of is- sues both in natural language and speech recognition, including incorporation of an NL interface in speech un- derstanding, flexibility in the type of input language (i.e. spoken or written), relational databases, evaluation of system performance, possible limitations, and others. The NLI system 1 is driven by a syntactic parser de- signed to handle English queries that are characteristic of the written language. In contrast, ATIS syntax is charac- teristic of spoken and spontaneous language. Therefore, one of the primary questions in using the NLI system has been how to overcome problems related to the discrep- ancy between written and spoken language input. Issues related to the ATIS domain and queries on the one hand, and to the construction of the NLI interface on the other hand are addressed. The task of the experiment is then described along with the results. 2 Why use a commercial prod- uct? Using a commercial product is attractive for a number of reasons: within Bell Laboratories, there has been no effort so far to develop a natural language interface (although this may change). Therefore, it is a significant sav- ings of time and effort to use a publicly available system in order to achieve the larger task, that is the integration of speech and natural language. within the task of language understanding, the use of a natural language interface meant to understand written language input, exposes issues specific to …

Content truncated to 500 words