A Simulation-Based Research Strategy for Designing Complex NL Systems

A SIMULATION-BASED RESEARCH STRATEGY FOR DESIGNING COMPLEX NL SYSTEMS* Sharon Oviatt, Philip Cohen, Michelle Wang 8J Jeremy Gaston t ABSTRACT Basic research is critically needed to guide the development of a new generation of multimodal and multilingual NL sys- tems. This paper summarizes the goals, capabilities, com- puting environment, and performance characteristics of a new semi-automatic simulation technique. This technique has been designed to support a wide spectrum of empiri- cal studies on highly interactive speech, writing, and multi- modal systems incorporating pen and voice. Initial studies using this technique have provided information on people's language, performance, and preferential use of these com- munication modalities, either alone or in multimodal combi- nation. One aim of this research has been to explore how the selection of input modality and presentation format can be used to reduce difficult sources of linguistic variability in people's speech and writing, such that more robust system processing results. The development of interface techniques for channeling users' language will be important to the ability of complex NL systems to function successfully in actual field use, as well as to the overall commercialization of this tech- nology. Future extensions of the present simulation research also are discussed. 1. INTRODUCTION Basic research is critically needed to guide the develop: ment of a new generation of complex natural language systems that are still in the planning stages, such as ones that support multimodal, multilingual, or multiparty ex- changes across a variety of intended applications. In the case of planned multimodal systems, for example, the potential exists to support more robust, productive, and flexible human-computer interaction than that afforded by current unimodal ones [3]. However, since multimodal systems are relatively complex, the problem of how to design optimal configurations is unlikely to be solved through simple intuition alone. Advance empirical work *This research was supported in part by Grant No. IFti-9213472 from the National Science Foundation to the first authors, as well as additional funding and equipment donations from ATR Interns- tional, Apple Computer, USWest, and ~Vacom Inc. Any opinions, findings, or conclusions expressed in this paper are those of the authors, and do not necessarily reflect the views of our sponsors. t Michelle Wang is afl'diated with the Computer Science Depart- ment and Jeremy Gaston with the Symbolic Systems Program at Stanford University. Computer Dialogue Laboratory A.I. Center, SRI International 333 Ravenswood Avenue Menlo Park, California, U.S.A. 94025 with human subjects will be needed to generate a factual basis for designing multimodal systems that can actually deliver performance superior to unimodal ones. In particular, there is a special need for both method- ological tools and research results based on high-quality simulations of proposed complex NL systems. Such simulations can reveal specific information about peo- ple's language, task performance, and preferential use of different types of systems, so that they can be de- signed to handle expected input. Likewise, simulation research provides a relatively affordable and nimble way to compare the specific advantages and disadvantages of alternative architectures, such that more …

Content truncated to 500 words