System Evaluation
Related Papers
Designing the Human Machine Interface in the ATIS Domain
Spoken language systems for the near future will not handle all of English, but, rather, will be limited to a domain-specific sub-language. Accurate modeling of the sub-language will depend on …...
Mining Spoken Dialogue Corpora for System Evaluation and Modelin
We are interested in the problem of modeling and evaluating spoken language systems in the context of human-machine dialogs. Spoken di- alog corpora allow for a multidimensional anal- ysis of …...
Problems in Evaluating Grammatical Error Detection Systems
Many evaluation issues for grammatical error detection have previously been overlooked, making it hard to draw meaningful comparisons between different approaches, even when they are evaluated on the same corpus. …...
Evaluation of Lifelong Learning Systems
AbstractCurrent intelligent systems need the expensive support of machine learning experts to sustain their performance level when used on a daily basis. To reduce this cost, i.e. remaining free from …...