TREC

An important first step in developing a cross-lingual question answering system is to understand whether techniques developed with English text will also work with other languages, such as Chinese. The …...

Recent TREC results have demonstrated the need for deeper text understanding methods. This paper introduces the idea of automated reasoning applied to question answering and shows the feasibility of integrating …...

We present a practically unsupervised learning method to produce single-snippet answers to definition questions in ques- tion answering systems that supplement Web search engines. The method exploits on-line encyclopedias and …...

Test collections are essential to evaluate Information Retrieval (IR) systems. The relevance assessment set has been recog- nized as the key bottleneck in test col- lection building, especially on very …...

General information retrieval systems are designed to serve all users without con- sidering individual needs. In this paper, we propose a novel approach to person- alized search. It can, in …...

This paper demonstrates a conceptually simple but effective method of increasing the accuracy of QA systems on factoid-style questions. We define the notion of an inverted question, and show that …...

The present methodology for evaluating complex questions at TREC analyzes an- swers in terms of facts called “nuggets”. The official F-score metric represents the harmonic mean between recall and pre- …...

Research in Question Answering (QA) has been dominated by the TREC methodology of black-box system evaluation. This makes it difficult to evaluate the effectiveness of in- dividual components and requires …...