TREC 2003

Definition questions represent a largely unex- plored area of question answering—they are different from factoid questions in that the goal is to return as many relevant “nuggets” of information about …...

* Statistical ranking methods based on cen- troid vector (profile) extracted from ex- ternal knowledge have become widely adopted in the top definitional QA sys- tems in TREC 2003 and …...

The present methodology for evaluating complex questions at TREC analyzes an- swers in terms of facts called “nuggets”. The official F-score metric represents the harmonic mean between recall and pre- …...