Overview of Todai Robot Project and Evaluation Framework of its NLP-based Problem Solving
15876Authors
nan
Abstract
AbstractWe introduce the organization of the Todai Robot Project and discuss its achievements. The Todai Robot Project task focuses on benchmarking NLP systems for problem solving. This task encourages NLP-based systems to solve real high-school examinations. We describe the details of the method to manage question resources and their correct answers, answering tools and participation by researchers in the task. We also analyse the answering accuracy of the developed systems by comparing the systemsÂ’ answers with answers given by human test-takers.
Keywords
Full Content
nan
Labeled Text
AbstractWe introduce the organization of the Todai Robot Project and discuss its achievements. The Todai Robot Project task focuses on benchmarking NLP systems for problem solving. This task encourages NLP-based systems to solve real high-school examinations. We describe the details of the method to manage question resources and their correct answers, answering tools and participation by researchers in the task. We also analyse the answering accuracy of the developed systems by comparing the systemsÂ’ answers with answers given by human test-takers.
Publication Details
- Paper ID:
- 15876
- Year:
- 2014
- Publication:
- TIPSTER
- Publication Type:
- conf
- DOI:
- nan