Inter-sentential Coreferences in Semantic Networks: An Evaluation of Manual Annotation

9764

Authors

nan

Abstract

AbstractWe present an evaluation of inter-sentential coreference annotation in the context of manually created semantic networks. The semantic networks are constructed independently be each annotator and require an entity mapping priori to evaluating the coreference. We introduce a model used for mapping the semantic entities as well as an algorithm used for our evaluation task. Finally, we report the raw statistics for inter-annotator agreement and describe the inherent difficulty in evaluating coreference in semantic networks.

Keywords

nan

Full Content

nan

Labeled Text

AbstractWe present an evaluation of inter-sentential coreference annotation in the context of manually created semantic networks. The semantic networks are constructed independently be each annotator and require an entity mapping priori to evaluating the coreference. We introduce a model used for mapping the semantic entities as well as an algorithm used for our evaluation task. Finally, we report the raw statistics for inter-annotator agreement and describe the inherent difficulty in evaluating coreference in semantic networks.

Publication Details

Paper ID:
9764
Year:
2008
Publication:
TIPSTER
Publication Type:
conf
DOI:
nan