New Metrics
otherentity
ID: newmetrics
Related Papers
Word Level Language Identification in Online Multilingual Communication
Multilingual speakers switch between lan- guages in online and spoken communication. Analyses of large scale multilingual data re- quire automatic language identification at the word level. For our experiments with …...
Refining Targeted Syntactic Evaluation of Language Models
AbstractTargeted syntactic evaluation of subject-verb number agreement in English (TSE) evaluates language models’ syntactic knowledge using hand-crafted minimal pairs of sentences that differ only in the main verb’s conjugation. The …...
Revisiting the Evaluation of End-to-end Event Extraction
Event extraction (EE) aims to harvest event in- stances from plain text, where each instance is composed of a group of event arguments with specific event roles. Existing end-to-end EE …...