Overestimate Systematicity
metric
ID: overestimatesystematicity
Related Papers
Refining Targeted Syntactic Evaluation of Language Models
AbstractTargeted syntactic evaluation of subject-verb number agreement in English (TSE) evaluates language models’ syntactic knowledge using hand-crafted minimal pairs of sentences that differ only in the main verb’s conjugation. The …...