SEMBLEU
metric
ID: sembleu
Related Papers
SemBleu: A Robust Metric for AMR Parsing Evaluation
AbstractEvaluating AMR parsing accuracy involves comparing pairs of AMR graphs. The major evaluation metric, SMATCH (Cai and Knight, 2013), searches for one-to-one mappings between the nodes of two AMRs with …...
AMR Similarity Metrics from Principles
AbstractDifferent metrics have been proposed to compare Abstract Meaning Representation (AMR) graphs. The canonical Smatch metric (Cai and Knight, 2013) aligns the variables of two graphs and assesses triple matches. …...