Smatch
Related Papers
SemEval-2016 Task 8: Meaning Representation Parsing
In this report we summarize the results of the SemEval 2016 Task 8: Meaning Representa- tion Parsing. Participants were asked to gener- ate Abstract Meaning Representation (AMR) (Banarescu et al., …...
L2F/INESC-ID at SemEval-2017 Tasks 1 and 2: Lexical and semantic features in word and textual similarity
AbstractThis paper describes our approach to the SemEval-2017 “Semantic Textual Similarity” and “Multilingual Word Similarity” tasks. In the former, we test our approach in both English and Spanish, and use …...
AMR Parsing as Sequence-to-Graph Transduction
AbstractWe propose an attention-based model that treats AMR parsing as sequence-to-graph transduction. Unlike most AMR parsers that rely on pre-trained aligners, external semantic resources, or data augmentation, our proposed parser …...
SemBleu: A Robust Metric for AMR Parsing Evaluation
AbstractEvaluating AMR parsing accuracy involves comparing pairs of AMR graphs. The major evaluation metric, SMATCH (Cai and Knight, 2013), searches for one-to-one mappings between the nodes of two AMRs with …...
AMR Similarity Metrics from Principles
AbstractDifferent metrics have been proposed to compare Abstract Meaning Representation (AMR) graphs. The canonical Smatch metric (Cai and Knight, 2013) aligns the variables of two graphs and assesses triple matches. …...
The Role of Reentrancies in Abstract Meaning Representation Parsing
AbstractAbstract Meaning Representation (AMR) parsing aims at converting sentences into AMR representations. These are graphs and not trees because AMR supports reentrancies (nodes with more than one parent). Following previous …...
Accounting for Language Effect in the Evaluation of Cross-lingual AMR Parsers
AbstractCross-lingual Abstract Meaning Representation (AMR) parsers are currently evaluated in comparison to gold English AMRs, despite parsing a language other than English, due to the lack of multilingual AMR evaluation …...
Align-smatch: A Novel Evaluation Method for Chinese Abstract Meaning Representation Parsing based on Alignment of Concept and Relation
AbstractAbstract Meaning Representation is a sentence-level meaning representation, which abstracts the meaning of sentences into a rooted acyclic directed graph. With the continuous expansion of Chinese AMR corpus, more and …...
DocAMR: Multi-Sentence AMR Representation and Evaluation
AbstractDespite extensive research on parsing of English sentences into Abstract Meaning Representation (AMR) graphs, which are compared to gold graphs via the Smatch metric, full-document parsing into a unified graph …...