metric ID: smatch

Related Papers

SemEval-2016 Task 8: Meaning Representation Parsing

Authors: nan

Publication: TIPSTER (2016)

DOI: nan

In this report we summarize the results of the SemEval 2016 Task 8: Meaning Representa- tion Parsing. Participants were asked to gener- ate Abstract Meaning Representation (AMR) (Banarescu et al., …...

22427

L2F/INESC-ID at SemEval-2017 Tasks 1 and 2: Lexical and semantic features in word and textual similarity

Authors: nan

Publication: TIPSTER (2017)

DOI: nan

AbstractThis paper describes our approach to the SemEval-2017 “Semantic Textual Similarity” and “Multilingual Word Similarity” tasks. In the former, we test our approach in both English and Spanish, and use …...

25360

AMR Parsing as Sequence-to-Graph Transduction

Authors: nan

Publication: TIPSTER (2019)

DOI: nan

AbstractWe propose an attention-based model that treats AMR parsing as sequence-to-graph transduction. Unlike most AMR parsers that rely on pre-trained aligners, external semantic resources, or data augmentation, our proposed parser …...

39949

SemBleu: A Robust Metric for AMR Parsing Evaluation

Authors: nan

Publication: TIPSTER (2019)

DOI: nan

AbstractEvaluating AMR parsing accuracy involves comparing pairs of AMR graphs. The major evaluation metric, SMATCH (Cai and Knight, 2013), searches for one-to-one mappings between the nodes of two AMRs with …...

39516

AMR Similarity Metrics from Principles

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractDifferent metrics have been proposed to compare Abstract Meaning Representation (AMR) graphs. The canonical Smatch metric (Cai and Knight, 2013) aligns the variables of two graphs and assesses triple matches. …...

26924

The Role of Reentrancies in Abstract Meaning Representation Parsing

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractAbstract Meaning Representation (AMR) parsing aims at converting sentences into AMR representations. These are graphs and not trees because AMR supports reentrancies (nodes with more than one parent). Following previous …...

32279

Accounting for Language Effect in the Evaluation of Cross-lingual AMR Parsers

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractCross-lingual Abstract Meaning Representation (AMR) parsers are currently evaluated in comparison to gold English AMRs, despite parsing a language other than English, due to the lack of multilingual AMR evaluation …...

4886

Align-smatch: A Novel Evaluation Method for Chinese Abstract Meaning Representation Parsing based on Alignment of Concept and Relation

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractAbstract Meaning Representation is a sentence-level meaning representation, which abstracts the meaning of sentences into a rooted acyclic directed graph. With the continuous expansion of Chinese AMR corpus, more and …...

14487

DocAMR: Multi-Sentence AMR Representation and Evaluation

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractDespite extensive research on parsing of English sentences into Abstract Meaning Representation (AMR) graphs, which are compared to gold graphs via the Smatch metric, full-document parsing into a unified graph …...

21152