Стандартные метрики
Related Papers
HEADS: Headline Generation as Sequence Prediction Using an Abstract Feature-Rich Space
Feature-Rich Space Carlos A. Colmenares∗ Google Inc. Brandschenkestrasse 110 8002 Zurich, Switzerland crcarlos@google.com Marina Litvak Shamoon College of Engineering Beer Sheva, Israel marinal@sce.ac.il Amin Mantrach Fabrizio Silvestri Yahoo Labs. Avinguda …...
Polly Want a Cracker: Analyzing Performance of Parroting on Paraphrase Generation Datasets
AbstractParaphrase generation is an interesting and challenging NLP task which has numerous practical applications. In this paper, we analyze datasets commonly used for paraphrase generation research, and show that simply …...
Style Transfer for Texts: Retrain, Report Errors, Compare with Rewrites
AbstractThis paper shows that standard assessment methodology for style transfer has several significant problems. First, the standard metrics for style accuracy and semantics preservation vary significantly on different re-runs. Therefore …...
Is Killed More Significant than Fled? A Contextual Model for Salient Event Detection
AbstractIdentifying the key events in a document is critical to holistically understanding its important information. Although measuring the salience of events is highly contextual, most previous work has used a …...
Extracting Event Temporal Relations via Hyperbolic Geometry
AbstractDetecting events and their evolution through time is a crucial task in natural language understanding. Recent neural approaches to event temporal relation extraction typically map events to embeddings in the …...
Numerical reasoning in machine reading comprehension tasks: are we there yet?
AbstractNumerical reasoning based machine reading comprehension is a task that involves reading comprehension along with using arithmetic operations such as addition, subtraction, sorting and counting. The DROP benchmark (Dua et …...
The Role of Syntactic Planning in Compositional Image Captioning
AbstractImage captioning has focused on generalizing to images drawn from the same distribution as the training set, and not to the more challenging problem of generalizing to different distributions of …...