Задача клоуз
Related Papers
Implicit Argument Prediction with Event Knowledge
AbstractImplicit arguments are not syntactically connected to their predicates, and are therefore hard to extract. Previous work has used models with large numbers of features, evaluated on very small datasets. …...
Benchmarking Hierarchical Script Knowledge
AbstractUnderstanding procedural language requires reasoning about both hierarchical and temporal relations between events. For example, “boiling pasta” is a sub-event of “making a pasta dish”, typically happens before “draining pasta,” …...
Applying Masked Language Models to Search for Suitable Verbs Used in Academic Writing
Non-native speakers of English tend to use in- appropriate expressions when relating to aca- demic writing. This may cause a non-fluent essay and probably unable to convey the pre- cise …...
Sorting through the noise: Testing robustness of information processing in pre-trained language models
AbstractPre-trained LMs have shown impressive performance on downstream NLP tasks, but we have yet to establish a clear understanding of their sophistication when it comes to processing, retaining, and applying …...
Knowledge Neurons in Pretrained Transformers
AbstractLarge-scale pretrained language models are surprisingly good at recalling factual knowledge presented in the training corpus. In this paper, we present preliminary studies on how factual knowledge is stored in …...
Nowruz at SemEval-2022 Task 7: Tackling Cloze Tests with Transformers and Ordinal Regression
AbstractThis paper outlines the system using which team Nowruz participated in SemEval 2022 Task 7 “Identifying Plausible Clarifications of Implicit and Underspecified Phrases” for both subtasks A and B. Using …...
Made of Steel? Learning Plausible Materials for Components in the Vehicle Repair Domain
AbstractWe propose a novel approach to learn domain-specific plausible materials for components in the vehicle repair domain by probing Pretrained Language Models (PLMs) in a cloze task style setting to …...
Simple and Effective Multi-Token Completion from Masked Language Models
AbstractPre-trained neural masked language models are often used for predicting a replacement token for a given sequence position, in a cloze-like task. However, this usage is restricted to predicting a …...