Cloze Style Prompts

method ID: clozestyleprompts

Related Papers

Factual Probing Is [MASK]: Learning vs. Learning to Recall

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractPetroni et al. (2019) demonstrated that it is possible to retrieve world facts from a pre-trained language model by expressing them as cloze-style prompts and interpret the model’s prediction accuracy …...

21427

How Pre-trained Language Models Capture Factual Knowledge? A Causal-Inspired Analysis

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractRecently, there has been a trend to investigate the factual knowledge captured by Pre-trained Language Models (PLMs). Many works show the PLMs’ ability to fill in the missing factual words …...

32735