Поведенческие пробники
otherentity
ID: behavioralprobes
Related Papers
Does Pre-training Induce Systematic Inference? How Masked Language Models Acquire Commonsense Knowledge
AbstractTransformer models pre-trained with a masked-language-modeling objective (e.g., BERT) encode commonsense knowledge as evidenced by behavioral probes; however, the extent to which this knowledge is acquired by systematic inference over …...