Оценка без обучения
Related Papers
CompGuessWhat?!: A Multi-task Evaluation Framework for Grounded Language Learning
AbstractApproaches to Grounded Language Learning are commonly focused on a single task-based final performance measure which may not depend on desirable properties of the learned hidden representations, such as their …...
oLMpics-On What Language Model Pre-training Captures
AbstractRecent success of pre-trained language models (LMs) has spurred widespread interest in the language capabilities that they possess. However, efforts to understand whether LM representations are useful for symbolic reasoning …...
Avoiding Inference Heuristics in Few-shot Prompt-based Finetuning
AbstractRecent prompt-based approaches allow pretrained language models to achieve strong performances on few-shot finetuning by reformulating downstream tasks as a language modeling problem. In this work, we demonstrate that, despite …...
Persian Natural Language Inference: A Meta-learning Approach
AbstractIncorporating information from other languages can improve the results of tasks in low-resource languages. A powerful method of building functional natural language processing systems for low-resource languages is to combine …...
ThinkSum: Probabilistic reasoning over sets using large language models
AbstractLarge language models (LLMs) have a substantial capacity for high-level analogical reasoning: reproducing patterns in linear text that occur in their training data (zero-shot evaluation) or in the provided context …...