Оценка без обучения

method ID: zeroshotevaluation

Related Papers

CompGuessWhat?!: A Multi-task Evaluation Framework for Grounded Language Learning

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractApproaches to Grounded Language Learning are commonly focused on a single task-based final performance measure which may not depend on desirable properties of the learned hidden representations, such as their …...

37292

oLMpics-On What Language Model Pre-training Captures

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractRecent success of pre-trained language models (LMs) has spurred widespread interest in the language capabilities that they possess. However, efforts to understand whether LM representations are useful for symbolic reasoning …...

26909

Avoiding Inference Heuristics in Few-shot Prompt-based Finetuning

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractRecent prompt-based approaches allow pretrained language models to achieve strong performances on few-shot finetuning by reformulating downstream tasks as a language modeling problem. In this work, we demonstrate that, despite …...

30998

Persian Natural Language Inference: A Meta-learning Approach

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractIncorporating information from other languages can improve the results of tasks in low-resource languages. A powerful method of building functional natural language processing systems for low-resource languages is to combine …...

4839

ThinkSum: Probabilistic reasoning over sets using large language models

Authors: nan

Publication: TIPSTER (2023)

DOI: nan

AbstractLarge language models (LLMs) have a substantial capacity for high-level analogical reasoning: reproducing patterns in linear text that occur in their training data (zero-shot evaluation) or in the provided context …...

38787