Эталонные тесты здравого смысла

AbstractHumans use countless basic, shared facts about the world to efficiently navigate in their environment. This commonsense knowledge is rarely communicated explicitly, however, understanding how commonsense knowledge is represented in …...

AbstractCommonsense reasoning benchmarks have been largely solved by fine-tuning language models. The downside is that fine-tuning may cause models to overfit to task-specific data and thereby forget their knowledge gained …...

Recently, knowledge graph (KG) augmented models have achieved noteworthy success on various commonsense reasoning tasks. How- ever, KG edge (fact) sparsity and noisy edge extraction/generation often hinder mod- els from …...

Many commonsense reasoning NLP tasks in- volve choosing between one or more possi- ble answers to a question or prompt based on knowledge that is often implicit. Large pre- trained …...

AbstractCommonsense reasoning systems should be able to generalize to diverse reasoning cases. However, most state-of-the-art approaches depend on expensive data annotations and overfit to a specific benchmark without learning how …...