GPT 4

AbstractLLMs are great at tasks involving English which dominates in their training data. We explore their ability to address tasks involving languages that are severely under-represented in their training data. …...

AbstractLarge neural networks can now generate jokes, but do they really “understand” humor? We challenge AI models with three tasks derived from the New Yorker Cartoon Caption Contest: matching a …...

In this research, we investigated GPT-4 as a question-answering model for the Holy Quran. As a first step, we built the Quran ques- tion–answer pair (QUQA) dataset, comprising 2,189 questions, …...

AbstractTo recognize and mitigate harms from large language models (LLMs), we need to understand the prevalence and nuances of stereotypes in LLM outputs. Toward this end, we present Marked Personas, …...

AbstractLarge language models (LLMs) have demonstrated solid zero-shot reasoning capabilities, which is reflected in their performance on the current test tasks. This calls for a more challenging benchmark requiring highly …...