InstructGPT
Related Papers
Help me write a Poem: Instruction Tuning as a Vehicle for Collaborative Poetry Writing
AbstractRecent work in training large language models (LLMs) to follow natural language instructions has opened up exciting opportunities for natural language interface design. Building on the prior success of large …...
Analyzing ChatGPT’s Mathematical Deficiencies: Insights and Contributions
In this study, we assess ChatGPT, OpenAI’s latest conversational chatbot and large lan- guage model (LLM), on its performance in elementary-grade arithmetic and logic prob- lems. Despite its impressive coherence …...
Language models are not naysayers: an analysis of language models on negation benchmarks
AbstractNegation has been shown to be a major bottleneck for masked language models, such as BERT. However, whether this finding still holds for larger-sized auto-regressive language models (“LLMs”) has not …...
Precise Zero-Shot Dense Retrieval without Relevance Labels
AbstractWhile dense retrieval has been shown to be effective and efficient across tasks and languages, it remains difficult to create effective fully zero-shot dense retrieval systems when no relevance labels …...