Chain of Thought
Related Papers
On Second Thought, Let’s Not Think Step by Step! Bias and Toxicity in Zero-Shot Reasoning
AbstractGenerating a Chain of Thought (CoT) has been shown to consistently improve large language model (LLM) performance on a wide range of NLP tasks. However, prior work has mainly focused …...
REV: Information-Theoretic Evaluation of Free-Text Rationales
AbstractGenerating free-text rationales is a promising step towards explainable NLP, yet evaluating such rationales remains a challenge. Existing metrics have mostly focused on measuring the association between the rationale and …...
SCOTT: Self-Consistent Chain-of-Thought Distillation
AbstractLarge language models (LMs) beyond a certain scale, demonstrate the emergent capability of generating free-text rationales for their predictions via chain-of-thought (CoT) prompting. While CoT can yield dramatically improved performance, …...
Symbolic Chain-of-Thought Distillation: Small Models Can Also “Think” Step-by-Step
AbstractChain-of-thought prompting (e.g., “Let’s think step-by-ste”) primes large language models to verbalize rationalization for their predictions. While chain-of-thought can lead to dramatic performance gains, benefits appear to emerge only for …...
Verify-and-Edit: A Knowledge-Enhanced Chain-of-Thought Framework
AbstractAs large language models (LLMs) have become the norm in NLP, demonstrating good performance in generation and reasoning tasks, one of its most fatal disadvantages is the lack of factual …...