HotpotQA
Related Papers
Avoiding Reasoning Shortcuts: Adversarial Evaluation, Training, and Model Development for Multi-Hop QA
AbstractMulti-hop question answering requires a model to connect multiple pieces of evidence scattered in a long context to answer the question. In this paper, we show that in the multi-hop …...
Dynamically Fused Graph Network for Multi-hop Reasoning
AbstractText-based question answering (TBQA) has been studied extensively in recent years. Most existing approaches focus on finding the answer to a question within a single paragraph. However, many difficult questions …...
Multi-hop Reading Comprehension through Question Decomposition and Rescoring
AbstractMulti-hop Reading Comprehension (RC) requires reasoning and aggregation across several paragraphs. We propose a system for multi-hop RC that decomposes a compositional question into simpler sub-questions that can be answered …...
Self-Assembling Modular Networks for Interpretable Multi-Hop Reasoning
AbstractMulti-hop QA requires a model to connect multiple pieces of evidence scattered in a long context to answer the question. The recently proposed HotpotQA (Yang et al., 2018) dataset is …...
A Simple Yet Strong Pipeline for HotpotQA
AbstractState-of-the-art models for multi-hop question answering typically augment large-scale language models like BERT with additional, intuitively useful capabilities such as named entity recognition, graph-based reasoning, and question decomposition. However, does …...
Answer-driven Deep Question Generation based on Reinforcement Learning
AbstractDeep question generation (DQG) aims to generate complex questions through reasoning over multiple documents. The task is challenging and underexplored. Existing methods mainly focus on enhancing document representations, with little …...
Break It Down: A Question Understanding Benchmark
AbstractUnderstanding natural language questions entails the ability to break down a question into the requisite steps for computing its answer. In this work, we introduce a Question Decomposition Meaning Representation …...
Context-Aware Answer Extraction in Question Answering
AbstractExtractive QA models have shown very promising performance in predicting the correct answer to a question for a given passage. However, they sometimes result in predicting the correct answer text …...
Hierarchical Graph Network for Multi-hop Question Answering
AbstractIn this paper, we present Hierarchical Graph Network (HGN) for multi-hop question answering. To aggregate clues from scattered texts across multiple paragraphs, a hierarchical graph is created by constructing nodes …...
Is Multihop QA in DiRe Condition? Measuring and Reducing Disconnected Reasoning
AbstractHas there been real progress in multi-hop question-answering? Models often exploit dataset artifacts to produce correct answers, without connecting information across multiple supporting facts. This limits our ability to measure …...
Logic-Guided Data Augmentation and Regularization for Consistent Question Answering
AbstractMany natural language questions require qualitative, quantitative or logical comparisons between two entities or events. This paper addresses the problem of improving the accuracy and consistency of responses to comparison …...
Low-Resource Generation of Multi-hop Reasoning Questions
AbstractThis paper focuses on generating multi-hop reasoning questions from the raw text in a low resource circumstance. Such questions have to be syntactically valid and need to logically correlate with …...
Propagate-Selector: Detecting Supporting Sentences for Question Answering via Graph Neural Networks
AbstractIn this study, we propose a novel graph neural network called propagate-selector (PS), which propagates information over sentences to understand information that cannot be inferred when considering sentences in isolation. …...
Reinforced Multi-task Approach for Multi-hop Question Generation
AbstractQuestion generation (QG) attempts to solve the inverse of question answering (QA) problem by generating a natural language question given a document and an answer. While sequence to sequence neural …...
Semantic Graphs for Generating Deep Questions
AbstractThis paper proposes the problem of Deep Question Generation (DQG), which aims to generate complex questions that require reasoning over multiple pieces of information about the input passage. In order …...
Span Selection Pre-training for Question Answering
AbstractBERT (Bidirectional Encoder Representations from Transformers) and related pre-trained Transformers have provided large gains across many language understanding tasks, achieving a new state-of-the-art (SOTA). BERT is pretrained on two auxiliary …...
SRLGRN: Semantic Role Labeling Graph Reasoning Network
AbstractThis work deals with the challenge of learning and reasoning over multi-hop question answering (QA). We propose a graph reasoning network based on the semantic structure of the sentences to …...
Unsupervised Question Decomposition for Question Answering
AbstractWe aim to improve question answering (QA) by decomposing hard questions into simpler sub-questions that existing QA systems are capable of answering. Since labeling questions with decompositions is cumbersome, we …...
Breadth First Reasoning Graph for Multi-hop Question Answering
AbstractRecently Graph Neural Network (GNN) has been used as a promising tool in multi-hop question answering task. However, the unnecessary updations and simple edge constructions prevent an accurate answer span …...
Do Multi-Hop Question Answering Systems Know How to Answer the Single-Hop Sub-Questions?
AbstractMulti-hop question answering (QA) requires a model to retrieve and integrate information from multiple passages to answer a question. Rapid progress has been made on multi-hop QA systems with regard …...
Learning with Instance Bundles for Reading Comprehension
AbstractWhen training most modern reading comprehension models, all the questions associated with a context are treated as being independent from each other. However, closely related questions and their corresponding answers …...
Mitigating False-Negative Contexts in Multi-document Question Answering with Retrieval Marginalization
AbstractQuestion Answering (QA) tasks requiring information from multiple documents often rely on a retrieval model to identify relevant information for reasoning. The retrieval model is typically trained to maximize the …...
RealFormer: Transformer Likes Residual Attention
Transformer is the backbone of modern NLP models. In this paper, we propose Real- Former, a simple and generic technique to create Residual Attention Layer Transformer networks that significantly outperform …...
Robustifying Multi-hop QA through Pseudo-Evidentiality Training
AbstractThis paper studies the bias problem of multi-hop question answering models, of answering correctly without correct reasoning. One way to robustify these models is by supervising to not only answer …...
Text Modular Networks: Learning to Decompose Tasks in the Language of Existing Models
AbstractWe propose a general framework called Text Modular Networks(TMNs) for building interpretable systems that learn to solve complex tasks by decomposing them into simpler ones solvable by existing models. To …...
A STEP towards Interpretable Multi-Hop Reasoning:Bridge Phrase Identification and Query Expansion
AbstractWe propose an unsupervised method for the identification of bridge phrases in multi-hop question answering (QA). Our method constructs a graph of noun phrases from the question and the available …...
CQG: A Simple and Effective Controlled Generation Framework for Multi-hop Question Generation
AbstractMulti-hop question generation focuses on generating complex questions that require reasoning over multiple pieces of information of the input passage. Current models with state-of-the-art performance have been able to generate …...
Learning to Generate Question by Asking Question: A Primal-Dual Approach with Uncommon Word Generation
AbstractAutomatic question generation (AQG) is the task of generating a question from a given passage and an answer. Most existing AQG methods aim at encoding the passage and the answer …...
LinkBERT: Pretraining Language Models with Document Links
AbstractLanguage model (LM) pretraining captures various knowledge from text corpora, helping downstream tasks. However, existing methods such as BERT model a single document, and do not capture dependencies or knowledge …...
Locate Then Ask: Interpretable Stepwise Reasoning for Multi-hop Question Answering
AbstractMulti-hop reasoning requires aggregating multiple documents to answer a complex question. Existing methods usually decompose the multi-hop question into simpler single-hop questions to solve the problem for illustrating the explainable …...
Long Context Question Answering via Supervised Contrastive Learning
AbstractLong-context question answering (QA) tasks require reasoning over a long document or multiple documents. Addressing these tasks often benefits from identifying a set of evidence spans (e.g., sentences), which provide …...
Modeling Multi-hop Question Answering as Single Sequence Prediction
AbstractFusion-in-decoder (Fid) (Izacard and Grave, 2020) is a generative question answering (QA) model that leverages passage retrieval with a pre-trained transformer and pushed the state of the art on single-hop …...
Question Generation Based on Grammar Knowledge and Fine-grained Classification
AbstractQuestion generation is the task of automatically generating questions based on given context and answers, and there are problems that the types of questions and answers do not match. In …...
Analyzing the Effectiveness of the Underlying Reasoning Tasks in Multi-hop Question Answering
AbstractTo explain the predicted answers and evaluate the reasoning abilities of models, several studies have utilized underlying reasoning (UR) tasks in multi-hop question answering (QA) datasets. However, it remains an …...
Counterfactual Multihop QA: A Cause-Effect Approach for Reducing Disconnected Reasoning
AbstractMulti-hop QA requires reasoning over multiple supporting facts to answer the question. However, the existing QA models always rely on shortcuts, e.g., providing the true answer by only one fact, …...
Few-shot Reranking for Multi-hop QA via Language Model Prompting
AbstractWe study few-shot reranking for multi-hop QA (MQA) with open-domain questions. To alleviate the need for a large number of labeled question-document pairs for retriever training, we propose PromptRank, which …...
Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questions
AbstractPrompting-based large language models (LLMs) are surprisingly powerful at generating natural language reasoning steps or Chains-of-Thoughts (CoT) for multi-step question answering (QA). They struggle, however, when the necessary knowledge is …...
Single Sequence Prediction over Reasoning Graphs for Multi-hop QA
AbstractRecent generative approaches for multi-hop question answering (QA) utilize the fusion-in-decoder method to generate a single sequence output which includes both a final answer and a reasoning path taken to …...