Machine Reading Comprehension
Related Papers
Answerable or Not: Devising a Dataset for Extending Machine Reading Comprehension
AbstractMachine-reading comprehension (MRC) has recently attracted attention in the fields of natural language processing and machine learning. One of the problematic presumptions with current MRC technologies is that each question …...
Comparing Attention-Based Convolutional and Recurrent Neural Networks: Success and Limitations in Machine Reading Comprehension
AbstractWe propose a machine reading comprehension model based on the compare-aggregate framework with two-staged attention that achieves state-of-the-art results on the MovieQA question answering dataset. To investigate the limitations of …...
Dataset for the First Evaluation on Chinese Machine Reading Comprehension
Machine Reading Comprehension (MRC) has become enormously popular recently and has attracted a lot of attention. However, existing reading comprehension datasets are mostly in English. To add diversity in reading …...
Subword-augmented Embedding for Cloze Reading Comprehension
AbstractRepresentation learning is the foundation of machine reading comprehension. In state-of-the-art models, deep learning methods broadly use word and character level representations. However, character is not naturally the minimal linguistic …...
A Span-Extraction Dataset for Chinese Machine Reading Comprehension
AbstractMachine Reading Comprehension (MRC) has become enormously popular recently and has attracted a lot of attention. However, the existing reading comprehension datasets are mostly in English. In this paper, we …...
BERT Post-Training for Review Reading Comprehension and Aspect-based Sentiment Analysis
AbstractQuestion-answering plays an important role in e-commerce as it allows potential customers to actively seek crucial information about products or services to help their purchase decision making. Inspired by the …...
Evidence Sentence Extraction for Machine Reading Comprehension
AbstractRemarkable success has been achieved in the last few years on some limited machine reading comprehension (MRC) tasks. However, it is still difficult to interpret the predictions of existing MRC …...
Improving Pre-Trained Multilingual Model with Vocabulary Expansion
AbstractRecently, pre-trained language models have achieved remarkable success in a broad range of natural language processing tasks. However, in multilingual setting, it is extremely resource-consuming to pre-train a deep language …...
Learning to Ask Unanswerable Questions for Machine Reading Comprehension
AbstractMachine reading comprehension with unanswerable questions is a challenging task. In this work, we propose a data augmentation technique by automatically generating relevant unanswerable questions according to an answerable question …...
Multi-task Learning with Sample Re-weighting for Machine Reading Comprehension
AbstractWe propose a multi-task learning framework to learn a joint Machine Reading Comprehension (MRC) model that can be applied to a wide range of MRC tasks in different domains. Inspired …...
Relation Module for Non-Answerable Predictions on Reading Comprehension
AbstractMachine reading comprehension (MRC) has attracted significant amounts of research attention recently, due to an increase of challenging reading comprehension datasets. In this paper, we aim to improve a MRC …...
A Frame-based Sentence Representation for Machine Reading Comprehension
AbstractSentence representation (SR) is the most crucial and challenging task in Machine Reading Comprehension (MRC). MRC systems typically only utilize the information contained in the sentence itself, while human beings …...
A Framework for Evaluation of Machine Reading Comprehension Gold Standards
AbstractMachine Reading Comprehension (MRC) is the task of answering a question over a paragraph of text. While neural MRC systems gain popularity and achieve noticeable performance, issues are being raised …...
A Self-Training Method for Machine Reading Comprehension with Soft Evidence Extraction
AbstractNeural models have achieved great success on machine reading comprehension (MRC), many of which typically consist of two components: an evidence extractor and an answer predictor. The former seeks the …...
A Sentence Cloze Dataset for Chinese Machine Reading Comprehension
AbstractOwing to the continuous efforts by the Chinese NLP community, more and more Chinese machine reading comprehension datasets become available. To add diversity in this area, in this paper, we …...
A Unified MRC Framework for Named Entity Recognition
AbstractThe task of named entity recognition (NER) is normally divided into nested NER and flat NER depending on whether named entities are nested or not. Models are usually separately developed …...
A Vietnamese Dataset for Evaluating Machine Reading Comprehension
AbstractOver 97 million inhabitants speak Vietnamese as the native language in the world. However, there are few research studies on machine reading comprehension (MRC) in Vietnamese, the task of understanding …...
Ask to Learn: A Study on Curiosity-driven Question Generation
AbstractWe propose a novel text generation task, namely Curiosity-driven Question Generation. We start from the observation that the Question Generation task has traditionally been considered as the dual problem of …...
Bi-directional CognitiveThinking Network for Machine Reading Comprehension
AbstractWe propose a novel Bi-directional Cognitive Knowledge Framework (BCKF) for reading comprehension from the perspective of complementary learning systems theory. It aims to simulate two ways of thinking in the …...
CLUE: A Chinese Language Understanding Evaluation Benchmark
AbstractThe advent of natural language understanding (NLU) benchmarks for English, such as GLUE and SuperGLUE allows new NLU models to be evaluated across a diverse set of tasks. These comprehensive …...
Dice Loss for Data-imbalanced NLP Tasks
AbstractMany NLP tasks such as tagging and machine reading comprehension are faced with the severe data imbalance issue: negative examples significantly outnumber positive examples, and the huge number of easy-negative …...
Graph-Based Knowledge Integration for Question Answering over Dialogue
AbstractQuestion answering over dialogue, a specialized machine reading comprehension task, aims to comprehend a dialogue and to answer specific questions. Despite many advances, existing approaches for this task did not …...
Interactive Machine Comprehension with Information Seeking Agents
AbstractExisting machine reading comprehension (MRC) models do not scale effectively to real-world applications like web-level information retrieval and question answering (QA). We argue that this stems from the nature of …...
Learn with Noisy Data via Unsupervised Loss Correction for Weakly Supervised Reading Comprehension
AbstractWeakly supervised machine reading comprehension (MRC) task is practical and promising for its easily available and massive training data, but inevitablely introduces noise. Existing related methods usually incorporate extra submodels …...
Low-Resource Generation of Multi-hop Reasoning Questions
AbstractThis paper focuses on generating multi-hop reasoning questions from the raw text in a low resource circumstance. Such questions have to be syntactically valid and need to logically correlate with …...
MaP: A Matrix-based Prediction Approach to Improve Span Extraction in Machine Reading Comprehension
AbstractSpan extraction is an essential problem in machine reading comprehension. Most of the existing algorithms predict the start and end positions of an answer span in the given corresponding context …...
Molweni: A Challenge Multiparty Dialogues-based Machine Reading Comprehension Dataset with Discourse Structure
AbstractResearch into the area of multiparty dialog has grown considerably over recent years. We present the Molweni dataset, a machine reading comprehension (MRC) dataset with discourse structure built over multiparty …...
Read and Reason with MuSeRC and RuCoS: Datasets for Machine Reading Comprehension for Russian
AbstractThe paper introduces two Russian machine reading comprehension (MRC) datasets, called MuSeRC and RuCoS, which require reasoning over multiple sentences and commonsense knowledge to infer the answer. The former follows …...
Recurrent Chunking Mechanisms for Long-Text Machine Reading Comprehension
AbstractIn this paper, we study machine reading comprehension (MRC) on long texts: where a model takes as inputs a lengthy document and a query, extracts a text span from the …...
Robust Machine Reading Comprehension by Learning Soft labels
AbstractNeural models have achieved great success on the task of machine reading comprehension (MRC), which are typically trained on hard labels. We argue that hard labels limit the model capability …...
SQL Generation via Machine Reading Comprehension
AbstractText-to-SQL systems offers natural language interfaces to databases, which can automatically generates SQL queries given natural language questions. On the WikiSQL benchmark, state-of- the-art text-to-SQL systems typically take a slot-filling …...
Synonym Knowledge Enhanced Reader for Chinese Idiom Reading Comprehension
AbstractMachine reading comprehension (MRC) is the task that asks a machine to answer questions based on a given context. For Chinese MRC, due to the non-literal and non-compositional semantic characteristics, …...
To Test Machine Comprehension, Start by Defining Comprehension
AbstractMany tasks aim to measure machine reading comprehension (MRC), often focusing on question types presumed to be difficult. Rarely, however, do task designers start by considering what systems should in …...
Towards Medical Machine Reading Comprehension with Structural Knowledge and Plain Text
AbstractMachine reading comprehension (MRC) has achieved significant progress on the open domain in recent years, mainly due to large-scale pre-trained language models. However, it performs much worse in specific domains …...
A Chinese Machine Reading Comprehension Dataset Automatic Generated Based on Knowledge Graph
AbstractMachine reading comprehension (MRC) is a typical natural language processing (NLP)task and has developed rapidly in the last few years. Various reading comprehension datasets have been built to support MRC …...
A Study on Contextualized Language Modeling for Machine Reading Comprehension
AbstractWith the recent breakthrough of deep learning technologies, research on machine reading comprehension (MRC) has attracted much attention and found its versatile applications in many use cases. MRC is an …...
Adversarial Training for Machine Reading Comprehension with Virtual Embeddings
AbstractAdversarial training (AT) as a regularization method has proved its effectiveness on various tasks. Though there are successful applications of AT on some NLP tasks, the distinguishing characteristics of NLP …...
Benchmarking Machine Reading Comprehension: A Psychological Perspective
AbstractMachine reading comprehension (MRC) has received considerable attention as a benchmark for natural language understanding. However, the conventional task design of MRC lacks explainability beyond the model interpretation, i.e., reading …...
ChineseBERT: Chinese Pretraining Enhanced by Glyph and Pinyin Information
AbstractRecent pretraining models in Chinese neglect two important aspects specific to the Chinese language: glyph and pinyin, which carry significant syntax and semantic information for language understanding. In this work, …...
Coreference Reasoning in Machine Reading Comprehension
AbstractCoreference resolution is essential for natural language understanding and has been long studied in NLP. In recent years, as the format of Question Answering (QA) became a standard for machine …...
Decoupled Transformer for Scalable Inference in Open-domain Question Answering
AbstractLarge transformer models, such as BERT, achieve state-of-the-art results in machine reading comprehension (MRC) for open-domain question answering (QA). However, transformers have a high computational cost for inference which makes …...
Enhancing Multiple-choice Machine Reading Comprehension by Punishing Illogical Interpretations
AbstractMachine Reading Comprehension (MRC), which requires a machine to answer questions given the relevant documents, is an important way to test machines’ ability to understand human language. Multiple-choice MRC is …...
GCRC: A New Challenging MRC Dataset from Gaokao Chinese for Explainable Evaluation
Recently, driven by numerous publicly available machine reading comprehension (MRC) datasets, MRC systems have made some progress. These datasets, however, have two major limitations: 1) the defined tasks are relatively …...
Is the Understanding of Explicit Discourse Relations Required in Machine Reading Comprehension?
AbstractAn in-depth analysis of the level of language understanding required by existing Machine Reading Comprehension (MRC) benchmarks can provide insight into the reading capabilities of machines. In this paper, we …...
Machine Reading Comprehension as Data Augmentation: A Case Study on Implicit Event Argument Extraction
AbstractImplicit event argument extraction (EAE) is a crucial document-level information extraction task that aims to identify event arguments beyond the sentence level. Despite many efforts for this task, the lack …...
Modeling Context in Answer Sentence Selection Systems on a Latency Budget
AbstractAnswer Sentence Selection (AS2) is an efficient approach for the design of open-domain Question Answering (QA) systems. In order to achieve low latency, traditional AS2 models score question-answer pairs individually, …...
Multi-Strategy Knowledge Distillation Based Teacher-Student Framework for Machine Reading Comprehension
AbstractThe irrelevant information in documents poses a great challenge for machine reading compre-hension (MRC). To deal with such a challenge current MRC models generally fall into twoseparate parts: evidence extraction …...
RECONSIDER: Improved Re-Ranking using Span-Focused Cross-Attention for Open Domain Question Answering
AbstractState-of-the-art Machine Reading Comprehension (MRC) models for Open-domain Question Answering (QA) are typically trained for span selection using distantly supervised positive examples and heuristically retrieved negative examples. This training scheme …...
Relying on Discourse Analysis to Answer Complex Questions by Neural Machine Reading Comprehension
AbstractMachine reading comprehension (MRC) is one of the most challenging tasks in natural language processing domain. Recent state-of-the-art results for MRC have been achieved with the pre-trained language models, such …...
Why Machine Reading Comprehension Models Learn Shortcuts?
Recent studies report that many machine read- ing comprehension (MRC) models can per- form closely to or even better than humans on benchmark datasets. However, existing works indicate that many …...
An MRC Framework for Semantic Role Labeling
AbstractSemantic Role Labeling (SRL) aims at recognizing the predicate-argument structure of a sentence and can be decomposed into two subtasks: predicate disambiguation and argument labeling. Prior work deals with these …...
Answer Uncertainty and Unanswerability in Multiple-Choice Machine Reading Comprehension
AbstractMachine reading comprehension (MRC) has drawn a lot of attention as an approach for assessing the ability of systems to understand natural language. Usually systems focus on selecting the correct …...
Document-level Event Factuality Identification via Machine Reading Comprehension Frameworks with Transfer Learning
AbstractDocument-level Event Factuality Identification (DEFI) predicts the factuality of a specific event based on a document from which the event can be derived, which is a fundamental and crucial task …...
Improving Machine Reading Comprehension with Contextualized Commonsense Knowledge
AbstractTo perform well on a machine reading comprehension (MRC) task, machine readers usually require commonsense knowledge that is not explicitly mentioned in the given documents. This paper aims to extract …...
JBNU-CCLab at SemEval-2022 Task 12: Machine Reading Comprehension and Span Pair Classification for Linking Mathematical Symbols to Their Descriptions
AbstractThis paper describes our system in the SemEval-2022 Task 12: ‘linking mathematical symbols to their descriptions’, achieving first on the leaderboard for all the subtasks comprising named entity extraction (NER) …...
KECP: Knowledge Enhanced Contrastive Prompting for Few-shot Extractive Question Answering
AbstractExtractive Question Answering (EQA) is one of the most essential tasks in Machine Reading Comprehension (MRC), which can be solved by fine-tuning the span selecting heads of Pre-trained Language Models …...
Modeling Hierarchical Reasoning Chains by Linking Discourse Units and Key Phrases for Reading Comprehension
AbstractMachine reading comprehension (MRC) poses new challenges to logical reasoning, which aims to understand the implicit logical relations entailed in the given contexts and perform inference over them. Due to …...
On the Robustness of Reading Comprehension Models to Entity Renaming
AbstractWe study the robustness of machine reading comprehension (MRC) models to entity renaming—do models make more wrong predictions when the same questions are asked about an entity whose name has …...
OPERA: Operation-Pivoted Discrete Reasoning over Text
AbstractMachine reading comprehension (MRC) that requires discrete reasoning involving symbolic operations, e.g., addition, sorting, and counting, is a challenging task. According to this nature, semantic parsing-based methods predict interpretable but …...
Tracing Origins: Coreference-aware Machine Reading Comprehension
AbstractMachine reading comprehension is a heavily-studied research and test field for evaluating new pre-trained language models (PrLMs) and fine-tuning strategies, and recent studies have enriched the pre-trained language models with …...
The Impacts of Unanswerable Questions on the Robustness of Machine Reading Comprehension Models
AbstractPretrained language models have achieved super-human performances on many Machine Reading Comprehension (MRC) benchmarks. Nevertheless, their relative inability to defend against adversarial attacks has spurred skepticism about their natural language …...