Сандық ойлау
Related Papers
Diversify Your Datasets: Analyzing Generalization via Controlled Variance in Adversarial Datasets
AbstractPhenomenon-specific “adversarial” datasets have been recently designed to perform targeted stress-tests for particular inference types. Recent work (Liu et al., 2019a) proposed that such datasets can be utilized for training …...
Do NLP Models Know Numbers? Probing Numeracy in Embeddings
AbstractThe ability to understand and work with numbers (numeracy) is critical for many complex reasoning tasks. Currently, most NLP models treat numbers in text in the same way as other …...
DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphs
AbstractReading comprehension has recently seen rapid progress, with systems matching humans on the most popular datasets for the task. However, a large body of work has highlighted the brittleness of …...
Giving BERT a Calculator: Finding Operations and Arguments with Reading Comprehension
AbstractReading comprehension models have been successfully applied to extractive text answers, but it is unclear how best to generalize these models to abstractive numerical answers. We enable a BERT-based reading …...
Methods for Numeracy-Preserving Word Embeddings
AbstractWord embedding models are typically able to capture the semantics of words via the distributional hypothesis, but fail to capture the numerical properties of numbers that appear in the text. …...
Question Directed Graph Attention Network for Numerical Reasoning over Text
AbstractNumerical reasoning over texts, such as addition, subtraction, sorting and counting, is a challenging machine reading comprehension task, since it requires both natural language understanding and arithmetic computation. To address …...
FinQA: A Dataset of Numerical Reasoning over Financial Data
AbstractThe sheer volume of financial statements makes it difficult for humans to access and analyze a business’s financials. Robust numerical reasoning likewise faces unique challenges in this domain. In this …...
Have You Seen That Number? Investigating Extrapolation in Question Answering Models
AbstractNumerical reasoning in machine reading comprehension (MRC) has shown drastic improvements over the past few years. While the previous models for numerical MRC are able to interpolate the learned numerical …...
Numerical reasoning in machine reading comprehension tasks: are we there yet?
AbstractNumerical reasoning based machine reading comprehension is a task that involves reading comprehension along with using arithmetic operations such as addition, subtraction, sorting and counting. The DROP benchmark (Dua et …...
TAT-QA: A Question Answering Benchmark on a Hybrid of Tabular and Textual Content in Finance
AbstractHybrid data combining both tabular and textual content (e.g., financial reports) are quite pervasive in the real world. However, Question Answering (QA) over such hybrid data is largely neglected in …...
Towards Table-to-Text Generation with Numerical Reasoning
AbstractRecent neural text generation models have shown significant improvement in generating descriptive text from structured data such as table formats. One of the remaining important challenges is generating more analytical …...
Answering Numerical Reasoning Questions in Table-Text Hybrid Contents with Graph-based Encoder and Tree-based Decoder
In the real-world question answering scenar- ios, hybrid form combining both tabular and textual contents has attracted more and more attention, among which numerical reasoning problem is one of the …...
Enhancing Financial Table and Text Question Answering with Tabular Graph and Numerical Reasoning
AbstractTypical financial documents consist of tables, texts, and numbers. Given sufficient training data, large language models (LM) can learn the tabular structures and perform numerical reasoning well in question answering …...
MultiHiertt: Numerical Reasoning over Multi Hierarchical Tabular and Textual Data
AbstractNumerical reasoning over hybrid data containing both textual and tabular content (e.g., financial reports) has recently attracted much attention in the NLP community. However, existing question answering (QA) benchmarks over …...
Teaching Neural Module Networks to Do Arithmetic
AbstractAnswering complex questions that require multi-step multi-type reasoning over raw text is challenging, especially when conducting numerical reasoning. Neural Module Networks (NMNs), follow the programmer-interpreter framework and design trainable modules …...
FERMAT: An Alternative to Accuracy for Numerical Reasoning
AbstractWhile pre-trained language models achieve impressive performance on various NLP benchmarks, they still struggle with tasks that require numerical reasoning. Recent advances in improving numerical reasoning are mostly achieved using …...
MatCha: Enhancing Visual Language Pretraining with Math Reasoning and Chart Derendering
AbstractVisual language data such as plots, charts, and infographics are ubiquitous in the human world. However, state-of-the-art vision-language models do not perform well on these data. We propose MatCha (Math …...