Predictive Performance
Related Papers
Using Machine Learning Techniques to Interpret WH-questions
We describe a set of supervised ma- chine learning experiments centering on the construction of statistical mod- els of WH-questions. These models, which are built from shallow linguis- tic features …...
Efficient Subsampling for Training Complex Language Models
We propose an efficient way to train maximum entropy language models (MELM) and neural network language models (NNLM). The ad- vantage of the proposed method comes from a more robust …...
Graph-Based Lexicon Expansion with Sparsity-Inducing Penalties
We present novel methods to construct com- pact natural language lexicons within a graph- based semi-supervised learning framework, an attractive platform suited for propagating soft labels onto new natural language …...
Context-aware Argumentative Relation Mining
Context is crucial for identifying argumen- tative relations in text, but many argument mining methods make little use of contex- tual features. This paper presents context- aware argumentative relation mining …...
Joint Modeling of Content and Discourse Relations in Dialogues
AbstractWe present a joint modeling approach to identify salient discussion points in spoken meetings as well as to label the discourse relations between speaker turns. A variation of our model …...
Attention is not Explanation
AbstractAttention mechanisms have seen wide adoption in neural NLP models. In addition to improving predictive performance, these are often touted as affording transparency: models equipped with attention provide a distribution …...
Characterizing the Value of Information in Medical Notes
AbstractMachine learning models depend on the quality of input data. As electronic health records are widely adopted, the amount of data in health care is growing, along with complaints about …...
Empirical Evaluation of Pre-trained Transformers for Human-Level NLP: The Role of Sample Size and Dimensionality
AbstractIn human-level NLP tasks, such as predicting mental health, personality, or demographics, the number of observations is often smaller than the standard 768+ hidden state sizes of each layer within …...
Learning Bill Similarity with Annotated and Augmented Corpora of Bills
AbstractBill writing is a critical element of representative democracy. However, it is often overlooked that most legislative bills are derived, or even directly copied, from other bills. Despite the significance …...
An Ordinal Latent Variable Model of Conflict Intensity
AbstractMeasuring the intensity of events is crucial for monitoring and tracking armed conflict. Advances in automated event extraction have yielded massive data sets of “who did what to whom” micro-records …...
Do Neural Topic Models Really Need Dropout? Analysis of the Effect of Dropout in Topic Modeling
AbstractDropout is a widely used regularization trick to resolve the overfitting issue in large feedforward neural networks trained on a small dataset, which performs poorly on the held-out test subset. …...