Statistical Significance
Related Papers
Do we Need Linguistics When We Have Statistics? A Comparative Analysis of the Contributions of Linguistic Cues to a Statistical Word Grouping System
We present a comparative analysis of the performance of a statistics-based system for the formation of semantic groups of adjectives when various sources of linguistic knowledge are introduced. We identify …...
Measuring Correlation Between Linguist’s Judgments and Latent Dirichlet Allocation Topics
Data that has been annotated by linguists is often considered a gold standard on many tasks in the NLP field. However, linguists are expensive so researchers seek automatic techniques that …...
Code-Switch Language Model with Inversion Constraints for Mixed Language Speech Recognition
We propose a first ever code-switch language model for mixed language speech recognition that incorporates syntactic constraints by a code-switch boundary prediction model, a code-switch translation model, and a reconstruction …...
Using Language Resources in Humanities research
AbstractIn this paper we present two real cases, in the fields of discourse analysis of newspapers and communication research which demonstrate the impact of Language Resources (LR) and NLP in …...
A Repository of State of the Art and Competitive Baseline Summaries for Generic News Summarization
AbstractIn the period since 2004, many novel sophisticated approaches for generic multi-document summarization have been developed. Intuitive simple approaches have also been shown to perform unexpectedly well for the task. …...
Keyphrase Annotation with Graph Co-Ranking
AbstractKeyphrase annotation is the task of identifying textual units that represent the main content of a document. Keyphrase annotation is either carried out by extracting the most important phrases from …...
Reporting Score Distributions Makes a Difference: Performance Study of LSTM-networks for Sequence Tagging
AbstractIn this paper we show that reporting a single performance score is insufficient to compare non-deterministic approaches. We demonstrate for common sequence tagging tasks that the seed value for the …...
Searching for a Higher Power in the Human Evaluation of MT
AbstractIn MT evaluation, pairwise comparisons are conducted to identify the better system. In conducting the comparison, the experimenter must allocate a budget to collect Direct Assessment (DA) judgments. We provide …...