metric ID: surprisal

Related Papers

A Model of Discourse Predictions in Human Sentence Processing

Authors: nan

Publication: TIPSTER (2011)

DOI: nan

This paper introduces a psycholinguistic model of sentence processing which combines a Hidden Markov Model noun phrase chun- ker with a co-reference classifier. Both mod- els are fully incremental and …...

44391

Psycholinguistic Models of Sentence Processing Improve Sentence Readability Ranking

Authors: nan

Publication: TIPSTER (2017)

DOI: nan

AbstractWhile previous research on readability has typically focused on document-level measures, recent work in areas such as natural language generation has pointed out the need of sentence-level readability measures. Much …...

42472

How is BERT surprised? Layerwise detection of linguistic anomalies

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractTransformer language models have shown remarkable ability in detecting when a word is anomalous in context, but likelihood scores offer no information about the cause of the anomaly. In this …...

8459

Revisiting the Uniform Information Density Hypothesis

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractThe uniform information density (UID) hypothesis posits a preference among language users for utterances structured such that information is distributed uniformly across a signal. While its implications on language production …...

32030

Modeling the Impact of Syntactic Distance and Surprisal on Cross-Slavic Text Comprehension

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractWe focus on the syntactic variation and measure syntactic distances between nine Slavic languages (Belarusian, Bulgarian, Croatian, Czech, Polish, Slovak, Slovene, Russian, and Ukrainian) using symmetric measures of insertion, deletion …...

14178

Are Language Models Sensitive to Semantic Attraction? A Study on Surprisal

Authors: nan

Publication: TIPSTER (2023)

DOI: nan

AbstractIn psycholinguistics, semantic attraction is a sentence processing phenomenon in which a given argument violates the selectional requirements of a verb, but this violation is not perceived by comprehenders due …...

26424

Simultaneous Interpreting as a Noisy Channel: How Much Information Gets Through

Authors: nan

Publication: TIPSTER (2023)

DOI: nan

AbstractWe explore the relationship between information density/surprisal of source and target texts in translation and interpreting in the language pair English-German, looking at the specific properties of translation (“translationese”). Our …...

20055

Why Does Surprisal From Larger Transformer-Based Language Models Provide a Poorer Fit to Human Reading Times?

Authors: nan

Publication: TIPSTER (2023)

DOI: nan

AbstractThis work presents a linguistic analysis into why larger Transformer-based pre-trained language models with more parameters and lower perplexity nonetheless yield surprisal estimates that are less predictive of human reading …...

27018