Теория информации
Related Papers
The Candide System for Machine Translation
We present an overview of Candide, a system for automatic translation of French text to English text. Candide uses methods of information theory and statistics to develop a probability model …...
A Database for Measuring Linguistic Information Content
AbstractWhich languages convey the most information in a given amount of space? This is a question often asked of linguists, especially by engineers who often have some information theoretic measure …...
Extractive Summarisation Based on Keyword Profile and Language Model
We present a statistical framework to extract information-rich citation sentences that sum- marise the main contributions of a scientific paper. In a first stage, we automatically dis- cover salient keywords …...
Modeling Diachronic Change in Scientific Writing with Information Density
AbstractPrevious linguistic research on scientific writing has shown that language use in the scientific domain varies considerably in register and style over time. In this paper we investigate the introduction …...
Modeling Content Importance for Summarization with Pre-trained Language Models
AbstractModeling content importance is an essential yet challenging task for summarization. Previous work is mostly based on statistical methods that estimate word-level salience, which does not consider semantics and larger …...
A Bayesian Framework for Information-Theoretic Probing
AbstractPimentel et al. (2020) recently analysed probing from an information-theoretic perspective. They argue that probing should be seen as approximating a mutual information. This led to the rather unintuitive conclusion …...