Минималды сипаттама ұзындығы
Related Papers
MDL-based DCG Induction for NP Identification
We introduce a learner capable of automatically extend- ing large, manually written natural language Definite Clause Grammars with missing syntactic rules. It is based upon the Minimum Description Length princi- …...
Unsupervised Learning of Word Boundary with Description Length Gain
This paper presents an unsupervised approach to lexical acquisition with the goodness measure de- scription length gain (DLG) formulated following classic information theory within the minimum de- scription length (MDL) …...
Efficient Unsupervised Recursive Word Segmentation Using Minimum Description Length
Automatic word segmentation is a basic re- quirement for unsupervised learning in morpho- logical analysis. In this paper, we formulate a novel recursive method for minimum descrip- tion length (MDL) …...
Automatic Learning of Context-Free Grammar
In this paper we study the problem of learning context-free grammar from a cor- pus. We investigate a technique that is based on the notion of minimum description length of …...
Unsupervised Morphological Segmentation with Log-Linear Models
Morphological segmentation breaks words into morphemes (the basic semantic units). It is a key component for natural language pro- cessing systems. Unsupervised morphologi- cal segmentation is attractive, because in ev- …...
Krimping texts for better summarization
Automated text summarization is aimed at extracting essential information from orig- inal text and presenting it in a minimal, often predefined, number of words. In this paper, we introduce a …...
Orthographic and Morphological Correspondences between Related Slavic Languages as a Base for Modeling of Mutual Intelligibility
AbstractIn an intercomprehension scenario, typically a native speaker of language L1 is confronted with output from an unknown, but related language L2. In this setting, the degree to which the …...
Unsupervised Bilingual Segmentation using MDL for Machine Translation
In statistical machine translation systems, a problem arises from the weak performance in alignment due to differences in word form or granularity across different languages. To address this problem, in …...
Information-Theoretic Probing with Minimum Description Length
AbstractTo measure how well pretrained representations encode some linguistic property, it is common to use accuracy of a probe, i.e. a classifier trained to predict the property from the representations. …...
Adversarial Scrubbing of Demographic Information for Text Classification
AbstractContextual representations learned by language models can often encode undesirable attributes, like demographic associations of the users, while being trained for an unrelated target task. We aim to scrub such …...
Minimum Description Length Recurrent Neural Networks
AbstractWe train neural networks to optimize a Minimum Description Length score, that is, to balance between the complexity of the network and its accuracy at a task. We show that …...
Investigating UD Treebanks via Dataset Difficulty Measures
AbstractTreebanks annotated with Universal Dependencies (UD) are currently available for over 100 languages and are widely utilized by the community. However, their inherent characteristics are hard to measure and are …...