Статистическое языковое моделирование
Related Papers
An Alternative Conception of Tree-Adjoining Derivation
The precise formulation of derivation for tree- adjoining grammars has important ramifications for a wide variety of uses of the formalism, from syntactic analysis to semantic interpretation and statistical language …...
Independence Assumptions Considered Harmful
Many current approaches to statistical lan- guage modeling rely on independence a.~- sumptions 1)etween the different explana- tory variables. This results in models which are computationally simple, but which only …...
An Empirical Evaluation on Statistical Parsing of Japanese Sentences Using Lexical Association Statistics
\Ve are proposing a new framework of statisti- cal language modeling which integrates lexical .association statistics with syntactic preference, while maintaining the modularity of those differ- ent statistics types, facilitating …...
A Language Modeling Approach to Predicting Reading Difficulty
We demonstrate a new research approach to the problem of predicting the reading difficulty of a text passage, by recasting readability in terms of statistical language modeling. We derive a …...
Applying Meaningful Word-Pair Identifier to the Chinese Syllable-to-Word Conversion Problem
. Syllable-to-word (STW) conversion is a frequently used Chinese input method that is fundamental to syllable/speech understanding. The two major problems with STW conversion are the segmentation of syllable input …...
Automatic Learning of Language Model Structure
Statistical language modeling remains a challeng- ing task, in particular for morphologically rich lan- guages. Recently, new approaches based on factored language models have been developed to address this problem. …...
Approximation Lasso Methods for Language Modeling
Lasso is a regularization method for pa- rameter estimation in linear models. It op- timizes the model parameters with respect to a loss function subject to model com- plexities. This …...
Generating Statistical Language Models from Interpretation Grammars in Dialogue Systems
In this paper, we explore statistical lan- guage modelling for a speech-enabled MP3 player application by generating a corpus from the interpretation grammar written for the application with the Gram- …...
Large Language Models in Machine Translation
This paper reports on the benefits of large- scale statistical language modeling in ma- chine translation. A distributed infrastruc- ture is proposed which we use to train on up to …...
Training Continuous Space Language Models: Some Practical Issues
Using multi-layer neural networks to esti- mate the probabilities of word sequences is a promising research area in statistical lan- guage modeling, with applications in speech recognition and statistical machine …...
Language Modeling for Document Selection in Question Answering
Usually, in the Question Answering do- main, for a question in natural language, precise answers to the question are ex- tracted from documents according only to the context of the …...
Leveraging Effective Query Modeling Techniques for Speech Recognition and Summarization
Statistical language modeling (LM) that purports to quantify the acceptability of a given piece of text has long been an in- teresting yet challenging research area. In particular, language modeling …...
A Cognitive Regularizer for Language Modeling
AbstractThe uniform information density (UID) hypothesis, which posits that speakers behaving optimally tend to distribute information uniformly across a linguistic signal, has gained traction in psycholinguistics as an explanation for …...
ReACC: A Retrieval-Augmented Code Completion Framework
AbstractCode completion, which aims to predict the following code token(s) according to the code context, can improve the productivity of software development. Recent work has proved that statistical language modeling …...