Noisy Channel Model

The techniques of image processing have been used in optical character recognition (OCR) for a long time. The recognition method evolved from early "pattern recognition" to "feature extraction" recently. The …...

The noisy channel model has been applied to a wide range of problems, including spelling correction. These models consist of two components: a source model and a channel model. Very …...

This paper presents a method for incor- porating word pronunciation information in a noisy channel model for spelling cor- rection. The proposed method builds an explicit error model for word …...

This paper describes a noisy channel model of speech repairs, which can identify and correct repairs in speech transcripts. A syntactic parser is used as the source model, and a …...

Many proper names are spelled inconsis- tently in speech recognizer output, posing a problem for applications where locating mentions of named entities is critical. We model the distortion in the …...

In Statistics-Based Summarization - Step One: Sentence Compression, Knight and Marcu (Knight and Marcu, 2000) (K&M) present a noisy-channel model for sen- tence compression. The main difficulty in using this …...

. This paper proposes a novel approach to spelling correction. It reranks the output of an existing spelling corrector, Aspell. A discriminative model (Ranking SVM) is employed to improve upon …...

The noisy channel model approach is suc- cessfully applied to various natural lan- guage processing tasks. Currently the main research focus of this approach is adaptation methods, how to capture …...

AbstractWe describe a new Arabic spelling correction system which is intended for use with electronic dictionary search by learners of Arabic. Unlike other spelling correction systems, this system does not …...

Unrehearsed spoken language often contains many disfluencies. If we want to correctly interpret the content of spoken language, we need to be able to detect these disfluencies and deal with …...

Automated grammar correction techniques have seen improvement over the years, but there is still much room for increased perfor- mance. Current correction techniques mainly focus on identifying and correcting a …...

A system making optimal use of available in- formation in incremental language compre- hension might be expected to use linguistic knowledge together with current input to re- vise beliefs about …...

Discriminative training in query spelling cor- rection is difficult due to the complex inter- nal structures of the data. Recent work on query spelling correction suggests a two stage approach …...

AbstractArabic is a language known for its rich and complex morphology. Although many research projects have focused on the problem of Arabic morphological analysis using different techniques and approaches, very …...

AbstractDuring the course of first language acquisition, children produce linguistic forms that do not conform to adult grammar. In this paper, we introduce a data set and approach for systematically …...

AbstractThis paper presents a method for the normalization of historical texts using a combination of weighted finite-state transducers and language models. We have extended our previous work on the normalization …...

AbstractPortmanteaus are a word formation phenomenon where two words combine into a new word. We propose character-level neural sequence-to-sequence (S2S) methods for the task of portmanteau generation that are end-to-end-trainable, …...

AbstractDirect decoding for task-oriented dialogue is known to suffer from the explaining-away effect, manifested in models that prefer short and generic responses. Here we argue for the use of Bayes’ …...