Биграмма
Related Papers
An Empirical Study of Smoothing Techniques for Language Modeling
We present an extensive empirical com- parison of several smoothing techniques in the domain of language modeling, includ- ing those described by Jelinek and Mer- cer (1980), Katz (1987), and …...
Using Parsed Corpora for Structural Disambiguation in the TRAINS Domain
This paper describes a prototype disam- biguation module, KANKEI, which was tested on two corpora of the TRAINS project. In ambiguous verb phrases of form V ... NP PP or …...
Fertility Models for Statistical Natural Language Understanding
Several recent efforts in statistical nat- ural language understanding (NLU) have focused on generating clumps of English words from semantic meaning concepts (Miller et al., 1995; Levin and Pierac- cini, …...
Probabilistic and Rule-Based Tagger of an Inflective Language- a Comparison
We present results of probabilistic tag- ging of Czech texts in order to show how these techniques work for one of the highly morphologically ambiguous inflective lan- guages. After description …...
PAT-Trees with the Deletion Function as the Learning Device for Linguistic Patterns
In this study, a learning device based on the PAT- tree data structures was developed. The original PAT-trees were enhanced with the deletion function to emulate human learning competence. The …...
Discriminative Pruning of Language Models for Chinese Word Segmentation
This paper presents a discriminative pruning method of n-gram language model for Chinese word segmentation. To reduce the size of the language model that is used in a Chinese word …...
The Transliteration from Alphabet Queries to Japanese Product Names
There are some cases where the non- Japanese buyers are unable to find products they want through the Japanese shopping Web sites because they require Japanese queries. We propose to …...
A simple real-word error detection and correction using local word bigram and trigram
Spelling error is broadly classified in two categories namely non word error and real word error. In this paper a localized real word error detection and correction method is proposed …...
ASOBEK at SemEval-2016 Task 1: Sentence Representation with Character N-gram Embeddings for Semantic Textual Similarity
A growing body of research has recently been conducted on semantic textual similarity using a variety of neural network models. While re- cent research focuses on word-based represen- tation for …...
Word Segmentation by Separation Inference for East Asian Languages
AbstractChinese Word Segmentation (CWS) intends to divide a raw sentence into words through sequence labeling. Thinking in reverse, CWS can also be viewed as a process of grouping a sequence …...