NGram

We present an integrated approach to speech and natural language processing which uses a single parser to create training for a statistical speech recognition component and for interpreting recognized text. …...

Zipf’s law states that the frequency of word tokens in a large corpus of natural language is inversely proportional to the rank. The law is investigated for two languages English …...

In this paper an approach is proposed to combine different order N-grams based on the discriminative estimation criterion, on which the parameters of n-gram can be optimized. To raise the …...

Language identification has been an interesting and fascinating issue in natural language processing for decades, and there have been many researches on it. However, most of the researches are for …...

Theoretically, an improvement in a language model occurs as the size of the n-grams increases from 3 to 5 or higher. As the n-gram size increases, the number of parameters …...

AbstractThis paper presents OMINE, an opinion mining system which aims to identify concepts such as products and their attributes, and analyze their corresponding polarities. Our work pioneers at linking extracted …...

In this paper, a human evaluation of a Catalan-Spanish Ngram-based statistical machine translation system is used to de- velop specific techniques based on the use of grammatical categories, lexical cate- …...

. We propose a method to detect Japanese nasty comments from posts on bulletin board systems (BBS). Nasty comments can cause many social problem, because they express potentially harmful words …...

AbstractThe availability of large collections of text have made it possible to build language models that incorporate counts of billions of n-grams. This paper proposes two new methods of efficiently …...

This paper proposes the use of local his- tograms (LH) over character n-grams for au- thorship attribution (AA). LHs are enriched histogram representations that preserve se- quential information in documents; …...

This paper describes the evaluation of differ- ent kinds of textual features for the Cross- Lingual Textual Entailment Task of SemEval 2013. We have counted the number of N- grams …...

This paper presents an approach for detecting promotional content in Wikipedia. By incor- porating stylometric features, including fea- tures based on n-gram and PCFG language models, we demonstrate improved accuracy …...

We introduce recurrent neural network- based Minimum Translation Unit (MTU) models which make predictions based on an unbounded history of previous bilin- gual contexts. Traditional back-off n-gram models suffer under …...

In this paper, we present an unsupervised two-phase approach to extract keywords from Arabic documents that combines statistical analysis and linguistic information. The first phase detects all the N-grams that …...

Efficient computation of n-gram posterior probabilities from lattices has applications in lattice-based minimum Bayes-risk de- coding in statistical machine translation and the estimation of expected document frequencies from spoken corpora. …...

Previous work has debated whether humans make use of hierarchic syntax when process- ing language (Frank and Bod, 2011; Fos- sum and Levy, 2012). This paper uses an eye-tracking corpus …...

This paper describes a classification system that participated in SemEval-2016 Task 4: Sentiment Analysis in Twitter. The proposed approach competed in subtasks A, B, and C, which involved tweet polarity …...

AbstractNBSVM is one of the most popular methods for text classification and has been widely used as baselines for various text representation approaches. It uses Naive Bayes (NB) feature to …...

AbstractThe existing word representation methods mostly limit their information source to word co-occurrence statistics. In this paper, we introduce ngrams into four representation methods: SGNS, GloVe, PPMI matrix, and its …...

AbstractThis paper discusses the approach taken by the UWaterloo team to arrive at a solution for the Fine-Grained Sentiment Analysis problem posed by Task 5 of SemEval 2017. The paper …...

AbstractConstituency parsing is a fundamental and important task for natural language understanding, where a good representation of contextual information can help this task. N-grams, which is a conventional type of …...

This paper explores semantic change simply using the Ngram information, with the intu- ition that Ngrams as the direct neighbors offer collocation cues that further signal meaning changes. We specifically …...

AbstractIn this paper, we introduce JBLiMP (Japanese Benchmark of Linguistic Minimal Pairs), a novel dataset for targeted syntactic evaluations of language models in Japanese. JBLiMP consists of 331 minimal pairs, …...