N-Grams
Related Papers
Contextual Word Similarity and Estimation From Sparse Data
In recent years there is much interest in word cooccurrence relations, such as n-grams, verb- object combinations, or cooccurrence within a limited context. This paper discusses how to estimate the …...
Collocation Map for Overcoming Data Sparseness
Statistical language models are useful because they can provide probabilis- tic information upon uncertain decision making. The most common statistic is n-grams measuring word cooccurrences in texts. The method suffers …...
Extension of Zipf’s Law to Word and Character N-grams for English and Chinese
It is shown that for a large corpus, Zipf 's law for both words in English and characters in Chinese does not hold for all ranks. The frequency falls below …...
Improved Automatic Keyword Extraction Given More Linguistic Knowledge
In this paper, experiments on automatic extraction of keywords from abstracts us- ing a supervised machine learning algo- rithm are discussed. The main point of this paper is that by …...
Random Forests in Language Modelin
In this paper, we explore the use of Random Forests (RFs) (Amit and Geman, 1997; Breiman, 2001) in language modeling, the problem of predicting the next word based on words …...
Clustered language models based on regular expressions for SMT
. In this paper, we present a language model based on clusters obtained by applying regular expressions to the training data and, thus, discriminating several different sentence types as, e.g. …...
LoLo: A System based on Terminology for Multilingual Extraction
An unsupervised learning method, based on corpus linguistics and special lan- guage terminology, is described that can extract time-varying information from text streams. The method is shown to be ‘language-independent’ …...
Learning to Shift the Polarity of Words for Sentiment Classification
We propose a machine learning based method of sentiment classification of sen- tences using word-level polarity. The polari- ties of words in a sentence are not always the same as …...
MAXSIM: A Maximum Similarity Metric for Machine Translation Evaluation
We propose an automatic machine translation (MT) evaluation metric that calculates a sim- ilarity score (based on precision and recall) of a pair of sentences. Unlike most metrics, we compute …...
Gender and Animacy Knowledge Discovery from Web-Scale N-Grams for Unsupervised Person Mention Detection
. In this paper we present a simple approach to discover gender and animacy knowledge for person mention detection. We learn noun-gender and noun-animacy pair counts from web-scale n-grams using …...
The Influence of Text Pre-processing on Plagiarism Detection
This paper explores the influence of text pre- processing techniques on plagiarism detection. We examine stop-word removal, lemmatization, number replacement, synonymy recognition, and word generalization. We also look into the …...
Is Sentiment a Property of Synsets? Evaluating Resources for Sentiment Classification using Machine Learning
AbstractExisting approaches to classifying documents by sentiment include machine learning with features created from n-grams and part of speech. This paper explores a different approach and examines performance of one …...
Investigating Advanced Techniques for Document Content Similarity Applied to External Plagiarism Analysis
We present an approach to perform exter- nal plagiarism analysis by applying sev- eral similarity detection techniques, such as lexical measures and a textual entail- ment recognition system developed by …...
On the Contribution of MWE-based Features to a Readability Formula for French as a Foreign Language
This study aims to assess the usefulness of multi-word expressions (MWEs) as fea- tures for a readability formula that pre- dicts the difficulty of texts for French as a foreign …...
Outcome Polarity Identification of Medical Papers
A medical publication may or may not present an outcome. When an outcome is present, its polarity may be positive, negative or neu- tral. Information about the polarity of an …...
TransAhead: A Computer-Assisted Translation and Writing Tool
We introduce a method for learning to predict text completion given a source text and partial translation. In our approach, predictions are offered aimed at alleviating users’ burden on lexical …...
An MT Error-Driven Discriminative Word Lexicon using Sentence Structure Features
The Discriminative Word Lexicon (DWL) is a maximum-entropy model that pre- dicts the target word probability given the source sentence words. We present two ways to extend a DWL to …...
Sentence Compression with Joint Structural Inference
Sentence compression techniques often assemble output sentences using frag- ments of lexical sequences such as n- grams or units of syntactic structure such as edges from a dependency tree repre- …...
Constructions: a New Unit of Analysis for Corpus-based Discourse Analysis
We propose and assess the novel idea of using automatically induced constructions as a unit of analysis for corpus-based discourse analysis. Automated techniques are needed in order to elucidate important …...
Exploring Syntactic Features for Native Language Identification: A Variationist Perspective on Feature Encoding and Ensemble Optimization
In this paper, we systematically explore lexicalized and non-lexicalized local syntactic features for the task of Native Language Identification (NLI). We investigate different types of feature representations in single- and …...
GPLSI: Supervised Sentiment Analysis in Twitter using Skipgrams
In this paper we describe the system sub- mitted for the SemEval 2014 Task 9 (Sen- timent Analysis in Twitter) Subtask B. Our contribution consists of a supervised ap- proach …...
An empirical study of segment prioritization for incrementally retrained post-editing-based SMT
Post-editing the output of a statistical machine translation (SMT) system to obtain high-quality translation has become an increasingly common application of SMT, which henceforth we re- fer to as post-editing-based …...
Recognizing Complex Negation on Twitter
After the Great East Japan Earthquake in 2011, an abundance of false rumors were dis- seminated on Twitter that actually hindered rescue activities. This work presents a method for recognizing …...
Sentiment Classification of Arabic Documents: Experiments with multi-type features and ensemble algorithms
Document sentiment classification is of- ten processed by applying machine learn- ing techniques, in particular supervised learning which consists basically of two major steps: feature extraction and train- ing the …...
Adverse Drug Reaction Classification With Deep Neural Networks
AbstractWe study the problem of detecting sentences describing adverse drug reactions (ADRs) and frame the problem as binary classification. We investigate different neural network (NN) architectures for ADR classification. In …...
INF-UFRGS-OPINION-MINING at SemEval-2016 Task 6: Automatic Generation of a Training Corpus for Unsupervised Identification of Stance in Tweets
This paper describe a weakly supervised so- lution for detecting stance in tweets, submit- ted to the SemEval 2016 Stance Task. Our approach is based on the premise that stance …...
CrystalNest at SemEval-2017 Task 4: Using Sarcasm Detection for Enhancing Sentiment Classification and Quantification
AbstractThis paper describes a system developed for a shared sentiment analysis task and its subtasks organized by SemEval-2017. A key feature of our system is the embedded ability to detect …...
INF-UFRGS at SemEval-2017 Task 5: A Supervised Identification of Sentiment Score in Tweets and Headlines
AbstractThis paper describes a supervised solution for detecting the polarity scores of tweets or headline news in the financial domain, submitted to the SemEval 2017 Fine-Grained Sentiment Analysis on Financial …...
UdL at SemEval-2017 Task 1: Semantic Textual Similarity Estimation of English Sentence Pairs Using Regression Model over Pairwise Features
AbstractThis paper describes the model UdL we proposed to solve the semantic textual similarity task of SemEval 2017 workshop. The track we participated in was estimating the semantics relatedness of …...
Tools for The Production of Analogical Grids and a Resource of N-gram Analogical Grids in 11 Languages
We release a Python module containing several tools to build analogical grids from words contained in a corpus. The module implements several previously presented algorithms. The tools are language-independent. This …...
GSI-UPM at SemEval-2019 Task 5: Semantic Similarity and Word Embeddings for Multilingual Detection of Hate Speech Against Immigrants and Women on Twitter
AbstractThis paper describes the GSI-UPM system for SemEval-2019 Task 5, which tackles multilingual detection of hate speech on Twitter. The main contribution of the paper is the use of a …...
Segmentation-free compositional n-gram embedding
AbstractWe propose a new type of representation learning method that models words, phrases and sentences seamlessly. Our method does not depend on word segmentation and any human-annotated resources (e.g., word …...
Joint Chinese Word Segmentation and Part-of-speech Tagging via Multi-channel Attention of Character N-grams
AbstractChinese word segmentation (CWS) and part-of-speech (POS) tagging are two fundamental tasks for Chinese language processing. Previous studies have demonstrated that jointly performing them can be an effective one-step solution …...
Supertagging Combinatory Categorial Grammar with Attentive Graph Convolutional Networks
AbstractSupertagging is conventionally regarded as an important task for combinatory categorial grammar (CCG) parsing, where effective modeling of contextual information is highly important to this task. However, existing studies have …...
Masking and Transformer-based Models for Hyperpartisanship Detection in News
AbstractHyperpartisan news show an extreme manipulation of reality based on an underlying and extreme ideological orientation. Because of its harmful effects at reinforcing one’s bias and the posterior behavior of …...
Relation Extraction with Word Graphs from N-grams
AbstractMost recent studies for relation extraction (RE) leverage the dependency tree of the input sentence to incorporate syntax-driven contextual information to improve model performance, with little attention paid to the …...
Taming Pre-trained Language Models with N-gram Representations for Low-Resource Domain Adaptation
AbstractLarge pre-trained models such as BERT are known to improve different downstream NLP tasks, even when such a model is trained on a generic domain. Moreover, recent studies have shown …...