method ID: ngrams

Related Papers

Contextual Word Similarity and Estimation From Sparse Data

Authors: nan

Publication: TIPSTER (1993)

DOI: nan

In recent years there is much interest in word cooccurrence relations, such as n-grams, verb- object combinations, or cooccurrence within a limited context. This paper discusses how to estimate the …...

35479

Collocation Map for Overcoming Data Sparseness

Authors: nan

Publication: TIPSTER (1995)

DOI: nan

Statistical language models are useful because they can provide probabilis- tic information upon uncertain decision making. The most common statistic is n-grams measuring word cooccurrences in texts. The method suffers …...

43952

Extension of Zipf’s Law to Word and Character N-grams for English and Chinese

Authors: nan

Publication: TIPSTER (2003)

DOI: nan

It is shown that for a large corpus, Zipf 's law for both words in English and characters in Chinese does not hold for all ranks. The frequency falls below …...

3567

Improved Automatic Keyword Extraction Given More Linguistic Knowledge

Authors: nan

Publication: TIPSTER (2003)

DOI: nan

In this paper, experiments on automatic extraction of keywords from abstracts us- ing a supervised machine learning algo- rithm are discussed. The main point of this paper is that by …...

42440

Random Forests in Language Modelin

Authors: nan

Publication: TIPSTER (2004)

DOI: nan

In this paper, we explore the use of Random Forests (RFs) (Amit and Geman, 1997; Breiman, 2001) in language modeling, the problem of predicting the next word based on words …...

44938

Clustered language models based on regular expressions for SMT

Authors: nan

Publication: TIPSTER (2005)

DOI: nan

. In this paper, we present a language model based on clusters obtained by applying regular expressions to the training data and, thus, discriminating several different sentence types as, e.g. …...

3488

LoLo: A System based on Terminology for Multilingual Extraction

Authors: nan

Publication: TIPSTER (2006)

DOI: nan

An unsupervised learning method, based on corpus linguistics and special lan- guage terminology, is described that can extract time-varying information from text streams. The method is shown to be ‘language-independent’ …...

26358

Learning to Shift the Polarity of Words for Sentiment Classification

Authors: nan

Publication: TIPSTER (2008)

DOI: nan

We propose a machine learning based method of sentiment classification of sen- tences using word-level polarity. The polari- ties of words in a sentence are not always the same as …...

12583

MAXSIM: A Maximum Similarity Metric for Machine Translation Evaluation

Authors: nan

Publication: TIPSTER (2008)

DOI: nan

We propose an automatic machine translation (MT) evaluation metric that calculates a sim- ilarity score (based on precision and recall) of a pair of sentences. Unlike most metrics, we compute …...

36780

Gender and Animacy Knowledge Discovery from Web-Scale N-Grams for Unsupervised Person Mention Detection

Authors: nan

Publication: TIPSTER (2009)

DOI: nan

. In this paper we present a simple approach to discover gender and animacy knowledge for person mention detection. We learn noun-gender and noun-animacy pair counts from web-scale n-grams using …...

19348

The Influence of Text Pre-processing on Plagiarism Detection

Authors: nan

Publication: TIPSTER (2009)

DOI: nan

This paper explores the influence of text pre- processing techniques on plagiarism detection. We examine stop-word removal, lemmatization, number replacement, synonymy recognition, and word generalization. We also look into the …...

29556

Is Sentiment a Property of Synsets? Evaluating Resources for Sentiment Classification using Machine Learning

Authors: nan

Publication: TIPSTER (2010)

DOI: nan

AbstractExisting approaches to classifying documents by sentiment include machine learning with features created from n-grams and part of speech. This paper explores a different approach and examines performance of one …...

8475

Investigating Advanced Techniques for Document Content Similarity Applied to External Plagiarism Analysis

Authors: nan

Publication: TIPSTER (2011)

DOI: nan

We present an approach to perform exter- nal plagiarism analysis by applying sev- eral similarity detection techniques, such as lexical measures and a textual entail- ment recognition system developed by …...

29260

On the Contribution of MWE-based Features to a Readability Formula for French as a Foreign Language

Authors: nan

Publication: TIPSTER (2011)

DOI: nan

This study aims to assess the usefulness of multi-word expressions (MWEs) as fea- tures for a readability formula that pre- dicts the difficulty of texts for French as a foreign …...

29012

Outcome Polarity Identification of Medical Papers

Authors: nan

Publication: TIPSTER (2011)

DOI: nan

A medical publication may or may not present an outcome. When an outcome is present, its polarity may be positive, negative or neu- tral. Information about the polarity of an …...

28624

TransAhead: A Computer-Assisted Translation and Writing Tool

Authors: nan

Publication: TIPSTER (2012)

DOI: nan

We introduce a method for learning to predict text completion given a source text and partial translation. In our approach, predictions are offered aimed at alleviating users’ burden on lexical …...

23935

An MT Error-Driven Discriminative Word Lexicon using Sentence Structure Features

Authors: nan

Publication: TIPSTER (2013)

DOI: nan

The Discriminative Word Lexicon (DWL) is a maximum-entropy model that pre- dicts the target word probability given the source sentence words. We present two ways to extend a DWL to …...

27393

Sentence Compression with Joint Structural Inference

Authors: nan

Publication: TIPSTER (2013)

DOI: nan

Sentence compression techniques often assemble output sentences using frag- ments of lexical sequences such as n- grams or units of syntactic structure such as edges from a dependency tree repre- …...

42207

Constructions: a New Unit of Analysis for Corpus-based Discourse Analysis

Authors: nan

Publication: TIPSTER (2014)

DOI: nan

We propose and assess the novel idea of using automatically induced constructions as a unit of analysis for corpus-based discourse analysis. Automated techniques are needed in order to elucidate important …...

19118

Exploring Syntactic Features for Native Language Identification: A Variationist Perspective on Feature Encoding and Ensemble Optimization

Authors: nan

Publication: TIPSTER (2014)

DOI: nan

In this paper, we systematically explore lexicalized and non-lexicalized local syntactic features for the task of Native Language Identification (NLI). We investigate different types of feature representations in single- and …...

5657

GPLSI: Supervised Sentiment Analysis in Twitter using Skipgrams

Authors: nan

Publication: TIPSTER (2014)

DOI: nan

In this paper we describe the system sub- mitted for the SemEval 2014 Task 9 (Sen- timent Analysis in Twitter) Subtask B. Our contribution consists of a supervised ap- proach …...

22843

An empirical study of segment prioritization for incrementally retrained post-editing-based SMT

Authors: nan

Publication: TIPSTER (2015)

DOI: nan

Post-editing the output of a statistical machine translation (SMT) system to obtain high-quality translation has become an increasingly common application of SMT, which henceforth we re- fer to as post-editing-based …...

18619

Recognizing Complex Negation on Twitter

Authors: nan

Publication: TIPSTER (2015)

DOI: nan

After the Great East Japan Earthquake in 2011, an abundance of false rumors were dis- seminated on Twitter that actually hindered rescue activities. This work presents a method for recognizing …...

19109

Sentiment Classification of Arabic Documents: Experiments with multi-type features and ensemble algorithms

Authors: nan

Publication: TIPSTER (2015)

DOI: nan

Document sentiment classification is of- ten processed by applying machine learn- ing techniques, in particular supervised learning which consists basically of two major steps: feature extraction and train- ing the …...

19216

Adverse Drug Reaction Classification With Deep Neural Networks

Authors: nan

Publication: TIPSTER (2016)

DOI: nan

AbstractWe study the problem of detecting sentences describing adverse drug reactions (ADRs) and frame the problem as binary classification. We investigate different neural network (NN) architectures for ADR classification. In …...

4532

INF-UFRGS-OPINION-MINING at SemEval-2016 Task 6: Automatic Generation of a Training Corpus for Unsupervised Identification of Stance in Tweets

Authors: nan

Publication: TIPSTER (2016)

DOI: nan

This paper describe a weakly supervised so- lution for detecting stance in tweets, submit- ted to the SemEval 2016 Stance Task. Our approach is based on the premise that stance …...

22525

CrystalNest at SemEval-2017 Task 4: Using Sarcasm Detection for Enhancing Sentiment Classification and Quantification

Authors: nan

Publication: TIPSTER (2017)

DOI: nan

AbstractThis paper describes a system developed for a shared sentiment analysis task and its subtasks organized by SemEval-2017. A key feature of our system is the embedded ability to detect …...

25250

INF-UFRGS at SemEval-2017 Task 5: A Supervised Identification of Sentiment Score in Tweets and Headlines

Authors: nan

Publication: TIPSTER (2017)

DOI: nan

AbstractThis paper describes a supervised solution for detecting the polarity scores of tweets or headline news in the financial domain, submitted to the SemEval 2017 Fine-Grained Sentiment Analysis on Financial …...

25204

UdL at SemEval-2017 Task 1: Semantic Textual Similarity Estimation of English Sentence Pairs Using Regression Model over Pairwise Features

Authors: nan

Publication: TIPSTER (2017)

DOI: nan

AbstractThis paper describes the model UdL we proposed to solve the semantic textual similarity task of SemEval 2017 workshop. The track we participated in was estimating the semantics relatedness of …...

25381

Tools for The Production of Analogical Grids and a Resource of N-gram Analogical Grids in 11 Languages

Authors: nan

Publication: TIPSTER (2018)

DOI: nan

We release a Python module containing several tools to build analogical grids from words contained in a corpus. The module implements several previously presented algorithms. The tools are language-independent. This …...

17852

GSI-UPM at SemEval-2019 Task 5: Semantic Similarity and Word Embeddings for Multilingual Detection of Hate Speech Against Immigrants and Women on Twitter

Authors: nan

Publication: TIPSTER (2019)

DOI: nan

AbstractThis paper describes the GSI-UPM system for SemEval-2019 Task 5, which tackles multilingual detection of hate speech on Twitter. The main contribution of the paper is the use of a …...

25803

Segmentation-free compositional n-gram embedding

Authors: nan

Publication: TIPSTER (2019)

DOI: nan

AbstractWe propose a new type of representation learning method that models words, phrases and sentences seamlessly. Our method does not depend on word segmentation and any human-annotated resources (e.g., word …...

21965

Joint Chinese Word Segmentation and Part-of-speech Tagging via Multi-channel Attention of Character N-grams

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractChinese word segmentation (CWS) and part-of-speech (POS) tagging are two fundamental tasks for Chinese language processing. Previous studies have demonstrated that jointly performing them can be an effective one-step solution …...

4169

Supertagging Combinatory Categorial Grammar with Attentive Graph Convolutional Networks

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractSupertagging is conventionally regarded as an important task for combinatory categorial grammar (CCG) parsing, where effective modeling of contextual information is highly important to this task. However, existing studies have …...

30095

Masking and Transformer-based Models for Hyperpartisanship Detection in News

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractHyperpartisan news show an extreme manipulation of reality based on an underlying and extreme ideological orientation. Because of its harmful effects at reinforcing one’s bias and the posterior behavior of …...

19610

Relation Extraction with Word Graphs from N-grams

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractMost recent studies for relation extraction (RE) leverage the dependency tree of the input sentence to incorporate syntax-driven contextual information to improve model performance, with little attention paid to the …...

31871

Taming Pre-trained Language Models with N-gram Representations for Low-Resource Domain Adaptation

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractLarge pre-trained models such as BERT are known to improve different downstream NLP tasks, even when such a model is trained on a generic domain. Moreover, recent studies have shown …...

8637