Сөз векторлары
Related Papers
Learning Word Vectors for Sentiment Analysis
Unsupervised vector-based approaches to se- mantics can model rich lexical meanings, but they largely fail to capture sentiment informa- tion that is central to many word meanings and important for …...
Linguistic Regularities in Continuous Space Word Representations
Continuous space language models have re- cently demonstrated outstanding results across a variety of tasks. In this paper, we ex- amine the vector-space word representations that are implicitly learned by …...
A Character-based Approach to Distributional Semantic Models: Exploiting Kanji Characters for Constructing JapaneseWord Vectors
AbstractMany Japanese words are made of kanji characters, which themselves represent meanings. However traditional word-based distributional semantic models (DSMs) do not benefit from the useful semantic information of kanji characters. …...
Convolutional Neural Networks for Sentence Classification
We report on a series of experiments with convolutional neural networks (CNN) trained on top of pre-trained word vec- tors for sentence-level classification tasks. We show that a simple CNN …...
Exploring Compositional Architectures and Word Vector Representations for Prepositional Phrase Attachment
AbstractPrepositional phrase (PP) attachment disambiguation is a known challenge in syntactic parsing. The lexical sparsity associated with PP attachments motivates research in word representations that can capture pertinent syntactic and …...
A Simple and Efficient Method to Generate Word Sense Representations
Distributed representations of words have boosted the performance of many Natu- ral Language Processing tasks. However, usually only one representation per word is obtained, not acknowledging the fact that some …...
Distributed Representations of Words to Guide Bootstrapped Entity Classifiers
Bootstrapped classifiers iteratively generalize from a few seed examples or prototypes to other examples of target labels. However, sparseness of language and limited supervi- sion make the task difficult. We …...
Evaluation of Word Vector Representations by Subspace Alignment
Unsupervisedly learned word vectors have proven to provide exceptionally effective features in many NLP tasks. Most common intrinsic evaluations of vector quality mea- sure correlation with similarity judgments. However, these …...
Improving Topic Coherence with Latent Feature Word Representations in MAP Estimation for Topic Modeling
Probabilistic topic models are widely used to discover latent topics in document col- lections, while latent feature word vec- tors have been used to obtain high per- formance in many …...
The Unreasonable Effectiveness of Word Representations for Twitter Named Entity Recognition
Named entity recognition (NER) systems trained on newswire perform very badly when tested on Twitter. Signals that were reliable in copy-edited text disappear almost entirely in Twitter’s informal chatter, requiring …...
ECNU at SemEval-2016 Task 7: An Enhanced Supervised Learning Method for Lexicon Sentiment Intensity Ranking
This paper describes our system submissions to task 7 in SemEval 2016, i.e., Determining Sentiment Intensity. We participated the first two subtasks in English, which are to predict the sentiment …...
Extracting Spatial Entities and Relations in Korean Text
AbstractA spatial information extraction system retrieves spatial entities and their relationships for geological searches and reasoning. Spatial information systems have been developed mainly for English text, e.g., through the SpaceEval …...
Know-Center at SemEval-2016 Task 5: Using Word Vectors with Typed Dependencies for Opinion Target Expression Extraction
This paper describes our participation in SemEval-2016 Task 5 for Subtask 1, Slot 2. The challenge demands to find domain spe- cific target expressions on sentence level that refer to …...
Punctuation Prediction for Unsegmented Transcript Based on Word Vector
AbstractIn this paper we propose an approach to predict punctuation marks for unsegmented speech transcript. The approach is purely lexical, with pre-trained Word Vectors as the only input. A training …...
Modeling Context Words as Regions: An Ordinal Regression Approach to Word Embedding
AbstractVector representations of word meaning have found many applications in the field of natural language processing. Word vectors intuitively represent the average context in which a given word tends to …...
The (too Many) Problems of Analogical Reasoning with Word Vectors
AbstractThis paper explores the possibilities of analogical reasoning with vector space models. Given two pairs of words with the same relation (e.g. man:woman :: king:queen), it was proposed that the …...
Towards Lexical Chains for Knowledge-Graph-based Word Embeddings
AbstractWord vectors with varying dimensionalities and produced by different algorithms have been extensively used in NLP. The corpora that the algorithms are trained on can contain either natural language text …...
Advances in Pre-Training Distributed Word Representations
Many Natural Language Processing applications nowadays rely on pre-trained word representations estimated from large text corpora such as news collections, Wikipedia and Web Crawl. In this paper, we show how …...
CENTEMENT at SemEval-2018 Task 1: Classification of Tweets using Multiple Thresholds with Self-correction and Weighted Conditional Probabilities
AbstractIn this paper we present our contribution to SemEval-2018, a classifier for classifying multi-label emotions of Arabic and English tweets. We attempted “Affect in Tweets”, specifically Task E-c: Detecting Emotions …...
Interpretable Neural Architectures for Attributing an Ad’s Performance to its Writing Style
AbstractHow much does “free shipping!” help an advertisement’s ability to persuade? This paper presents two methods for performance attribution: finding the degree to which an outcome can be attributed to …...
Learning Word Vectors for 157 Languages
Distributed word representations, or word vectors, have recently been applied to many tasks in natural language processing, leading to state-of-the-art performance. A key ingredient to the successful application of these …...
Investigating Word-Class Distributions in Word Vector Spaces
AbstractThis paper presents an investigation on the distribution of word vectors belonging to a certain word class in a pre-trained word vector space. To this end, we made several assumptions …...
Specializing Word Vectors by Spectral Decomposition on Heterogeneously Twisted Graphs
AbstractTraditional word vectors, such as word2vec and glove, have a well-known inclination to conflate the semantic similarity with other semantic relations. A retrofitting procedure may be needed to solve this …...
Sentence Selection Strategies for Distilling Word Embeddings from BERT
AbstractMany applications crucially rely on the availability of high-quality word vectors. To learn such representations, several strategies based on language models have been proposed in recent years. While effective, these …...