Разреженность данных
Related Papers
The Haves and the Have-Nots: Leveraging Unlabelled Corpora for Sentiment Analysis
Expensive feature engineering based on WordNet senses has been shown be useful for document level sentimentto classification. A plausible reason for such a performance improvement is the reduction in data …...
Class-Based Language Modeling for Translating into Morphologically Rich Languages
Class-based language modeling (LM) is a long-studied and effective approach to overcome data sparsity in the context of n-gram model training. In statistical machine translation (SMT), differ- ent forms of …...
Stripping Adjectives: Integration Techniques for Selective Stemming in SMT Systems
In this paper we present an approach to re- duce data sparsity problems when translat- ing from morphologically rich languages into less inflected languages by selectively stemming certain word types. …...
Advancing Linguistic Features and Insights by Label-informed Feature Grouping: An Exploration in the Context of Native Language Identification
AbstractWe propose a hierarchical clustering approach designed to group linguistic features for supervised machine learning that is inspired by variationist linguistics. The method makes it possible to abstract away from …...
Consistent Word Segmentation, Part-of-Speech Tagging and Dependency Labelling Annotation for Chinese Language
AbstractIn this paper, we propose a new annotation approach to Chinese word segmentation, part-of-speech (POS) tagging and dependency labelling that aims to overcome the two major issues in traditional morphology-based …...
Learning grammatical categories using paradigmatic representations: Substitute words for language acquisition
AbstractLearning syntactic categories is a fundamental task in language acquisition. Previous studies show that co-occurrence patterns of preceding and following words are essential to group words into categories. However, the …...
Predicting proficiency levels in learner writings by transferring a linguistic complexity model from expert-written coursebooks
AbstractThe lack of a sufficient amount of data tailored for a task is a well-recognized problem for many statistical NLP methods. In this paper, we explore whether data sparsity can …...
Addressing the Data Sparsity Issue in Neural AMR Parsing
AbstractNeural attention models have achieved great success in different NLP tasks. However, they have not fulfilled their promise on the AMR parsing task due to the data sparsity issue. In …...
A LSTM Approach with Sub-Word Embeddings for Mongolian Phrase Break Prediction
AbstractIn this paper, we first utilize the word embedding that focuses on sub-word units to the Mongolian Phrase Break (PB) prediction task by using Long-Short-Term-Memory (LSTM) model. Mongolian is an …...
Solving Data Sparsity for Aspect Based Sentiment Analysis Using Cross-Linguality and Multi-Linguality
AbstractEfficient word representations play an important role in solving various problems related to Natural Language Processing (NLP), data mining, text mining etc. The issue of data sparsity poses a great …...
Out-of-Task Training for Dialog State Tracking Models
AbstractDialog state tracking (DST) suffers from severe data sparsity. While many natural language processing (NLP) tasks benefit from transfer learning and multi-task learning, in dialog these methods are limited by …...
Incorporating translation quality estimation into Chinese-Korean neural machine translation
AbstractExposure bias and poor translation diversity are two common problems in neural machine trans-lation (NMT) which are caused by the general of the teacher forcing strategy for training inthe NMT …...
Semantic Representation for Dialogue Modeling
AbstractAlthough neural models have achieved competitive results in dialogue systems, they have shown limited ability in representing core semantics, such as ignoring important entities. To this end, we exploit Abstract …...