Сезімталдықты Жіктеу
Related Papers
Thumbs up? Sentiment Classification using Machine Learning Techniques
We consider the problem of classifying doc- uments not by topic, but by overall senti- ment, e.g., determining whether a review is positive or negative. Using movie re- views as …...
Sentiment classification on customer feedback data: noisy data, large feature vectors, and the role of linguistic analysis
We demonstrate that it is possible to perform automatic sentiment classification in the very noisy domain of customer feedback data. We show that by using large feature vectors in combination …...
A New Method for Sentiment Classification in Text Retrieval
. Traditional text categorization is usually a topic-based task, but a subtle demand on information retrieval is to distinguish between positive and negative view on text topic. In this paper, …...
Evaluating the Utility of Appraisal Hierarchies as a Method for Sentiment Classification
Recent studies of sentiment classification (determining whether a text is “positive” or “negative”) using Appraisal theory have provided mixed results. While some good results have been obtained, it is difficult …...
Identifying Sources of Opinions with Conditional Random Fields and Extraction Patterns
Recent systems have been developed for sentiment classification, opinion recogni- tion, and opinion analysis (e.g., detect- ing polarity and strength). We pursue an- other aspect of opinion analysis: identi- fying …...
Using “Annotator Rationales” to Improve Machine Learning for Text Categorization
We propose a new framework for supervised ma- chine learning. Our goal is to learn from smaller amounts of supervised training data, by collecting a richer kind of training data: …...
Online Methods for Multi-Domain Learning and Adaptation
NLP tasks are often domain specific, yet sys- tems can learn behaviors across multiple do- mains. We develop a new multi-domain online learning framework based on parameter com- bination from …...
Unsupervised Classification of Sentiment and Objectivity in Chinese Text
We address the problem of sentiment and objectivity classification of product re- views in Chinese. Our approach is distinct- ive in that it treats both positive / negative sentiment and …...
Sentiment Classification Considering Negation and Contrast Transition
. Negation and contrast transition are two kinds of linguistic phenomena which are popularly used to reverse the sentiment polarity of some words and sentences. In this paper, we propose …...
Dependency Tree-based Sentiment Classification using CRFs with Hidden Variables
In this paper, we present a dependency tree- based method for sentiment classification of Japanese and English subjective sentences us- ing conditional random fields with hidden variables. Subjective sentences often …...
Disambiguating Dynamic Sentiment Ambiguous Adjectives
Dynamic sentiment ambiguous adjectives (DSAAs) like “large, small, high, low” pose a challenging task on sentiment analysis. This paper proposes a knowledge-based method to automatically determine the semantic orientation of …...
Employing Personal/Impersonal Views in Supervised and Semi-Supervised Sentiment Classification
In this paper, we adopt two views, personal and impersonal views, and systematically employ them in both supervised and semi-supervised sentiment classification. Here, personal views consist of those sentences which …...
Sentiment Classification using Automatically Extracted Subgraph Features
In this work, we propose a novel representa- tion of text based on patterns derived from lin- guistic annotation graphs. We use a subgraph mining algorithm to automatically derive fea- …...
SentiWordNet 3.0: An Enhanced Lexical Resource for Sentiment Analysis and Opinion Mining
AbstractIn this work we present SENTIWORDNET 3.0, a lexical resource explicitly devised for supporting sentiment classification and opinion mining applications. SENTIWORDNET 3.0 is an improved version of SENTIWORDNET 1.0, a …...
Collective Classification of Congressional Floor-Debate Transcripts
This paper explores approaches to sentiment classification of U.S. Congressional floor- debate transcripts. Collective classification techniques are used to take advantage of the informal citation structure present in the de- …...
Domain Adaptation by Constraining Inter-Domain Variability of Latent Feature Representation
We consider a semi-supervised setting for do- main adaptation where only unlabeled data is available for the target domain. One way to tackle this problem is to train a generative …...
Harnessing WordNet Senses for Supervised Sentiment Classification
Traditional approaches to sentiment classifica- tion rely on lexical features, syntax-based fea- tures or a combination of the two. We pro- pose semantic features using word senses for a supervised …...
Sentiment Classification in Resource-Scarce Languages by using Label Propagation
. With the advent of consumer generated media (e.g., Amazon reviews, Twitter, etc.), sentiment classification becomes a heated topic. Previous work heavily relies on a large amount of linguistic resources, …...
Using Multiple Sources to Construct a Sentiment Sensitive Thesaurus for Cross-Domain Sentiment Classification
We describe a sentiment classification method that is applicable when we do not have any la- beled data for a target domain but have some labeled data for multiple other …...
Active Learning for Imbalanced Sentiment Classification
Active learning is a promising way for sentiment classification to reduce the annotation cost. In this paper, we focus on the imbalanced class distribution scenario for sentiment classification, wherein the …...
A Boosting-based Algorithm for Classification of Semi-Structured Text using the Frequency of Substructures
Research in text classification currently fo- cuses on challenging tasks such as sen- timent classification, modality identifica- tion, and so on. In these tasks, approaches that use a structural representation, …...
bwbaugh : Hierarchical sentiment analysis with partial self-training
Using labeled Twitter training data from SemEval-2013, we train both a subjectivity classifier and a polarity classifier separately, and then combine the two into a single hier- archical classifier. Using …...
NTNU: Domain Semi-Independent Short Message Sentiment Classification
The paper describes experiments using grid searches over various combinations of ma- chine learning algorithms, features and pre- processing strategies in order to produce the optimal systems for sentiment classification …...
REACTION: A naive machine learning approach for sentiment classification
We evaluate a naive machine learning ap- proach to sentiment classification focused on Twitter in the context of the sentiment analysis task of SemEval-2013. We employ a classifier based on …...
Semi-supervised vs. Cross-domain Graphs for Sentiment Analysis
The lack of labeled data always poses challenges for tasks where machine learn- ing is involved. Semi-supervised and cross-domain approaches represent the most common ways to overcome this dif- ficulty. …...
Sentiment Analysis of Reviews: Should we analyze writer intentions or reader perceptions?
Many sentiment-analysis methods for the classification of reviews use training and test-data based on star ratings provided by reviewers. However, when reading re- views it appears that the reviewers’ rat- …...
The Haves and the Have-Nots: Leveraging Unlabelled Corpora for Sentiment Analysis
Expensive feature engineering based on WordNet senses has been shown be useful for document level sentimentto classification. A plausible reason for such a performance improvement is the reduction in data …...
UMCC_DLSI-(SA): Using a ranking algorithm and informal features to solve Sentiment Analysis in Twitter
In this paper, we describe the development and performance of the supervised system UMCC_DLSI-(SA). This system uses corpora where phrases are annotated as Positive, Negative, Objective, and Neutral, to achieve …...
Hybrid Deep Belief Networks for Semi-supervised Sentiment Classification
In this paper, we develop a novel semi-supervised learning algorithm called hybrid deep be- lief networks (HDBN), to address the semi-supervised sentiment classification problem with deep learning. First, we construct …...
IITP: Supervised Machine Learning for Aspect based Sentiment Analysis
The shared task on Aspect based Senti- ment Analysis primarily focuses on mining relevant information from the thousands of online reviews available for a popular product or service. In this …...
On Stopwords, Filtering and Data Sparsity for Sentiment Analysis of Twitter
AbstractSentiment classification over Twitter is usually affected by the noisy nature (abbreviations, irregular forms) of tweets data. A popular procedure to reduce the noise of textual data is to remove …...
UKPDIPF: Lexical Semantic Approach to Sentiment Polarity Prediction in Twitter Data
We present a sentiment classification sys- tem that participated in the SemEval 2014 shared task on sentiment analysis in Twit- ter. Our system expands tokens in a tweet with semantically …...
ASTD: Arabic Sentiment Tweets Dataset
This paper introduces ASTD, an Arabic social sentiment analysis dataset gathered from Twitter. It consists of about 10,000 tweets which are classified as objective, subjective positive, subjective negative, and subjective …...
Japanese Sentiment Classification with Stacked Denoising Auto-Encoder using Distributed Word Representation
Traditional sentiment classification methods often require polarity dictionaries or crafted features to utilize machine learning. How- ever, those approaches incur high costs in the making of dictionaries and/or features, which …...
Molding CNNs for text: non-linear, non-consecutive convolutions
The success of deep learning often de- rives from well-chosen operational build- ing blocks. In this work, we revise the temporal convolution operation in CNNs to better adapt it to …...
Reinforcing the Topic of Embeddings with Theta Pure Dependence for Text Classification
For sentiment classification, it is often recognized that embedding based on dis- tributional hypothesis is weak in captur- ing sentiment contrast–contrasting words may have similar local context. Based on broader …...
RoseMerry: A Baseline Message-level Sentiment Classification System
In this paper, we propose a baseline message- level sentiment classification method, as de- veloped for SemEval-2015 Task 10, Subtask B. This system leverages both hand-crafted features and message-level embedding …...
Sentiment Classification of Arabic Documents: Experiments with multi-type features and ensemble algorithms
Document sentiment classification is of- ten processed by applying machine learn- ing techniques, in particular supervised learning which consists basically of two major steps: feature extraction and train- ing the …...
Splusplus: A Feature-Rich Two-stage Classifier for Sentiment Analysis of Tweets
This paper describes our sentiment classifica- tion system submitted to SemEval-2015 Task 10. In the message-level polarity classifica- tion subtask, we obtain the highest macro- averaged F1-scores on three out …...
SWASH: A Naive Bayes Classifier for Tweet Sentiment Identification
This paper describes a sentiment classifica- tion system designed for SemEval-2015, Task 10, Subtask B. The system employs a con- strained, supervised text categorization ap- proach. Firstly, since thorough preprocess- …...
Swiss-Chocolate: Combining Flipout Regularization and Random Forests with Artificially Built Subsystems to Boost Text-Classification for Sentiment
We describe a classifier for predicting message-level sentiment of English micro- blog messages from Twitter. This paper describes our submission to the SemEval- 2015 competition (Task 10). Our approach is …...
TwitterHawk: A Feature Bucket Based Approach to Sentiment Analysis
This paper describes TwitterHawk, a system for sentiment analysis of tweets which partici- pated in the SemEval-2015 Task 10, Subtasks A through D. The system performed com- petitively, most notably …...
When Are Tree Structures Necessary for Deep Learning of Representations?
Recursive neural models, which use syn- tactic parse trees to recursively generate representations bottom-up, are a popular architecture. However there have not been rigorous evaluations showing for exactly which tasks …...
Bi-Transferring Deep Neural Networks for Domain Adaptation
Sentiment classification aims to automati- cally predict sentiment polarity (e.g., pos- itive or negative) of user generated sen- timent data (e.g., reviews, blogs). Due to the mismatch among different domains, …...
Cached Long Short-Term Memory Neural Networks for Document-Level Sentiment Classification
Recently, neural networks have achieved great success on sentiment classification due to their ability to alleviate feature engineering. How- ever, one of the remaining challenges is to model long texts …...
Dependency Based Embeddings for Sentence Classification Tasks
We compare different word embeddings from a standard window based skipgram model, a skipgram model trained using dependency context features and a novel skipgram variant that utilizes additional information from …...
Detecting Stance in Tweets And Analyzing its Interaction with Sentiment
One may express favor (or disfavor) to- wards a target by using positive or neg- ative language. Here for the first time we present a dataset of tweets annotated for …...
DiegoLab16 at SemEval-2016 Task 4: Sentiment Analysis in Twitter using Centroids, Clusters, and Sentiment Lexicons
We present our supervised sentiment classifi- cation system which competed in SemEval- 2016 Task 4: Sentiment Analysis in Twitter. Our system employs a Support Vector Ma- chine (SVM) classifier trained …...
Integration of Lexical and Semantic Knowledge for Sentiment Analysis in SMS
AbstractWith the explosive growth of online social media (forums, blogs, and social networks), exploitation of these new information sources has become essential. Our work is based on the sud4science project. …...
Leveraging Multiple Domains for Sentiment Classification
AbstractSentiment classification becomes more and more important with the rapid growth of user generated content. However, sentiment classification task usually comes with two challenges: first, sentiment classification is highly domain-dependent …...
Reliable Baselines for Sentiment Analysis in Resource-Limited Languages: The Serbian Movie Review Dataset
AbstractCollecting data for sentiment analysis in resource-limited languages carries a significant risk of sample selection bias, since the small quantities of available data are most likely not representative of the …...
UNIMELB at SemEval-2016 Tasks 4A and 4B: An Ensemble of Neural Networks and a Word2Vec Based Model for Sentiment Classification
This paper describes our sentiment clas- sification system for microblog-sized doc- uments, and documents where a topic is present. The system consists of a soft- voting ensemble of a word2vec …...
Deep Pyramid Convolutional Neural Networks for Text Categorization
AbstractThis paper proposes a low-complexity word-level deep convolutional neural network (CNN) architecture for text categorization that can efficiently represent long-range associations in text. In the literature, several deep and complex …...
Feature Selection as Causal Inference: Experiments with Text Classification
AbstractThis paper proposes a matching technique for learning causal associations between word features and class labels in document classification. The goal is to identify more meaningful and generalizable features than …...
Linguistically Regularized LSTM for Sentiment Classification
AbstractThis paper deals with sentence-level sentiment classification. Though a variety of neural network models have been proposed recently, however, previous models either depend on expensive phrase-level annotation, most of which …...
SemEval-2017 Task 4: Sentiment Analysis in Twitter
AbstractThis paper describes the fifth year of the Sentiment Analysis in Twitter task. SemEval-2017 Task 4 continues with a rerun of the subtasks of SemEval-2016 Task 4, which include identifying …...
Sentiment Lexicon Construction with Representation Learning Based on Hierarchical Sentiment Supervision
AbstractSentiment lexicon is an important tool for identifying the sentiment polarity of words and texts. How to automatically construct sentiment lexicons has become a research topic in the field of …...
A Lexicon-Based Supervised Attention Model for Neural Sentiment Analysis
AbstractAttention mechanisms have been leveraged for sentiment classification tasks because not all words have the same importance. However, most existing attention models did not take full advantage of sentiment lexicons, …...
An LSTM Approach to Short Text Sentiment Classification with Word Embeddings
Sentiment classification techniques have been widely used for analyzing user opinions. In conventional supervised learning methods, hand-crafted features are needed, which requires a thorough understanding of the domain. Since social …...
Bootstrap Domain-Specific Sentiment Classifiers from Unlabeled Corpora
AbstractThere is often the need to perform sentiment classification in a particular domain where no labeled document is available. Although we could make use of a general-purpose off-the-shelf sentiment classifier …...
DMCB at SemEval-2018 Task 1: Transfer Learning of Sentiment Classification Using Group LSTM for Emotion Intensity prediction
AbstractThis paper describes a system attended in the SemEval-2018 Task 1 “Affect in tweets” that predicts emotional intensities. We use Group LSTM with an attention model and transfer learning with …...
Enhancing Sentence Embedding with Generalized Pooling
AbstractPooling is an essential component of a wide variety of sentence representation and embedding models. This paper explores generalized pooling methods to enhance sentence embedding. We propose vector-based multi-head attention …...
Learning Sentiment Composition from Sentiment Lexicons
AbstractSentiment composition is a fundamental sentiment analysis problem. Previous work relied on manual rules and manually-created lexical resources such as negator lists, or learned a composition function from sentiment-annotated phrases …...
Projecting Embeddings for Domain Adaption: Joint Modeling of Sentiment Analysis in Diverse Domains
AbstractDomain adaptation for sentiment analysis is challenging due to the fact that supervised classifiers are very sensitive to changes in domain. The two most prominent approaches to this problem are …...
Using J-K-fold Cross Validation To Reduce Variance When Tuning NLP Models
AbstractK-fold cross validation (CV) is a popular method for estimating the true performance of machine learning models, allowing model selection and parameter tuning. However, the very process of CV requires …...
Categorical Metadata Representation for Customized Text Classification
AbstractThe performance of text classification has improved tremendously using intelligently engineered neural-based models, especially those injecting categorical metadata as additional information, e.g., using user/product information for sentiment classification. This information …...
Investigating Dynamic Routing in Tree-Structured LSTM for Sentiment Analysis
AbstractDeep neural network models such as long short-term memory (LSTM) and tree-LSTM have been proven to be effective for sentiment analysis. However, sequential LSTM is a bias model wherein the …...
Latent Variable Sentiment Grammar
AbstractNeural models have been investigated for sentiment classification over constituent trees. They learn phrase composition automatically by encoding tree structures but do not explicitly model sentiment composition, which requires to …...
Multi-Task Stance Detection with Sentiment and Stance Lexicons
AbstractStance detection aims to detect whether the opinion holder is in support of or against a given target. Recent works show improvements in stance detection by using either the attention …...
Rethinking Attribute Representation and Injection for Sentiment Classification
AbstractText attributes, such as user and product information in product reviews, have been used to improve the performance of sentiment classification models. The de facto standard method is to incorporate …...
Task Refinement Learning for Improved Accuracy and Stability of Unsupervised Domain Adaptation
AbstractPivot Based Language Modeling (PBLM) (Ziser and Reichart, 2018a), combining LSTMs with pivot-based methods, has yielded significant progress in unsupervised domain adaptation. However, this approach is still challenged by the …...
Bayes-enhanced Lifelong Attention Networks for Sentiment Classification
AbstractThe classic deep learning paradigm learns a model from the training data of a single task and the learned model is also tested on the same task. This paper studies …...
CAT-Gen: Improving Robustness in NLP Models via Controlled Adversarial Text Generation
AbstractNLP models are shown to suffer from robustness issues, i.e., a model’s prediction can be easily changed under small perturbations to the input. In this work, we present a Controlled …...
Cross-Lingual Unsupervised Sentiment Classification with Multi-View Transfer Learning
AbstractRecent neural network models have achieved impressive performance on sentiment classification in English as well as other languages. Their success heavily depends on the availability of a large amount of …...
Denoising Multi-Source Weak Supervision for Neural Text Classification
AbstractWe study the problem of learning neural text classifiers without using any labeled data, but only easy-to-provide rules as multiple weak supervision sources. This problem is challenging because rule-induced weak …...
DSC IIT-ISM at SemEval-2020 Task 8: Bi-Fusion Techniques for Deep Meme Emotion Analysis
AbstractMemes have become an ubiquitous social media entity and the processing and analysis of such multimodal data is currently an active area of research. This paper presents our work on …...
Feature Projection for Improved Text Classification
AbstractIn classification, there are usually some good features that are indicative of class labels. For example, in sentiment classification, words like good and nice are indicative of the positive sentiment …...
Give your Text Representation Models some Love: the Case for Basque
AbstractWord embeddings and pre-trained language models allow to build rich representations of text and have enabled improvements across most NLP tasks. Unfortunately they are very expensive to train, and many …...
How do Decisions Emerge across Layers in Neural Models? Interpretation with Differentiable Masking
AbstractAttribution methods assess the contribution of inputs to the model prediction. One way to do so is erasure: a subset of inputs is considered irrelevant if it can be removed …...
Identifying Spurious Correlations for Robust Text Classification
AbstractThe predictions of text classifiers are often driven by spurious correlations – e.g., the term “Spielberg” correlates with positively reviewed movies, even though the term itself does not semantically convey …...
Modeling Local Contexts for Joint Dialogue Act Recognition and Sentiment Classification with Bi-channel Dynamic Convolutions
AbstractIn this paper, we target improving the joint dialogue act recognition (DAR) and sentiment classification (SC) tasks by fully modeling the local contexts of utterances. First, we employ the dynamic …...
NLP_UIOWA at SemEval-2020 Task 8: You’re Not the Only One Cursed with Knowledge - Multi Branch Model Memotion Analysis
AbstractWe propose hybrid models (HybridE and HybridW) for meme analysis (SemEval 2020 Task 8), which involves sentiment classification (Subtask A), humor classification (Subtask B), and scale of semantic classes (Subtask …...
Palomino-Ochoa at SemEval-2020 Task 9: Robust System Based on Transformer for Code-Mixed Sentiment Classification
AbstractWe present a transfer learning system to perform a mixed Spanish-English sentiment classification task. Our proposal uses the state-of-the-art language model BERT and embed it within a ULMFiT transfer learning …...
PERL: Pivot-based Domain Adaptation for Pre-trained Deep Contextualized Embedding Models
AbstractPivot-based neural representation models have led to significant progress in domain adaptation for NLP. However, previous research following this approach utilize only labeled data from the source domain and unlabeled …...
Ruler: Data Programming by Demonstration for Document Labeling
AbstractData programming aims to reduce the cost of curating training data by encoding domain knowledge as labeling functions over source data. As such it not only requires domain expertise but …...
SentiBERT: A Transferable Transformer-Based Architecture for Compositional Sentiment Semantics
AbstractWe propose SentiBERT, a variant of BERT that effectively captures compositional sentiment semantics. The model incorporates contextualized representation with binary constituency parse tree to capture semantic composition. Comprehensive experiments demonstrate …...
Sentiment Analysis of Tweets using Heterogeneous Multi-layer Network Representation and Embedding
AbstractSentiment classification on tweets often needs to deal with the problems of under-specificity, noise, and multilingual content. This study proposes a heterogeneous multi-layer network-based representation of tweets to generate multiple …...
SetConv: A New Approach for Learning from Imbalanced Data
AbstractFor many real-world classification problems, e.g., sentiment classification, most existing machine learning methods are biased towards the majority class when the Imbalance Ratio (IR) is high. To address this problem, …...
The Impact of Indirect Machine Translation on Sentiment Classification
Sentiment classification has been crucial for many natural language processing (NLP) applica- tions, such as the analysis of movie reviews, tweets, or customer feedback. A sufficiently large amount of data …...
UoR at SemEval-2020 Task 8: Gaussian Mixture Modelling (GMM) Based Sampling Approach for Multi-modal Memotion Analysis
AbstractMemes are widely used on social media. They usually contain multi-modal information such as images and texts, serving as valuable data sources to analyse opinions and sentiment orientations of online …...
Urszula Walińska at SemEval-2020 Task 8: Fusion of Text and Image Features Using LSTM and VGG16 for Memotion Analysis
AbstractIn this paper, we describe the entry to the task of Memotion Analysis. The sentiment analysis of memes task, is motivated by a pervasive problem of offensive content spread in …...
Weakly-Supervised Aspect-Based Sentiment Analysis via Joint Aspect-Sentiment Topic Embedding
AbstractAspect-based sentiment analysis of review texts is of great value for understanding user feedback in a fine-grained manner. It has in general two sub-tasks: (i) extracting aspects from each review, …...
Weight Poisoning Attacks on Pretrained Models
AbstractRecently, NLP has seen a surge in the usage of large pre-trained models. Users download weights of models pre-trained on large datasets, then fine-tune the weights on a task of …...
A Disentangled Adversarial Neural Topic Model for Separating Opinions from Plots in User Reviews
AbstractThe flexibility of the inference process in Variational Autoencoders (VAEs) has recently led to revising traditional probabilistic topic models giving rise to Neural Topic Models (NTM). Although these approaches have …...
Aggregating User-Centric and Post-Centric Sentiments from Social Media for Topical Stance Prediction
AbstractConventional opinion polls were usually conducted via questionnaires or phone interviews, which are time-consuming and error-prone. With the advances in social networking platforms, it’s easier for the general public to …...
Clustering Word Embeddings with Self-Organizing Maps. Application on LaRoSeDa - A Large Romanian Sentiment Data Set
AbstractRomanian is one of the understudied languages in computational linguistics, with few resources available for the development of natural language processing tools. In this paper, we introduce LaRoSeDa, a Large …...
Grey-box Adversarial Attack And Defence For Sentiment Classification
AbstractWe introduce a grey-box adversarial attack and defence framework for sentiment classification. We address the issues of differentiability, label preservation and input reconstruction for adversarial attack and defence in one …...
Rationalization through Concepts
Automated predictions require explanations to be interpretable by humans. One type of ex- planation is a rationale, i.e., a selection of in- put features such as relevant text snippets from …...
Reinforced Counterfactual Data Augmentation for Dual Sentiment Classification
AbstractData augmentation and adversarial perturbation approaches have recently achieved promising results in solving the over-fitting problem in many natural language processing (NLP) tasks including sentiment classification. However, existing studies aimed …...
Reordering Examples Helps during Priming-based Few-Shot Learning
The ability to learn from limited data, or few- shot learning, is a desirable and often critical requirement for NLP systems. While many existing methods do poorly at learning from …...
SSMix: Saliency-Based Span Mixup for Text Classification
Data augmentation with mixup has shown to be effective on various computer vision tasks. Despite its great success, there has been a hurdle to apply mixup to NLP tasks since …...
A Hierarchical Interactive Network for Joint Span-based Aspect-Sentiment Analysis
AbstractRecently, some span-based methods have achieved encouraging performances for joint aspect-sentiment analysis, which first extract aspects (aspect extraction) by detecting aspect boundaries and then classify the span-level sentiments (sentiment classification). …...
Adapting Pre-trained Language Models to African Languages via Multilingual Adaptive Fine-Tuning
AbstractMultilingual pre-trained language models (PLMs) have demonstrated impressive performance on several downstream tasks for both high-resourced and low-resourced languages. However, there is still a large performance drop for languages unseen …...
MemoSen: A Multimodal Dataset for Sentiment Analysis of Memes
AbstractPosting and sharing memes have become a powerful expedient of expressing opinions on social media in recent days. Analysis of sentiment from memes has gained much attention to researchers due …...
Nearest Neighbor Zero-Shot Inference
AbstractRetrieval-augmented language models (LMs) use non-parametric memory to substantially outperform their non-retrieval counterparts on perplexity-based evaluations, but it is an open question whether they achieve similar gains in few- and …...
One-Teacher and Multiple-Student Knowledge Distillation on Sentiment Classification
AbstractKnowledge distillation is an effective method to transfer knowledge from a large pre-trained teacher model to a compacted student model. However, in previous studies, the distilled student models are still …...
Polyglot Prompt: Multilingual Multitask Prompt Training
AbstractThis paper aims for a potential architectural improvement for multilingual learning and asks: Can different tasks from different languages be modeled in a monolithic framework, i.e. without any task/language-specific module? …...
Resources and Experiments on Sentiment Classification for Georgian
AbstractThis paper presents, to the best of our knowledge, the first ever publicly available annotated dataset for sentiment classification and semantic polarity dictionary for Georgian. The characteristics of these resources …...
Robustifying Sentiment Classification by Maximally Exploiting Few Counterfactuals
AbstractFor text classification tasks, finetuned language models perform remarkably well. Yet, they tend to rely on spurious patterns in training data, thus limiting their performance on out-of-distribution (OOD) test data. …...
Towards Multi-Sense Cross-Lingual Alignment of Contextual Embeddings
AbstractCross-lingual word embeddings (CLWE) have been proven useful in many cross-lingual tasks. However, most existing approaches to learn CLWE including the ones with contextual embeddings are sense agnostic. In this …...
YNU-HPCC at SemEval-2022 Task 4: Finetuning Pretrained Language Models for Patronizing and Condescending Language Detection
AbstractThis paper describes a system built in the SemEval-2022 competition. As participants in Task 4: Patronizing and Condescending Language Detection, we implemented the text sentiment classification system for two subtasks …...
A Gradient Control Method for Backdoor Attacks on Parameter-Efficient Tuning
AbstractParameter-Efficient Tuning (PET) has shown remarkable performance by fine-tuning only a small number of parameters of the pre-trained language models (PLMs) for the downstream tasks, while it is also possible …...
BLIND: Bias Removal With No Demographics
AbstractModels trained on real-world data tend to imitate and amplify social biases. Common methods to mitigate biases require prior information on the types of biases that should be mitigated (e.g., …...
Causal-Debias: Unifying Debiasing in Pretrained Language Models and Fine-tuning via Causal Invariant Learning
AbstractDemographic biases and social stereotypes are common in pretrained language models (PLMs), and a burgeoning body of literature focuses on removing the unwanted stereotypical associations from PLMs. However, when fine-tuning …...
Characterizing and Measuring Linguistic Dataset Drift
AbstractNLP models often degrade in performance when real world data distributions differ markedly from training data. However, existing dataset drift metrics in NLP have generally not considered specific dimensions of …...
Generative Models For Indic Languages: Evaluating Content Generation Capabilities
AbstractLarge language models (LLMs) and generative AI have emerged as the most important areas in the field of natural language processing (NLP). LLMs are considered to be a key component …...
Local Interpretation of Transformer Based on Linear Decomposition
AbstractIn recent years, deep neural networks (DNNs) have achieved state-of-the-art performance on a wide range of tasks. However, limitations in interpretability have hindered their applications in the real world. This …...
Prompt-Based Approach for Czech Sentiment Analysis
AbstractThis paper introduces the first prompt-based methods for aspect-based sentiment analysis and sentiment classification in Czech. We employ the sequence-to-sequence models to solve the aspect-based tasks simultaneously and demonstrate the …...
Sentiment as an Ordinal Latent Variable
AbstractSentiment analysis has become a central tool in various disciplines outside of natural language processing. In particular in applied and domain-specific settings with strong requirements for interpretable methods, dictionary-based approaches …...
UDAPTER - Efficient Domain Adaptation Using Adapters
AbstractWe propose two methods to make unsupervised domain adaptation (UDA) more parameter efficient using adapters – small bottleneck layers interspersed with every layer of the large-scale pre-trained language model (PLM). …...
Zero-shot Approach to Overcome Perturbation Sensitivity of Prompts
AbstractRecent studies have demonstrated that natural-language prompts can help to leverage the knowledge learned by pre-trained language models for the binary sentence-level sentiment classification task. Specifically, these methods utilize few-shot …...