Benchmark Datasets
Related Papers
LogisticLDA: Regularizing Latent Dirichlet Allocation by Logistic Regression
. We present in this paper a supervised topic model for multi-class classification problems. To incorporate supervisory information, we jointly model documents and their labels in a graphical model called …...
A Probabilistic Forest-to-String Model for Language Generation from Typed Lambda Calculus Expressions
This paper describes a novel probabilistic ap- proach for generating natural language sen- tences from their underlying semantics in the form of typed lambda calculus. The approach is built on …...
Lexical Generalization in CCG Grammar Induction for Semantic Parsing
We consider the problem of learning fac- tored probabilistic CCG grammars for seman- tic parsing from data containing sentences paired with logical-form meaning representa- tions. Traditional CCG lexicons list lexical …...
Documents and Dependencies: an Exploration of Vector Space Models for Semantic Composition
In most previous research on distribu- tional semantics, Vector Space Models (VSMs) of words are built either from topical information (e.g., documents in which a word is present), or from …...
Dual Coordinate Descent Algorithms for Efficient Large Margin Structured Prediction
AbstractDue to the nature of complex NLP problems, structured prediction algorithms have been important modeling tools for a wide range of tasks. While there exists evidence showing that linear Structural …...
Exploring Representations from Unlabeled Data with Co-training for Chinese Word Segmentation
Nowadays supervised sequence labeling models can reach competitive performance on the task of Chinese word segmenta- tion. However, the ability of these mod- els is restricted by the availability of …...
A Benchmark Database of Phonetic Alignments in Historical Linguistics and Dialectology
AbstractIn the last two decades, alignment analyses have become an important technique in quantitative historical linguistics and dialectology. Phonetic alignment plays a crucial role in the identification of regular sound …...
Context-dependent Semantic Parsing for Time Expressions
We present an approach for learning context-dependent semantic parsers to identify and interpret time expressions. We use a Combinatory Categorial Gram- mar to construct compositional meaning representations, while considering contex- …...
Multi-Granular Aspect Aggregation in Aspect-Based Sentiment Analysis
Aspect-based sentiment analysis estimates the sentiment expressed for each particu- lar aspect (e.g., battery, screen) of an en- tity (e.g., smartphone). Different words or phrases, however, may be used to …...
Unsupervised Coreference Resolution by Utilizing the Most Informative Relations
In this paper we present a novel method for unsupervised coreference resolution. We introduce a precision-oriented inference method that scores a candidate entity of a mention based on the most …...
A Generative Word Embedding Model and its Low Rank Positive Semidefinite Solution
Most existing word embedding methods can be categorized into Neural Embedding Models and Matrix Factorization (MF)- based methods. However some mod- els are opaque to probabilistic interpre- tation, and MF-based …...
Extractive Summarization by Maximizing Semantic Volume
The most successful approaches to extrac- tive text summarization seek to maximize bigram coverage subject to a budget con- straint. In this work, we propose instead to maximize semantic volume. …...
Feature-Rich Two-Stage Logistic Regression for Monolingual Alignment
Monolingual alignment is the task of pair- ing semantically similar units from two pieces of text. We report a top-performing supervised aligner that operates on short text snippets. We employ …...
Solving General Arithmetic Word Problems
This paper presents a novel approach to au- tomatically solving arithmetic word problems. This is the first algorithmic approach that can handle arithmetic problems with multi- ple steps and operations, …...
A Deeper Look into Sarcastic Tweets Using Deep Convolutional Neural Networks
AbstractSarcasm detection is a key task for many natural language processing tasks. In sentiment analysis, for example, sarcasm can flip the polarity of an “apparently positive” sentence and, hence, negatively …...
Deep LSTM based Feature Mapping for Query Classification
Traditional convolutional neural network (CNN) based query classification uses linear feature mapping in its convolution opera- tion. The recurrent neural network (RNN), differs from a CNN in representing word sequence …...
Evaluating Entity Linking: An Analysis of Current Benchmark Datasets and a Roadmap for Doing a Better Job
AbstractEntity linking has become a popular task in both natural language processing and semantic web communities. However, we find that the benchmark datasets for entity linking tasks do not accurately …...
Evaluating Unsupervised Dutch Word Embeddings as a Linguistic Resource
AbstractWord embeddings have recently seen a strong increase in interest as a result of strong performance gains on a variety of tasks. However, most of this research also underlined the …...
Hybrid Question Answering over Knowledge Base and Free Text
AbstractRecent trend in question answering (QA) systems focuses on using structured knowledge bases (KBs) to find answers. While these systems are able to provide more precise answers than information retrieval …...
Label Embedding for Zero-shot Fine-grained Named Entity Typing
AbstractNamed entity typing is the task of detecting the types of a named entity in context. For instance, given “Eric is giving a presentation”, our goal is to infer that …...
Learning to Compose Neural Networks for Question Answering
We describe a question answering model that applies to both images and structured knowl- edge bases. The model uses natural lan- guage strings to automatically assemble neu- ral networks from …...
Leveraging Multiple Domains for Sentiment Classification
AbstractSentiment classification becomes more and more important with the rapid growth of user generated content. However, sentiment classification task usually comes with two challenges: first, sentiment classification is highly domain-dependent …...
Neighborhood Mixture Model for Knowledge Base Completion
Knowledge bases are useful resources for many natural language processing tasks, however, they are far from complete. In this paper, we define a novel entity rep- resentation as a mixture …...
Neural Word Segmentation Learning for Chinese
Most previous approaches to Chinese word segmentation formalize this prob- lem as a character-based sequence label- ing task so that only contextual informa- tion within fixed sized local windows and …...
One for All: Towards Language Independent Named Entity Linking
Entity linking (EL) is the task of dis- ambiguating mentions in text by associ- ating them with entries in a predefined database of mentions (persons, organiza- tions, etc). Most previous …...
STransE: a novel embedding model of entities and relationships in knowledge bases
Knowledge bases of real-world facts about entities and their relationships are useful re- sources for a variety of natural language pro- cessing tasks. However, because knowledge bases are typically incomplete, …...
Toward Socially-Infused Information Extraction: Embedding Authors, Mentions, and Entities
Entity linking is the task of identifying men- tions of entities in text, and linking them to entries in a knowledge base. This task is espe- cially difficult in microblogs, …...
Active Sentiment Domain Adaptation
AbstractDomain adaptation is an important technology to handle domain dependence problem in sentiment analysis field. Existing methods usually rely on sentiment classifiers trained in source domains. However, their performance may …...
Cascaded Attention based Unsupervised Information Distillation for Compressive Summarization
AbstractWhen people recall and digest what they have read for writing summaries, the important content is more likely to attract their attention. Inspired by this observation, we propose a cascaded …...
Deep Multi-Task Learning for Aspect Term Extraction with Memory Interaction
AbstractWe propose a novel LSTM-based deep multi-task learning framework for aspect term extraction from user review sentences. Two LSTMs equipped with extended memories and neural memory operations are designed for …...
Hierarchical Embeddings for Hypernymy Detection and Directionality
AbstractWe present a novel neural model HyperVec to learn hierarchical embeddings for hypernymy detection and directionality. While previous embeddings have shown limitations on prototypical hypernyms, HyperVec represents an unsupervised measure …...
Learning Contextually Informed Representations for Linear-Time Discourse Parsing
AbstractRecent advances in RST discourse parsing have focused on two modeling paradigms: (a) high order parsers which jointly predict the tree structure of the discourse and the relations it encodes; …...
Learning Generic Sentence Representations Using Convolutional Neural Networks
AbstractWe propose a new encoder-decoder approach to learn distributed sentence representations that are applicable to multiple purposes. The model is learned by using a convolutional neural network as an encoder …...
Sparsity and Noise: Where Knowledge Graph Embeddings Fall Short
AbstractKnowledge graph (KG) embedding techniques use structured relationships between entities to learn low-dimensional representations of entities and relations. One prominent goal of these approaches is to improve the quality of …...
A Meaning-Based Statistical English Math Word Problem Solver
AbstractWe introduce MeSys, a meaning-based approach, for solving English math word problems (MWPs) via understanding and reasoning in this paper. It first analyzes the text, transforms both body and question …...
Fine-grained Entity Typing through Increased Discourse Context and Adaptive Classification Thresholds
AbstractFine-grained entity typing is the task of assigning fine-grained semantic types to entity mentions. We propose a neural architecture which learns a distributional semantic representation that leverages a greater amount …...
Supervised Open Information Extraction
AbstractWe present data and methods that enable a supervised learning approach to Open Information Extraction (Open IE). Central to the approach is a novel formulation of Open IE as a …...
A2N: Attending to Neighbors for Knowledge Graph Inference
AbstractState-of-the-art models for knowledge graph completion aim at learning a fixed embedding representation of entities in a multi-relational graph which can generalize to infer unseen entity relationships at test time. …...
Adaptive Convolution for Multi-Relational Learning
AbstractWe consider the problem of learning distributed representations for entities and relations of multi-relational data so as to predict missing links therein. Convolutional neural networks have recently shown their superiority …...
Adversarial Category Alignment Network for Cross-domain Sentiment Classification
AbstractCross-domain sentiment classification aims to predict sentiment polarity on a target domain utilizing a classifier learned from a source domain. Most existing adversarial learning methods focus on aligning the global …...
An Empirical Comparison on Imitation Learning and Reinforcement Learning for Paraphrase Generation
AbstractGenerating paraphrases from given sentences involves decoding words step by step from a large vocabulary. To learn a decoder, supervised learning which maximizes the likelihood of tokens always suffers from …...
An Encoding Strategy Based Word-Character LSTM for Chinese NER
AbstractA recently proposed lattice model has demonstrated that words in character sequence can provide rich word boundary information for character-based Chinese NER model. In this model, word information is integrated …...
An Interactive Multi-Task Learning Network for End-to-End Aspect-Based Sentiment Analysis
AbstractAspect-based sentiment analysis produces a list of aspect terms and their corresponding sentiments for a natural language sentence. This task is usually done in a pipeline manner, with aspect term …...
Attention-based Conditioning Methods for External Knowledge Integration
AbstractIn this paper, we present a novel approach for incorporating external knowledge in Recurrent Neural Networks (RNNs). We propose the integration of lexicon features into the self-attention mechanism of RNN-based …...
Context-aware Embedding for Targeted Aspect-based Sentiment Analysis
AbstractAttention-based neural models were employed to detect the different aspects and sentiment polarities of the same target in targeted aspect-based sentiment analysis (TABSA). However, existing methods do not specifically pre-train …...
Contrastive Language Adaptation for Cross-Lingual Stance Detection
AbstractWe study cross-lingual stance detection, which aims to leverage labeled data in one language to identify the relative perspective (or stance) of a given document with respect to a claim …...
Deep Unknown Intent Detection with Margin Loss
AbstractIdentifying the unknown (novel) user intents that have never appeared in the training set is a challenging task in the dialogue system. In this paper, we present a two-stage method …...
Encouraging Paragraph Embeddings to Remember Sentence Identity Improves Classification
AbstractWhile paragraph embedding models are remarkably effective for downstream classification tasks, what they learn and encode into a single vector remains opaque. In this paper, we investigate a state-of-the-art paragraph …...
FlowSeq: Non-Autoregressive Conditional Sequence Generation with Generative Flow
AbstractMost sequence-to-sequence (seq2seq) models are autoregressive; they generate each token by conditioning on previously generated tokens. In contrast, non-autoregressive seq2seq models generate all tokens in one pass, which leads to …...
Harnessing Pre-Trained Neural Networks with Rules for Formality Style Transfer
AbstractFormality text style transfer plays an important role in various NLP applications, such as non-native speaker assistants and child education. Early studies normalize informal sentences with rules, before statistical and …...
IMHO Fine-Tuning Improves Claim Detection
AbstractClaims are the central component of an argument. Detecting claims across different domains or data sets can often be challenging due to their varying conceptualization. We propose to alleviate this …...
Incorporating Word Attention into Character-Based Word Segmentation
AbstractNeural network models have been actively applied to word segmentation, especially Chinese, because of the ability to minimize the effort in feature engineering. Typical segmentation models are categorized as character-based, …...
Joint Detection and Location of English Puns
AbstractA pun is a form of wordplay for an intended humorous or rhetorical effect, where a word suggests two or more meanings by exploiting polysemy (homographic pun) or phonological similarity …...
Learning Analogy-Preserving Sentence Embeddings for Answer Selection
AbstractAnswer selection aims at identifying the correct answer for a given question from a set of potentially correct answers. Contrary to previous works, which typically focus on the semantic similarity …...
Learning Only from Relevant Keywords and Unlabeled Documents
AbstractWe consider a document classification problem where document labels are absent but only relevant keywords of a target class and unlabeled documents are given. Although heuristic methods based on pseudo-labeling …...
Modeling Conversation Structure and Temporal Dynamics for Jointly Predicting Rumor Stance and Veracity
AbstractAutomatically verifying rumorous information has become an important and challenging task in natural language processing and social media analytics. Previous studies reveal that people’s stances towards rumorous messages can provide …...
MrMep: Joint Extraction of Multiple Relations and Multiple Entity Pairs Based on Triplet Attention
AbstractThis paper focuses on how to extract multiple relational facts from unstructured text. Neural encoder-decoder models have provided a viable new approach for jointly extracting relations and entity pairs. However, …...
Multi-task Learning with Sample Re-weighting for Machine Reading Comprehension
AbstractWe propose a multi-task learning framework to learn a joint Machine Reading Comprehension (MRC) model that can be applied to a wide range of MRC tasks in different domains. Inspired …...
One Time of Interaction May Not Be Enough: Go Deep with an Interaction-over-Interaction Network for Response Selection in Dialogues
AbstractCurrently, researchers have paid great attention to retrieval-based dialogues in open-domain. In particular, people study the problem by investigating context-response matching for multi-turn response selection based on publicly recognized benchmark …...
Open-Domain Targeted Sentiment Analysis via Span-Based Extraction and Classification
AbstractOpen-domain targeted sentiment analysis aims to detect opinion targets along with their sentiment polarities from a sentence. Prior work typically formulates this task as a sequence tagging problem. However, such …...
Ranking-Based Autoencoder for Extreme Multi-label Classification
AbstractExtreme Multi-label classification (XML) is an important yet challenging machine learning task, that assigns to each instance its most relevant candidate labels from an extremely large label collection, where the …...
Reviews Meet Graphs: Enhancing User and Item Representations for Recommendation with Hierarchical Attentive Graph Neural Network
AbstractUser and item representation learning is critical for recommendation. Many of existing recommendation methods learn representations of users and items based on their ratings and reviews. However, the user-user and …...
Sentence-Level Evidence Embedding for Claim Verification with Hierarchical Attention Networks
AbstractClaim verification is generally a task of verifying the veracity of a given claim, which is critical to many downstream applications. It is cumbersome and inefficient for human fact-checkers to …...
Simple and Effective Text Matching with Richer Alignment Features
AbstractIn this paper, we present a fast and strong neural approach for general purpose text matching applications. We explore what is sufficient to build a fast and well-performed text matching …...
Single Document Summarization as Tree Induction
AbstractIn this paper, we conceptualize single-document extractive summarization as a tree induction problem. In contrast to previous approaches which have relied on linguistically motivated document representations to generate summaries, our …...
Word Usage Similarity Estimation with Sentence Representations and Automatic Substitutes
AbstractUsage similarity estimation addresses the semantic proximity of word instances in different contexts. We apply contextualized (ELMo and BERT) word and sentence embeddings to this task, and propose supervised models …...
“Who said it, and Why?” Provenance for Natural Language Claims
AbstractIn an era where generating content and publishing it is so easy, we are bombarded with information and are exposed to all kinds of claims, some of which do not …...
2kenize: Tying Subword Sequences for Chinese Script Conversion
AbstractSimplified Chinese to Traditional Chinese character conversion is a common preprocessing step in Chinese NLP. Despite this, current approaches have insufficient performance because they do not take into account that …...
A Joint Multiple Criteria Model in Transfer Learning for Cross-domain Chinese Word Segmentation
AbstractWord-level information is important in natural language processing (NLP), especially for the Chinese language due to its high linguistic complexity. Chinese word segmentation (CWS) is an essential task for Chinese …...
A Multi-Task Incremental Learning Framework with Category Name Embedding for Aspect-Category Sentiment Analysis
Abstract(T)ACSA tasks, including aspect-category sentiment analysis (ACSA) and targeted aspect-category sentiment analysis (TACSA), aims at identifying sentiment polarity on predefined categories. Incremental learning on new categories is necessary for (T)ACSA …...
A Preliminary Exploration of GANs for Keyphrase Generation
AbstractWe introduce a new keyphrase generation approach using Generative Adversarial Networks (GANs). For a given document, the generator produces a sequence of keyphrases, and the discriminator distinguishes between human-curated and …...
Attention Transfer Network for Aspect-level Sentiment Classification
AbstractAspect-level sentiment classification (ASC) aims to detect the sentiment polarity of a given opinion target in a sentence. In neural network-based methods for ASC, most works employ the attention mechanism …...
BabyWalk: Going Farther in Vision-and-Language Navigation by Taking Baby Steps
AbstractLearning to follow instructions is of fundamental importance to autonomous agents for vision-and-language navigation (VLN). In this paper, we study how an agent can navigate long paths when learning from …...
Be More with Less: Hypergraph Attention Networks for Inductive Text Classification
AbstractText classification is a critical research topic with broad applications in natural language processing. Recently, graph neural networks (GNNs) have received increasing attention in the research community and demonstrated their …...
Calibrating Structured Output Predictors for Natural Language Processing
AbstractWe address the problem of calibrating prediction confidence for output entities of interest in natural language processing (NLP) applications. It is important that NLP applications such as named entity recognition …...
Chunk-based Chinese Spelling Check with Global Optimization
AbstractChinese spelling check is a challenging task due to the characteristics of the Chinese language, such as the large character set, no word boundary, and short word length. On the …...
Clickbait Detection with Style-aware Title Modeling and Co-attention
AbstractClickbait is a form of web content designed to attract attention and entice users to click on specific hyperlinks. The detection of clickbaits is an important task for online platforms …...
Closing the Gap: Joint De-Identification and Concept Extraction in the Clinical Domain
AbstractExploiting natural language processing in the clinical domain requires de-identification, i.e., anonymization of personal information in texts. However, current research considers de-identification and downstream tasks, such as concept extraction, only …...
Coarse-to-Fine Query Focused Multi-Document Summarization
AbstractWe consider the problem of better modeling query-cluster interactions to facilitate query focused multi-document summarization. Due to the lack of training data, existing work relies heavily on retrieval-style methods for …...
Constituency Lattice Encoding for Aspect Term Extraction
AbstractOne of the remaining challenges for aspect term extraction in sentiment analysis resides in the extraction of phrase-level aspect terms, which is non-trivial to determine the boundaries of such terms. …...
Contextual Modulation for Relation-Level Metaphor Identification
AbstractIdentifying metaphors in text is very challenging and requires comprehending the underlying comparison. The automation of this cognitive process has gained wide attention lately. However, the majority of existing approaches …...
Convolution over Hierarchical Syntactic and Lexical Graphs for Aspect Level Sentiment Analysis
AbstractThe state-of-the-art methods in aspect-level sentiment classification have leveraged the graph based models to incorporate the syntactic structure of a sentence. While being effective, these methods ignore the corpus level …...
COSMIC: COmmonSense knowledge for eMotion Identification in Conversations
AbstractIn this paper, we address the task of utterance level emotion recognition in conversations using commonsense knowledge. We propose COSMIC, a new framework that incorporates different elements of commonsense such …...
Coupled Hierarchical Transformer for Stance-Aware Rumor Verification in Social Media Conversations
AbstractThe prevalent use of social media enables rapid spread of rumors on a massive scale, which leads to the emerging need of automatic rumor verification (RV). A number of previous …...
Differentially Private Representation for NLP: Formal Guarantee and An Empirical Study on Privacy and Fairness
AbstractIt has been demonstrated that hidden representation learned by deep model can encode private information of the input, hence can be exploited to recover such information with reasonable accuracy. To …...
Dual Dynamic Memory Network for End-to-End Multi-turn Task-oriented Dialog Systems
AbstractExisting end-to-end task-oriented dialog systems struggle to dynamically model long dialog context for interactions and effectively incorporate knowledge base (KB) information into dialog generation. To conquer these limitations, we propose …...
Dual Inference for Improving Language Understanding and Generation
AbstractNatural language understanding (NLU) and Natural language generation (NLG) tasks hold a strong dual relationship, where NLU aims at predicting semantic labels based on natural language utterances and NLG does …...
Every Document Owns Its Structure: Inductive Text Classification via Graph Neural Networks
AbstractText classification is fundamental in natural language processing (NLP) and Graph Neural Networks (GNN) are recently applied in this task. However, the existing graph-based works can neither capture the contextual …...
Finding the Evidence: Localization-aware Answer Prediction for Text Visual Question Answering
AbstractImage text carries essential information to understand the scene and perform reasoning. Text-based visual question answering (text VQA) task focuses on visual questions that require reading text in images. Existing …...
GRACE: Gradient Harmonized and Cascaded Labeling for Aspect-based Sentiment Analysis
AbstractIn this paper, we focus on the imbalance issue, which is rarely studied in aspect term extraction and aspect sentiment classification when regarding them as sequence labeling tasks. Besides, previous …...
Graph-to-Tree Learning for Solving Math Word Problems
AbstractWhile the recent tree-based neural models have demonstrated promising results in generating solution expression for the math word problem (MWP), most of these models do not capture the relationships and …...
Handling Rare Entities for Neural Sequence Labeling
AbstractOne great challenge in neural sequence labeling is the data sparsity problem for rare entity words and phrases. Most of test set entities appear only few times and are even …...
Hyperbolic Capsule Networks for Multi-Label Classification
AbstractAlthough deep neural networks are effective at extracting high-level features, classification methods usually encode an input into a vector representation via simple feature aggregation operations (e.g. pooling). Such operations limit …...
Improving AMR Parsing with Sequence-to-Sequence Pre-training
AbstractIn the literature, the research on abstract meaning representation (AMR) parsing is much restricted by the size of human-curated dataset which is critical to build an AMR parser with good …...
Improving Aspect-based Sentiment Analysis with Gated Graph Convolutional Networks and Syntax-based Regulation
AbstractAspect-based Sentiment Analysis (ABSA) seeks to predict the sentiment polarity of a sentence toward a specific aspect. Recently, it has been shown that dependency trees can be integrated into deep …...
Improving Constituency Parsing with Span Attention
AbstractConstituency parsing is a fundamental and important task for natural language understanding, where a good representation of contextual information can help this task. N-grams, which is a conventional type of …...
Improving Multimodal Named Entity Recognition via Entity Span Detection with Unified Multimodal Transformer
AbstractIn this paper, we study Multimodal Named Entity Recognition (MNER) for social media posts. Existing approaches for MNER mainly suffer from two drawbacks: (1) despite generating word-aware visual representations, their …...
Joint Aspect Extraction and Sentiment Analysis with Directional Graph Convolutional Networks
AbstractEnd-to-end aspect-based sentiment analysis (EASA) consists of two sub-tasks: the first extracts the aspect terms in a sentence and the second predicts the sentiment polarities for such terms. For EASA, …...
Joint Chinese Word Segmentation and Part-of-speech Tagging via Multi-channel Attention of Character N-grams
AbstractChinese word segmentation (CWS) and part-of-speech (POS) tagging are two fundamental tasks for Chinese language processing. Previous studies have demonstrated that jointly performing them can be an effective one-step solution …...
Joint Chinese Word Segmentation and Part-of-speech Tagging via Two-way Attentions of Auto-analyzed Knowledge
AbstractChinese word segmentation (CWS) and part-of-speech (POS) tagging are important fundamental tasks for Chinese language processing, where joint learning of them is an effective one-step solution for both tasks. Previous …...
Knowledge Aware Emotion Recognition in Textual Conversations via Multi-Task Incremental Transformer
AbstractEmotion recognition in textual conversations (ERTC) plays an important role in a wide range of applications, such as opinion mining, recommender systems, and so on. ERTC, however, is a challenging …...
Knowledge Graph Embedding with Atrous Convolution and Residual Learning
AbstractKnowledge graph embedding is an important task and it will benefit lots of downstream applications. Currently, deep neural networks based methods achieve state-of-the-art performance. However, most of these existing methods …...
Label Correction Model for Aspect-based Sentiment Analysis
AbstractAspect-based sentiment analysis includes opinion aspect extraction and aspect sentiment classification. Researchers have attempted to discover the relationship between these two sub-tasks and have proposed the joint model for solving …...
Language Agnostic Automatic Summarization Evaluation
AbstractSo far work on automatic summarization has dealt primarily with English data. Accordingly, evaluation methods were primarily developed with this language in mind. In our work, we present experiments of …...
Learning Collaborative Agents with Rule Guidance for Knowledge Graph Reasoning
AbstractWalk-based models have shown their advantages in knowledge graph (KG) reasoning by achieving decent performance while providing interpretable decisions. However, the sparse reward signals offered by the KG during a …...
Learning to Tag OOV Tokens by Integrating Contextual Representation and Background Knowledge
AbstractNeural-based context-aware models for slot tagging have achieved state-of-the-art performance. However, the presence of OOV(out-of-vocab) words significantly degrades the performance of neural-based models, especially in a few-shot scenario. In this …...
Learning VAE-LDA Models with Rounded Reparameterization Trick
AbstractThe introduction of VAE provides an efficient framework for the learning of generative models, including generative topic models. However, when the topic model is a Latent Dirichlet Allocation (LDA) model, …...
MLQA: Evaluating Cross-lingual Extractive Question Answering
AbstractQuestion answering (QA) models have shown rapid progress enabled by the availability of large, high-quality benchmark datasets. Such annotated datasets are difficult and costly to collect, and rarely exist in …...
Modeling Local Contexts for Joint Dialogue Act Recognition and Sentiment Classification with Bi-channel Dynamic Convolutions
AbstractIn this paper, we target improving the joint dialogue act recognition (DAR) and sentiment classification (SC) tasks by fully modeling the local contexts of utterances. First, we employ the dynamic …...
Modularized Syntactic Neural Networks for Sentence Classification
AbstractThis paper focuses on tree-based modeling for the sentence classification task. In existing works, aggregating on a syntax tree usually considers local information of sub-trees. In contrast, in addition to …...
Multiˆ2OIE: Multilingual Open Information Extraction Based on Multi-Head Attention with BERT
AbstractIn this paper, we propose Multi2OIE, which performs open information extraction (open IE) by combining BERT with multi-head attention. Our model is a sequence-labeling system with an efficient and effective …...
Multilingual Culture-Independent Word Analogy Datasets
AbstractIn text processing, deep neural networks mostly use word embeddings as an input. Embeddings have to ensure that relations between words are reflected through distances in a high-dimensional numeric space. …...
Octa: Omissions and Conflicts in Target-Aspect Sentiment Analysis
AbstractSentiments in opinionated text are often determined by both aspects and target words (or targets). We observe that targets and aspects interrelate in subtle ways, often yielding conflicting sentiments. Thus, …...
Out-of-Sample Representation Learning for Knowledge Graphs
AbstractMany important problems can be formulated as reasoning in knowledge graphs. Representation learning has proved extremely effective for transductive reasoning, in which one needs to make new predictions for already …...
ParaCrawl: Web-Scale Acquisition of Parallel Corpora
AbstractWe report on methods to create the largest publicly available parallel corpora by crawling the web, using open source software. We empirically compare alternative methods and publish benchmark data sets …...
Probabilistic Case-based Reasoning for Open-World Knowledge Graph Completion
AbstractA case-based reasoning (CBR) system solves a new problem by retrieving ‘cases’ that are similar to the given problem. If such a system can achieve high accuracy, it is appealing …...
Query Graph Generation for Answering Multi-hop Complex Questions from Knowledge Bases
AbstractPrevious work on answering complex questions from knowledge bases usually separately addresses two types of complexity: questions with constraints and questions with multiple hops of relations. In this paper, we …...
Simplify the Usage of Lexicon in Chinese NER
AbstractRecently, many works have tried to augment the performance of Chinese named entity recognition (NER) using word lexicons. As a representative, Lattice-LSTM has achieved new benchmark results on several public …...
Single-/Multi-Source Cross-Lingual NER via Teacher-Student Learning on Unlabeled Data in Target Language
AbstractTo better tackle the named entity recognition (NER) problem on languages with little/no labeled data, cross-lingual NER must effectively leverage knowledge learned from source languages with rich labeled data. Previous …...
Slot-consistent NLG for Task-oriented Dialogue Systems with Iterative Rectification Network
AbstractData-driven approaches using neural networks have achieved promising performances in natural language generation (NLG). However, neural generators are prone to make mistakes, e.g., neglecting an input slot value and generating …...
Syntactic Graph Convolutional Network for Spoken Language Understanding
AbstractSlot filling and intent detection are two major tasks for spoken language understanding. In most existing work, these two tasks are built as joint models with multi-task learning with no …...
Syntactically Aware Cross-Domain Aspect and Opinion Terms Extraction
AbstractA fundamental task of fine-grained sentiment analysis is aspect and opinion terms extraction. Supervised-learning approaches have shown good results for this task; however, they fail to scale across domains where …...
Taxonomy Construction of Unseen Domains via Graph-based Cross-Domain Knowledge Transfer
AbstractExtracting lexico-semantic relations as graph-structured taxonomies, also known as taxonomy construction, has been beneficial in a variety of NLP applications. Recently Graph Neural Network (GNN) has shown to be powerful …...
Text Classification Using Label Names Only: A Language Model Self-Training Approach
AbstractCurrent text classification methods typically require a good number of human-labeled documents as training data, which can be costly and difficult to obtain in real applications. Humans can perform classification …...
The Dots Have Their Values: Exploiting the Node-Edge Connections in Graph-based Neural Models for Document-level Relation Extraction
AbstractThe goal of Document-level Relation Extraction (DRE) is to recognize the relations between entity mentions that can span beyond sentence boundary. The current state-of-the-art method for this problem has involved …...
The World is Not Binary: Learning to Rank with Grayscale Data for Dialogue Response Selection
AbstractResponse selection plays a vital role in building retrieval-based conversation systems. Despite that response selection is naturally a learning-to-rank problem, most prior works take a point-wise view and train binary …...
Towards Understanding Sample Variance in Visually Grounded Language Generation: Evaluations and Observations
AbstractA major challenge in visually grounded language generation is to build robust benchmark datasets and models that can generalize well in real-world settings. To do this, it is critical to …...
Using Distributional Thesaurus Embedding for Co-hyponymy Detection
AbstractDiscriminating lexical relations among distributionally similar words has always been a challenge for natural language processing (NLP) community. In this paper, we investigate whether the network embedding of distributional thesaurus …...
WER we are and WER we think we are
AbstractNatural language processing of conversational speech requires the availability of high-quality transcripts. In this paper, we express our skepticism towards the recent reports of very low Word Error Rates (WERs) …...
Word Embedding Evaluation for Sinhala
AbstractThis paper presents the first ever comprehensive evaluation of different types of word embeddings for Sinhala language. Three standard word embedding models, namely, Word2Vec (both Skipgram and CBOW), FastText, and …...
Word-level Textual Adversarial Attacking as Combinatorial Optimization
AbstractAdversarial attacks are carried out to reveal the vulnerability of deep neural networks. Textual adversarial attacking is challenging because text is discrete and a small perturbation can bring significant change …...
Zero-Shot Rationalization by Multi-Task Transfer Learning from Question Answering
AbstractExtracting rationales can help human understand which information the model utilizes and how it makes the prediction towards better interpretability. However, annotating rationales requires much effort and only few datasets …...
A Generative Framework for Simultaneous Machine Translation
AbstractWe propose a generative framework for simultaneous machine translation. Conventional approaches use a fixed number of source words to translate or learn dynamic policies for the number of source words …...
A Graph-Based Neural Model for End-to-End Frame Semantic Parsing
AbstractFrame semantic parsing is a semantic analysis task based on FrameNet which has received great attention recently. The task usually involves three subtasks sequentially: (1) target identification, (2) frame classification …...
A Knowledge-Guided Framework for Frame Identification
AbstractFrame Identification (FI) is a fundamental and challenging task in frame semantic parsing. The task aims to find the exact frame evoked by a target word in a given sentence. …...
A Novel Global Feature-Oriented Relational Triple Extraction Model based on Table Filling
AbstractTable filling based relational triple extraction methods are attracting growing research interests due to their promising performance and their abilities on extracting triples from complex sentences. However, this kind of …...
A Semantic Filter Based on Relations for Knowledge Graph Completion
AbstractKnowledge graph embedding, representing entities and relations in the knowledge graphs with high-dimensional vectors, has made significant progress in link prediction. More researchers have explored the representational capabilities of models …...
A Semantic-based Method for Unsupervised Commonsense Question Answering
AbstractUnsupervised commonsense question answering is appealing since it does not rely on any labeled task data. Among existing work, a popular solution is to use pre-trained language models to score …...
A Sequence-to-Sequence Approach to Dialogue State Tracking
AbstractThis paper is concerned with dialogue state tracking (DST) in a task-oriented dialogue system. Building a DST module that is highly effective is still a challenging issue, although significant progresses …...
A Span-Based Model for Joint Overlapped and Discontinuous Named Entity Recognition
AbstractResearch on overlapped and discontinuous named entity recognition (NER) has received increasing attention. The majority of previous work focuses on either overlapped or discontinuous entities. In this paper, we propose …...
Adversarial Self-Supervised Learning for Out-of-Domain Detection
AbstractDetecting out-of-domain (OOD) intents is crucial for the deployed task-oriented dialogue system. Previous unsupervised OOD detection methods only extract discriminative features of different in-domain intents while supervised counterparts can directly …...
AdvPicker: Effectively Leveraging Unlabeled Data via Adversarial Discriminator for Cross-Lingual NER
AbstractNeural methods have been shown to achieve high performance in Named Entity Recognition (NER), but rely on costly high-quality labeled data for training, which is not always available across languages. …...
Are NLP Models really able to Solve Simple Math Word Problems?
AbstractThe problem of designing NLP solvers for math word problems (MWP) has seen sustained research activity and steady gains in the test accuracy. Since existing solvers achieve high performance on …...
Aspect Sentiment Quad Prediction as Paraphrase Generation
AbstractAspect-based sentiment analysis (ABSA) has been extensively studied in recent years, which typically involves four fundamental sentiment elements, including the aspect category, aspect term, opinion term, and sentiment polarity. Existing …...
Attending via both Fine-tuning and Compressing
Though being a primary trend for enhancing interpretability of neural networks, attention mechanism’s reliability and validity are still under debate. In this paper, we try to pu- rify attention scores …...
Attention-based Relational Graph Convolutional Network for Target-Oriented Opinion Words Extraction
AbstractTarget-oriented opinion words extraction (TOWE) is a subtask of aspect-based sentiment analysis (ABSA). It aims to extract the corresponding opinion words for a given opinion target in a review sentence. …...
Benchmarking Scalable Methods for Streaming Cross Document Entity Coreference
AbstractStreaming cross document entity coreference (CDC) systems disambiguate mentions of named entities in a scalable manner via incremental clustering. Unlike other approaches for named entity disambiguation (e.g., entity linking), streaming …...
Beta Distribution Guided Aspect-aware Graph for Aspect Category Sentiment Analysis with Affective Knowledge
AbstractIn this paper, we investigate the Aspect Category Sentiment Analysis (ACSA) task from a novel perspective by exploring a Beta Distribution guided aspect-aware graph construction based on external knowledge. That …...
Beyond Text: Incorporating Metadata and Label Structure for Multi-Label Document Classification using Heterogeneous Graphs
AbstractMulti-label document classification, associating one document instance with a set of relevant labels, is attracting more and more research attention. Existing methods explore the incorporation of information beyond text, such …...
Collaborative Learning of Bidirectional Decoders for Unsupervised Text Style Transfer
AbstractUnsupervised text style transfer aims to alter the underlying style of the text to a desired value while keeping its style-independent semantics, without the support of parallel training corpora. Existing …...
Context-Interactive Pre-Training for Document Machine Translation
AbstractDocument machine translation aims to translate the source sentence into the target language in the presence of additional contextual information. However, it typically suffers from a lack of doc-level bilingual …...
Cross-lingual Entity Alignment with Incidental Supervision
AbstractMuch research effort has been put to multilingual knowledge graph (KG) embedding methods to address the entity alignment task, which seeks to match entities in different languagespecific KGs that refer …...
CSAGN: Conversational Structure Aware Graph Network for Conversational Semantic Role Labeling
AbstractConversational semantic role labeling (CSRL) is believed to be a crucial step towards dialogue understanding. However, it remains a major challenge for existing CSRL parser to handle conversational structural information. …...
DA-Transformer: Distance-aware Transformer
AbstractTransformer has achieved great success in the NLP field by composing various advanced models like BERT and GPT. However, Transformer and its existing variants may not be optimal in capturing …...
Dependency-driven Relation Extraction with Attentive Graph Convolutional Networks
AbstractSyntactic information, especially dependency trees, has been widely used by existing studies to improve relation extraction with better semantic guidance for analyzing the context information associated with the given entities. …...
Detect and Classify – Joint Span Detection and Classification for Health Outcomes
AbstractA health outcome is a measurement or an observation used to capture and assess the effect of a treatment. Automatic detection of health outcomes from text would undoubtedly speed up …...
Dialogue Response Selection with Hierarchical Curriculum Learning
AbstractWe study the learning of a matching model for dialogue response selection. Motivated by the recent finding that models trained with random negative samples are not ideal in real-world scenarios, …...
DialogueCRN: Contextual Reasoning Networks for Emotion Recognition in Conversations
AbstractEmotion Recognition in Conversations (ERC) has gained increasing attention for developing empathetic machines. Recently, many approaches have been devoted to perceiving conversational context by deep learning models. However, these approaches …...
Dictionary-based Debiasing of Pre-trained Word Embeddings
AbstractWord embeddings trained on large corpora have shown to encode high levels of unfair discriminatory gender, racial, religious and ethnic biases. In contrast, human-written dictionaries describe the meanings of words …...
Diversifying Dialog Generation via Adaptive Label Smoothing
AbstractNeural dialogue generation models trained with the one-hot target distribution suffer from the over-confidence issue, which leads to poor generation diversity as widely reported in the literature. Although existing approaches …...
Edge: Enriching Knowledge Graph Embeddings with External Text
AbstractKnowledge graphs suffer from sparsity which degrades the quality of representations generated by various methods. While there is an abundance of textual information throughout the web and many existing knowledge …...
Enhancing Aspect-level Sentiment Analysis with Word Dependencies
AbstractAspect-level sentiment analysis (ASA) has received much attention in recent years. Most existing approaches tried to leverage syntactic information, such as the dependency parsing results of the input text, to …...
Evaluating the Impact of a Hierarchical Discourse Representation on Entity Coreference Resolution Performance
AbstractRecent work on entity coreference resolution (CR) follows current trends in Deep Learning applied to embeddings and relatively simple task-related features. SOTA models do not make use of hierarchical representations …...
Exploiting Document Structures and Cluster Consistencies for Event Coreference Resolution
AbstractWe study the problem of event coreference resolution (ECR) that seeks to group coreferent event mentions into the same clusters. Deep learning methods have recently been applied for this task …...
Exploiting Position and Contextual Word Embeddings for Keyphrase Extraction from Scientific Papers
AbstractKeyphrases associated with research papers provide an effective way to find useful information in the large and growing scholarly digital collections. In this paper, we present KPRank, an unsupervised graph-based …...
Exploring Non-Autoregressive Text Style Transfer
AbstractIn this paper, we explore Non-AutoRegressive (NAR) decoding for unsupervised text style transfer. We first propose a base NAR model by directly adapting the common training scheme from its AutoRegressive …...
Fine-grained Post-training for Improving Retrieval-based Dialogue Systems
AbstractRetrieval-based dialogue systems display an outstanding performance when pre-trained language models are used, which includes bidirectional encoder representations from transformers (BERT). During the multi-turn response selection, BERT focuses on training …...
Graph Based Network with Contextualized Representations of Turns in Dialogue
AbstractDialogue-based relation extraction (RE) aims to extract relation(s) between two arguments that appear in a dialogue. Because dialogues have the characteristics of high personal pronoun occurrences and low information density, …...
Graph Convolutional Networks for Event Causality Identification with Rich Document-level Structures
AbstractWe study the problem of Event Causality Identification (ECI) to detect causal relation between event mention pairs in text. Although deep learning models have recently shown state-of-the-art performance for ECI, …...
HTCInfoMax: A Global Model for Hierarchical Text Classification via Information Maximization
AbstractThe current state-of-the-art model HiAGM for hierarchical text classification has two limitations. First, it correlates each text sample with all labels in the dataset which contains irrelevant information. Second, it …...
HypMix: Hyperbolic Interpolative Data Augmentation
AbstractInterpolation-based regularisation methods for data augmentation have proven to be effective for various tasks and modalities. These methods involve performing mathematical operations over the raw input samples or their latent …...
Improving BERT with Syntax-aware Local Attention
Pre-trained Transformer-based neural lan- guage models, such as BERT, have achieved remarkable results on varieties of NLP tasks. Recent works have shown that attention-based models can benefit from more focused …...
Inductive Topic Variational Graph Auto-Encoder for Text Classification
AbstractGraph convolutional networks (GCNs) have been applied recently to text classification and produced an excellent performance. However, existing GCN-based methods do not assume an explicit latent semantic structure of documents, …...
Integrated Directional Gradients: Feature Interaction Attribution for Neural NLP Models
AbstractIn this paper, we introduce Integrated Directional Gradients (IDG), a method for attributing importance scores to groups of features, indicating their relevance to the output of a neural network model …...
Integrating Semantics and Neighborhood Information with Graph-Driven Generative Models for Document Retrieval
AbstractWith the need of fast retrieval speed and small memory footprint, document hashing has been playing a crucial role in large-scale information retrieval. To generate high-quality hashing code, both semantics …...
Joint Learning of Representations for Web-tables, Entities and Types using Graph Convolutional Network
AbstractExisting approaches for table annotation with entities and types either capture the structure of table using graphical models, or learn embeddings of table entries without accounting for the complete syntactic …...
Keep the Primary, Rewrite the Secondary: A Two-Stage Approach for Paraphrase Generation
Paraphrase generation is an and challenging NLG problem.important In this work, we propose a new Identification-then- Aggregation (IA) framework to tackle this task. In the identification step, the input tokens …...
Knowing False Negatives: An Adversarial Training Method for Distantly Supervised Relation Extraction
AbstractDistantly supervised relation extraction (RE) automatically aligns unstructured text with relation instances in a knowledge base (KB). Due to the incompleteness of current KBs, sentences implying certain relations may be …...
Label-Specific Dual Graph Neural Network for Multi-Label Text Classification
AbstractMulti-label text classification is one of the fundamental tasks in natural language processing. Previous studies have difficulties to distinguish similar labels well because they learn the same document representations for …...
Learning from Multiple Noisy Augmented Data Sets for Better Cross-Lingual Spoken Language Understanding
AbstractLack of training data presents a grand challenge to scaling out spoken language understanding (SLU) to low-resource languages. Although various data augmentation approaches have been proposed to synthesize training data …...
Learning Neural Ordinary Equations for Forecasting Future Links on Temporal Knowledge Graphs
AbstractThere has been an increasing interest in inferring future links on temporal knowledge graphs (KG). While links on temporal KGs vary continuously over time, the existing approaches model the temporal …...
Learning to Ask Conversational Questions by Optimizing Levenshtein Distance
AbstractConversational Question Simplification (CQS) aims to simplify self-contained questions into conversational ones by incorporating some conversational characteristics, e.g., anaphora and ellipsis. Existing maximum likelihood estimation based methods often get trapped …...
Learning to Perturb Word Embeddings for Out-of-distribution QA
AbstractQA models based on pretrained language models have achieved remarkable performance on various benchmark datasets. However, QA models do not generalize well to unseen data that falls outside the training …...
Low-Rank Subspaces for Unsupervised Entity Linking
AbstractEntity linking is an important problem with many applications. Most previous solutions were designed for settings where annotated training data is available, which is, however, not the case in numerous …...
Maximal Clique Based Non-Autoregressive Open Information Extraction
AbstractOpen Information Extraction (OpenIE) aims to discover textual facts from a given sentence. In essence, the facts contained in plain text are unordered. However, the popular OpenIE systems usually output …...
Modeling Document-Level Context for Event Detection via Important Context Selection
AbstractThe task of Event Detection (ED) in Information Extraction aims to recognize and classify trigger words of events in text. The recent progress has featured advanced transformer-based language models (e.g., …...
Modularized Interaction Network for Named Entity Recognition
AbstractAlthough the existing Named Entity Recognition (NER) models have achieved promising performance, they suffer from certain drawbacks. The sequence labeling-based NER models do not perform well in recognizing long entities …...
Multi-granularity Textual Adversarial Attack with Behavior Cloning
AbstractRecently, the textual adversarial attack models become increasingly popular due to their successful in estimating the robustness of NLP models. However, existing works have obvious deficiencies. (1)They usually consider only …...
On the Benefit of Syntactic Supervision for Cross-lingual Transfer in Semantic Role Labeling
AbstractAlthough recent developments in neural architectures and pre-trained representations have greatly increased state-of-the-art model performance on fully-supervised semantic role labeling (SRL), the task remains challenging for languages where supervised SRL …...
Probabilistic Box Embeddings for Uncertain Knowledge Graph Reasoning
AbstractKnowledge bases often consist of facts which are harvested from a variety of sources, many of which are noisy and some of which conflict, resulting in a level of uncertainty …...
Pushing Paraphrase Away from Original Sentence: A Multi-Round Paraphrase Generation Approach
In recent years, neural paraphrase generation based on Seq2Seq has achieved superior per- formance, however, the generated paraphrase still has the problem of lack of diversity. In this paper, we …...
Question and Answer Test-Train Overlap in Open-Domain Question Answering Datasets
AbstractIdeally Open-Domain Question Answering models should exhibit a number of competencies, ranging from simply memorizing questions seen at training time, to answering novel question formulations with answers seen during training, …...
Reinforced Counterfactual Data Augmentation for Dual Sentiment Classification
AbstractData augmentation and adversarial perturbation approaches have recently achieved promising results in solving the over-fitting problem in many natural language processing (NLP) tasks including sentiment classification. However, existing studies aimed …...
Relation Extraction with Word Graphs from N-grams
AbstractMost recent studies for relation extraction (RE) leverage the dependency tree of the input sentence to incorporate syntax-driven contextual information to improve model performance, with little attention paid to the …...
Self-training with Few-shot Rationalization
AbstractWhile pre-trained language models have obtained state-of-the-art performance for several natural language understanding tasks, they are quite opaque in terms of their decision-making process. While some recent works focus on …...
Semantic and Syntactic Enhanced Aspect Sentiment Triplet Extraction
Aspect Sentiment Triplet Extraction (ASTE) aims to extract triplets from sentences, where each triplet includes an entity, its associated sentiment, and the opinion span explaining the reason for the sentiment. …...
Set Generation Networks for End-to-End Knowledge Base Population
AbstractThe task of knowledge base population (KBP) aims to discover facts about entities from texts and expand a knowledge base with these facts. Previous studies shape end-to-end KBP as a …...
SMURF: SeMantic and linguistic UndeRstanding Fusion for Caption Evaluation via Typicality Analysis
AbstractThe open-ended nature of visual captioning makes it a challenging area for evaluation. The majority of proposed models rely on specialized training to improve human-correlation, resulting in limited adoption, generalizability, …...
Supervised and Unsupervised Neural Approaches to Text Readability
AbstractWe present a set of novel neural supervised and unsupervised approaches for determining the readability of documents. In the unsupervised setting, we leverage neural language models, whereas in the supervised …...
Text Augmentation in a Multi-Task View
AbstractTraditional data augmentation aims to increase the coverage of the input distribution by generating augmented examples that strongly resemble original samples in an online fashion where augmented examples dominate training. …...
Text AutoAugment: Learning Compositional Augmentation Policy for Text Classification
AbstractData augmentation aims to enrich training samples for alleviating the overfitting issue in low-resource or class-imbalanced situations. Traditional methods first devise task-specific operations such as Synonym Substitute, then preset the …...
Topic-Aware Evidence Reasoning and Stance-Aware Aggregation for Fact Verification
AbstractFact verification is a challenging task that requires simultaneously reasoning and aggregating over multiple retrieved pieces of evidence to evaluate the truthfulness of a claim. Existing approaches typically (i) explore …...
Towards Question-Answering as an Automatic Metric for Evaluating the Content Quality of a Summary
AbstractA desirable property of a reference-based evaluation metric that measures the content quality of a summary is that it should estimate how much information that summary has in common with …...
UniRE: A Unified Label Space for Entity Relation Extraction
AbstractMany joint entity relation extraction models setup two separated label spaces for the two sub-tasks (i.e., entity detection and relation classification). We argue that this setting may hinder the information …...
What Will it Take to Fix Benchmarking in Natural Language Understanding?
AbstractEvaluation for many natural language understanding (NLU) tasks is broken: Unreliable and biased systems score so highly on standard benchmarks that there is little room for researchers who develop better …...
Why Machine Reading Comprehension Models Learn Shortcuts?
Recent studies report that many machine read- ing comprehension (MRC) models can per- form closely to or even better than humans on benchmark datasets. However, existing works indicate that many …...
X-Class: Text Classification with Extremely Weak Supervision
AbstractIn this paper, we explore text classification with extremely weak supervision, i.e., only relying on the surface text of class names. This is a more challenging setting than the seed-driven …...
“It’s Not Just Hate”: A Multi-Dimensional Perspective on Detecting Harmful Speech Online
AbstractWell-annotated data is a prerequisite for good Natural Language Processing models. Too often, though, annotation decisions are governed by optimizing time or annotator agreement. We make a case for nuanced …...
A Multi-Format Transfer Learning Model for Event Argument Extraction via Variational Information Bottleneck
AbstractEvent argument extraction (EAE) aims to extract arguments with given roles from texts, which have been widely studied in natural language processing. Most previous works have achieved good performance in …...
A Novel Multi-Task Learning Approach for Context-Sensitive Compound Type Identification in Sanskrit
AbstractThe phenomenon of compounding is ubiquitous in Sanskrit. It serves for achieving brevity in expressing thoughts, while simultaneously enriching the lexical and structural formation of the language. In this work, …...
A Robustly Optimized BMRC for Aspect Sentiment Triplet Extraction
AbstractAspect sentiment triplet extraction (ASTE) is a challenging subtask in aspect-based sentiment analysis. It aims to explore the triplets of aspects, opinions and sentiments with complex correspondence from the context. …...
A Span-based Multimodal Variational Autoencoder for Semi-supervised Multimodal Named Entity Recognition
AbstractMultimodal named entity recognition (MNER) on social media is a challenging task which aims to extract named entities in free text and incorporate images to classify them into user-defined types. …...
A Unified Neural Network Model for Readability Assessment with Feature Projection and Length-Balanced Loss
AbstractReadability assessment is a basic research task in the field of education. Traditional methods mainly employ machine learning classifiers with hundreds of linguistic features. Although the deep learning model has …...
Adaptive Contrastive Learning on Multimodal Transformer for Review Helpfulness Prediction
AbstractModern Review Helpfulness Prediction systems are dependent upon multiple modalities, typically texts and images. Unfortunately, those contemporary approaches pay scarce attention to polish representations of cross-modal relations and tend to …...
Analyzing Modality Robustness in Multimodal Sentiment Analysis
AbstractBuilding robust multimodal models are crucial for achieving reliable deployment in the wild. Despite its importance, less attention has been paid to identifying and improving the robustness of Multimodal Sentiment …...
BiBL: AMR Parsing and Generation with Bidirectional Bayesian Learning
AbstractAbstract Meaning Representation (AMR) offers a unified semantic representation for natural language sentences. Thus transformation between AMR and text yields two transition tasks in opposite directions, i.e., Text-to-AMR parsing and …...
CIAug: Equipping Interpolative Augmentation with Curriculum Learning
AbstractInterpolative data augmentation has proven to be effective for NLP tasks. Despite its merits, the sample selection process in mixup is random, which might make it difficult for the model …...
Coarse-to-Fine: Hierarchical Multi-task Learning for Natural Language Understanding
AbstractGeneralized text representations are the foundation of many natural language understanding tasks. To fully utilize the different corpus, it is inevitable that models need to understand the relevance among them. …...
CoDoNMT: Modeling Cohesion Devices for Document-Level Neural Machine Translation
AbstractCohesion devices, e.g., reiteration, coreference, are crucial for building cohesion links across sentences. In this paper, we propose a document-level neural machine translation framework, CoDoNMT, which models cohesion devices from …...
COM-MRC: A COntext-Masked Machine Reading Comprehension Framework for Aspect Sentiment Triplet Extraction
AbstractAspect Sentiment Triplet Extraction (ASTE) aims to extract sentiment triplets from sentences, which was recently formalized as an effective machine reading comprehension (MRC) based framework. However, when facing multiple aspect …...
Commonsense and Named Entity Aware Knowledge Grounded Dialogue Generation
AbstractGrounding dialogue on external knowledge and interpreting linguistic patterns in dialogue history context, such as ellipsis, anaphora, and co-reference is critical for dialogue comprehension and generation. In this paper, we …...
Comparing Annotated Datasets for Named Entity Recognition in English Literature
AbstractThe growing interest in named entity recognition (NER) in various domains has led to the creation of different benchmark datasets, often with slightly different annotation guidelines. To better understand the …...
Distantly Supervised Named Entity Recognition via Confidence-Based Multi-Class Positive and Unlabeled Learning
AbstractIn this paper, we study the named entity recognition (NER) problem under distant supervision. Due to the incompleteness of the external dictionaries and/or knowledge bases, such distantly annotated training data …...
Distilling Causal Effect from Miscellaneous Other-Class for Continual Named Entity Recognition
AbstractContinual Learning for Named Entity Recognition (CL-NER) aims to learn a growing number of entity types over time from a stream of data. However, simply learning Other-Class in the same …...
Does it Really Generalize Well on Unseen Data? Systematic Evaluation of Relational Triple Extraction Methods
AbstractThe ability to extract entities and their relations from unstructured text is essential for the automated maintenance of large-scale knowledge graphs. To keep a knowledge graph up-to-date, an extractor needs …...
DoubleMix: Simple Interpolation-Based Data Augmentation for Text Classification
AbstractThis paper proposes a simple yet effective interpolation-based data augmentation approach termed DoubleMix, to improve the robustness of models in text classification. DoubleMix first leverages a couple of simple augmentation …...
DRLK: Dynamic Hierarchical Reasoning with Language Model and Knowledge Graph for Question Answering
AbstractIn recent years, Graph Neural Network (GNN) approaches with enhanced knowledge graphs (KG) perform well in question answering (QA) tasks. One critical challenge is how to effectively utilize interactions between …...
E-VarM: Enhanced Variational Word Masks to Improve the Interpretability of Text Classification Models
AbstractEnhancing the interpretability of text classification models can help increase the reliability of these models in real-world applications. Currently, most researchers focus on extracting task-specific words from inputs to improve …...
Effective Token Graph Modeling using a Novel Labeling Strategy for Structured Sentiment Analysis
AbstractThe state-of-the-art model for structured sentiment analysis casts the task as a dependency parsing problem, which has some limitations: (1) The label proportions for span prediction and span relation prediction …...
EmoCaps: Emotion Capsule based Model for Conversational Emotion Recognition
AbstractEmotion recognition in conversation (ERC) aims to analyze the speaker’s state and identify their emotion in the conversation. Recent works in ERC focus on context modeling but ignore the representation …...
Empowering Dual-Encoder with Query Generator for Cross-Lingual Dense Retrieval
AbstractIn monolingual dense retrieval, lots of works focus on how to distill knowledge from cross-encoder re-ranker to dual-encoder retriever and these methods achieve better performance due to the effectiveness of …...
Enhanced Multi-Channel Graph Convolutional Network for Aspect Sentiment Triplet Extraction
AbstractAspect Sentiment Triplet Extraction (ASTE) is an emerging sentiment analysis task. Most of the existing studies focus on devising a new tagging scheme that enables the model to extract the …...
Entailment Graph Learning with Textual Entailment and Soft Transitivity
AbstractTyped entailment graphs try to learn the entailment relations between predicates from text and model them as edges between predicate nodes. The construction of entailment graphs usually suffers from severe …...
Event Causality Identification via Derivative Prompt Joint Learning
AbstractThis paper studies event causality identification, which aims at predicting the causality relation for a pair of events in a sentence. Regarding event causality identification as a supervised classification task, …...
Event Causality Identification via Generation of Important Context Words
AbstractAn important problem of Information Extraction involves Event Causality Identification (ECI) that seeks to identify causal relation between pairs of event mentions. Prior models for ECI have mainly solved the …...
Exploiting Unlabeled Data for Target-Oriented Opinion Words Extraction
AbstractTarget-oriented Opinion Words Extraction (TOWE) is a fine-grained sentiment analysis task that aims to extract the corresponding opinion words of a given opinion target from the sentence. Recently, deep learning …...
Exploring Label Hierarchy in a Generative Way for Hierarchical Text Classification
AbstractHierarchical Text Classification (HTC), which aims to predict text labels organized in hierarchical space, is a significant task lacking in investigation in natural language processing. Existing methods usually encode the …...
Extract-Select: A Span Selection Framework for Nested Named Entity Recognition with Generative Adversarial Training
AbstractNested named entity recognition (NER) is a task in which named entities may overlap with each other. Span-based approaches regard nested NER as a two-stage span enumeration and classification task, …...
FairLex: A Multilingual Benchmark for Evaluating Fairness in Legal Text Processing
AbstractWe present a benchmark suite of four datasets for evaluating the fairness of pre-trained language models and the techniques used to fine-tune them for downstream tasks. Our benchmarks cover four …...
Flat Multi-modal Interaction Transformer for Named Entity Recognition
AbstractMulti-modal named entity recognition (MNER) aims at identifying entity spans and recognizing their categories in social media posts with the aid of images. However, in dominant MNER approaches, the interaction …...
FlowEval: A Consensus-Based Dialogue Evaluation Framework Using Segment Act Flows
AbstractDespite recent progress in open-domain dialogue evaluation, how to develop automatic metrics remains an open problem. We explore the potential of dialogue evaluation featuring dialog act information, which was hardly …...
Generative Data Augmentation with Contrastive Learning for Zero-Shot Stance Detection
AbstractStance detection aims to identify whether the author of an opinionated text is in favor of, against, or neutral towards a given target. Remarkable success has been achieved when sufficient …...
Hero-Gang Neural Model For Named Entity Recognition
AbstractNamed entity recognition (NER) is a fundamental and important task in NLP, aiming at identifying named entities (NEs) from free text. Recently, since the multi-head attention mechanism applied in the …...
Hyperbolic Relevance Matching for Neural Keyphrase Extraction
AbstractKeyphrase extraction is a fundamental task in natural language processing that aims to extract a set of phrases with important information from a source document. Identifying important keyphrases is the …...
Improving Large-scale Language Models and Resources for Filipino
AbstractIn this paper, we improve on existing language resources for the low-resource Filipino language in two ways. First, we outline the construction of the TLUnified dataset, a large-scale pretraining corpus …...
Improving Temporal Generalization of Pre-trained Language Models with Lexical Semantic Change
AbstractRecent research has revealed that neural language models at scale suffer from poor temporal generalization capability, i.e., language model pre-trained on static data from past years performs worse over time …...
Incorporating Dynamic Semantics into Pre-Trained Language Model for Aspect-based Sentiment Analysis
AbstractAspect-based sentiment analysis (ABSA) predicts sentiment polarity towards a specific aspect in the given sentence. While pre-trained language models such as BERT have achieved great success, incorporating dynamic semantic changes …...
JointCL: A Joint Contrastive Learning Framework for Zero-Shot Stance Detection
AbstractZero-shot stance detection (ZSSD) aims to detect the stance for an unseen target during the inference stage. In this paper, we propose a joint contrastive learning (JointCL) framework, which consists …...
KCD: Knowledge Walks and Textual Cues Enhanced Political Perspective Detection in News Media
AbstractPolitical perspective detection has become an increasingly important task that can help combat echo chambers and political polarization. Previous approaches generally focus on leveraging textual content to identify stances, while …...
LEA: Meta Knowledge-Driven Self-Attentive Document Embedding for Few-Shot Text Classification
AbstractText classification has achieved great success with the prosperity of deep learning and pre-trained language models. However, we often encounter labeled data deficiency problems in real-world text-classification tasks. To overcome …...
Learnable Dependency-based Double Graph Structure for Aspect-based Sentiment Analysis
AbstractDependency tree-based methods might be susceptible to the dependency tree due to that they inevitably introduce noisy information and neglect the rich relation information between words. In this paper, we …...
Learning Reasoning Patterns for Relational Triple Extraction with Mutual Generation of Text and Graph
AbstractRelational triple extraction is a critical task for constructing knowledge graphs. Existing methods focused on learning text patterns from explicit relational mentions. However, they usually suffered from ignoring relational reasoning …...
Learning to Reason Deductively: Math Word Problem Solving as Complex Relation Extraction
AbstractSolving math word problems requires deductive reasoning over the quantities in the text. Various recent research efforts mostly relied on sequence-to-sequence or sequence-to-tree models to generate mathematical expressions without explicitly …...
MetaSLRCL: A Self-Adaptive Learning Rate and Curriculum Learning Based Framework for Few-Shot Text Classification
AbstractDue to the lack of labeled data in many realistic scenarios, a number of few-shot learning methods for text classification have been proposed, among which the meta learning based ones …...
Mitigating Dataset Artifacts in Natural Language Inference Through Automatic Contextual Data Augmentation and Learning Optimization
AbstractIn recent years, natural language inference has been an emerging research area. In this paper, we present a novel data augmentation technique and combine it with a unique learning procedure …...
Modeling Intra- and Inter-Modal Relations: Hierarchical Graph Contrastive Learning for Multimodal Sentiment Analysis
AbstractThe existing research efforts in Multimodal Sentiment Analysis (MSA) have focused on developing the expressive ability of neural networks to fuse information from different modalities. However, these approaches lack a …...
On the Impact of Temporal Representations on Metaphor Detection
AbstractState-of-the-art approaches for metaphor detection compare their literal - or core - meaning and their contextual meaning using metaphor classifiers based on neural networks. However, metaphorical expressions evolve over time …...
Open World Classification with Adaptive Negative Samples
AbstractOpen world classification is a task in natural language processing with key practical relevance and impact. Since the open or unknown category data only manifests in the inference phase, finding …...
Practice Makes a Solver Perfect: Data Augmentation for Math Word Problem Solvers
AbstractExisting Math Word Problem (MWP) solvers have achieved high accuracy on benchmark datasets. However, prior works have shown that such solvers do not generalize well and rely on superficial cues …...
Reducing Spurious Correlations for Answer Selection by Feature Decorrelation and Language Debiasing
AbstractDeep neural models have become the mainstream in answer selection, yielding state-of-the-art performance. However, these models tend to rely on spurious correlations between prediction labels and input features, which in …...
SEE-Few: Seed, Expand and Entail for Few-shot Named Entity Recognition
AbstractFew-shot named entity recognition (NER) aims at identifying named entities based on only few labeled instances. Current few-shot NER methods focus on leveraging existing datasets in the rich-resource domains which …...
Sentence-aware Adversarial Meta-Learning for Few-Shot Text Classification
AbstractMeta-learning has emerged as an effective approach for few-shot text classification. However, current studies fail to realize the importance of the semantic interaction between sentence features and neglect to enhance …...
Sentence-aware Contrastive Learning for Open-Domain Passage Retrieval
AbstractTraining dense passage representations via contrastive learning has been shown effective for Open-Domain Passage Retrieval (ODPR). Existing studies focus on further optimizing by improving negative sampling strategy or extra pretraining. …...
Sentence-level Media Bias Analysis Informed by Discourse Structures
AbstractAs polarization continues to rise among both the public and the news media, increasing attention has been devoted to detecting media bias. Most recent work in the NLP community, however, …...
So Different Yet So Alike! Constrained Unsupervised Text Style Transfer
AbstractAutomatic transfer of text between domains has become popular in recent times. One of its aims is to preserve the semantic content while adapting to the target domain. However, it …...
Speaker-Aware Discourse Parsing on Multi-Party Dialogues
AbstractDiscourse parsing on multi-party dialogues is an important but difficult task in dialogue systems and conversational analysis. It is believed that speaker interactions are helpful for this task. However, most …...
SSEGCN: Syntactic and Semantic Enhanced Graph Convolutional Network for Aspect-based Sentiment Analysis
AbstractAspect-based Sentiment Analysis (ABSA) aims to predict the sentiment polarity towards a particular aspect in a sentence. Recently, graph neural networks based on dependency tree convey rich structural information which …...
Student Surpasses Teacher: Imitation Attack for Black-Box NLP APIs
AbstractMachine-learning-as-a-service (MLaaS) has attracted millions of users to their splendid large-scale models. Although published as black-box APIs, the valuable models behind these services are still vulnerable to imitation attacks. Recently, …...
SUN: Exploring Intrinsic Uncertainties in Text-to-SQL Parsers
AbstractThis paper aims to improve the performance of text-to-SQL parsing by exploring the intrinsic uncertainties in the neural network based approaches (called SUN). From the data uncertainty perspective, it is …...
Target Really Matters: Target-aware Contrastive Learning and Consistency Regularization for Few-shot Stance Detection
AbstractStance detection aims to identify the attitude from an opinion towards a certain target. Despite the significant progress on this task, it is extremely time-consuming and budget-unfriendly to collect sufficient …...
TCG-Event: Effective Task Conditioning for Generation-based Event Extraction
Event extraction is an important but challenging task. Many existing techniques decompose it into subtasks of event and argument de- tection/classification, which are themselves complex structured prediction problems. Generation-based extraction …...
Towards Few-shot Entity Recognition in Document Images: A Label-aware Sequence-to-Sequence Framework
AbstractEntity recognition is a fundamental task in understanding document images. Traditional sequence labeling frameworks treat the entity types as class IDs and rely on extensive data and high-quality annotations to …...
Towards Robust k-Nearest-Neighbor Machine Translation
Abstractk-Nearest-Neighbor Machine Translation (kNN-MT) becomes an important research direction of NMT in recent years. Its main idea is to retrieve useful key-value pairs from an additional datastore to modify translations …...
TRIPS: Efficient Vision-and-Language Pre-training with Text-Relevant Image Patch Selection
AbstractVision Transformers (ViTs) have been widely used in large-scale Vision and Language Pre-training (VLP) models. Though previous VLP works have proved the effectiveness of ViTs, they still suffer from computational …...
Two Languages Are Better than One: Bilingual Enhancement for Chinese Named Entity Recognition
AbstractChinese Named Entity Recognition (NER) has continued to attract research attention. However, most existing studies only explore the internal features of the Chinese language but neglect other lingual modal features. …...
UniNL: Aligning Representation Learning with Scoring Function for OOD Detection via Unified Neighborhood Learning
AbstractDetecting out-of-domain (OOD) intents from user queries is essential for avoiding wrong operations in task-oriented dialogue systems. The key challenge is how to distinguish in-domain (IND) and OOD intents. Previous …...
Unsupervised Data Augmentation for Aspect Based Sentiment Analysis
AbstractRecent approaches to Aspect-based Sentiment Analysis (ABSA) take a co-extraction approach to this span-level classification task, performing the subtasks of aspect term extraction (ATE) and aspect sentiment classification (ASC) simultaneously. …...
Watch the Neighbors: A Unified K-Nearest Neighbor Contrastive Learning Framework for OOD Intent Discovery
AbstractDiscovering out-of-domain (OOD) intent is important for developing new skills in task-oriented dialogue systems. The key challenges lie in how to transfer prior in-domain (IND) knowledge to OOD clustering, as …...
Decoupling Pseudo Label Disambiguation and Representation Learning for Generalized Intent Discovery
AbstractGeneralized intent discovery aims to extend a closed-set in-domain intent classifier to an open-world intent set including in-domain and out-of-domain intents. The key challenges lie in pseudo label disambiguation and …...
Document Flattening: Beyond Concatenating Context for Document-Level Neural Machine Translation
AbstractExisting work in document-level neural machine translation commonly concatenates several consecutive sentences as a pseudo-document, and then learns inter-sentential dependencies. This strategy limits the model’s ability to leverage information from …...
Easy Guided Decoding in Providing Suggestions for Interactive Machine Translation
AbstractMachine translation technology has made great progress in recent years, but it cannot guarantee error-free results. Human translators perform post-editing on machine translations to correct errors in the scene of …...
From the One, Judge of the Whole: Typed Entailment Graph Construction with Predicate Generation
AbstractEntailment Graphs (EGs) have been constructed based on extracted corpora as a strong and explainable form to indicate context-independent entailment relation in natural languages. However, EGs built by previous methods …...
Generative Knowledge Selection for Knowledge-Grounded Dialogues
AbstractKnowledge selection is the key in knowledge-grounded dialogues (KGD), which aims to select an appropriate knowledge snippet to be used in the utterance based on dialogue history. Previous studies mainly …...
ICA-Proto: Iterative Cross Alignment Prototypical Network for Incremental Few-Shot Relation Classification
AbstractIn the task of incremental few-shot relation classification, model performance is always limited by the incompatibility between the base feature embedding space and the novel feature embedding space. To tackle …...
Ideology Prediction from Scarce and Biased Supervision: Learn to Disregard the “What” and Focus on the “How”!
AbstractWe propose a novel supervised learning approach for political ideology prediction (PIP) that is capable of predicting out-of-distribution inputs. This problem is motivated by the fact that manual data-labeling is …...
Improving Embedding Transfer for Low-Resource Machine Translation
AbstractLow-resource machine translation (LRMT) poses a substantial challenge due to the scarcity of parallel training data. This paper introduces a new method to improve the transfer of the embedding layer …...
Improving Numeracy by Input Reframing and Quantitative Pre-Finetuning Task
AbstractNumbers have unique characteristics to words. Teaching models to understand numbers in text is an open-ended research question. Instead of discussing the required calculation skills, this paper focuses on a …...
Incorporating Question Answering-Based Signals into Abstractive Summarization via Salient Span Selection
AbstractIn this work, we propose a method for incorporating question-answering (QA) signals into a summarization model. Our method identifies salient noun phrases (NPs) in the input document by automatically generating …...
INK: Injecting kNN Knowledge in Nearest Neighbor Machine Translation
AbstractNeural machine translation has achieved promising results on many translation tasks. However, previous studies have shown that neural models induce a non-smooth representation space, which harms its generalization results. Recently, …...
It’s about Time: Rethinking Evaluation on Rumor Detection Benchmarks using Chronological Splits
AbstractNew events emerge over time influencing the topics of rumors in social media. Current rumor detection benchmarks use random splits as training, development and test sets which typically results in …...
Jointprop: Joint Semi-supervised Learning for Entity and Relation Extraction with Heterogeneous Graph-based Propagation
AbstractSemi-supervised learning has been an important approach to address challenges in extracting entities and relations from limited data. However, current semi-supervised works handle the two tasks (i.e., Named Entity Recognition …...
KGLM: Integrating Knowledge Graph Structure in Language Models for Link Prediction
AbstractThe ability of knowledge graphs to represent complex relationships at scale has led to their adoption for various needs including knowledge representation, question-answering, and recommendation systems. Knowledge graphs are often …...
Label-Aware Hyperbolic Embeddings for Fine-grained Emotion Classification
AbstractFine-grained emotion classification (FEC) is a challenging task. Specifically, FEC needs to handle subtle nuance between labels, which can be complex and confusing. Most existing models only address text classification …...
Multi-Grained Knowledge Retrieval for End-to-End Task-Oriented Dialog
AbstractRetrieving proper domain knowledge from an external database lies at the heart of end-to-end task-oriented dialog systems to generate informative responses. Most existing systems blend knowledge retrieval with response generation …...
P-MNER: Cross Modal Correction Fusion Network with Prompt Learning for Multimodal Named Entity Recognitiong
Abstract“Multimodal Named Entity Recognition (MNER) is a challenging task in social mediadue to the combination of text and image features. Previous MNER work has focused onpredicting entity information after fusing …...
Semi-supervised Relation Extraction via Data Augmentation and Consistency-training
AbstractDue to the semantic complexity of the Relation extraction (RE) task, obtaining high-quality human labelled data is an expensive and noisy process. To improve the sample efficiency of the models, …...
Tackling Modality Heterogeneity with Multi-View Calibration Network for Multimodal Sentiment Detection
AbstractWith the popularity of social media, detecting sentiment from multimodal posts (e.g. image-text pairs) has attracted substantial attention recently. Existing works mainly focus on fusing different features but ignore the …...
TAM of SCNU at SemEval-2023 Task 1: FCLL: A Fine-grained Contrastive Language-Image Learning Model for Cross-language Visual Word Sense Disambiguation
AbstractVisual Word Sense Disambiguation (WSD), as a fine-grained image-text retrieval task, aims to identify the images that are relevant to ambiguous target words or phrases. However, the difficulties of limited …...
TART: Improved Few-shot Text Classification Using Task-Adaptive Reference Transformation
AbstractMeta-learning has emerged as a trending technique to tackle few-shot text classification and achieve state-of-the-art performance. However, the performance of existing approaches heavily depends on the inter-class variance of the …...
Topic-Guided Sampling For Data-Efficient Multi-Domain Stance Detection
AbstractThe task of Stance Detection is concerned with identifying the attitudes expressed by an author towards a target of interest. This task spans a variety of domains ranging from social …...
UniEX: An Effective and Efficient Framework for Unified Information Extraction via a Span-extractive Perspective
AbstractWe propose a new paradigm for universal information extraction (IE) that is compatible with any schema format and applicable to a list of IE tasks, such as named entity recognition, …...
Unsupervised Open-domain Keyphrase Generation
AbstractIn this work, we study the problem of unsupervised open-domain keyphrase generation, where the objective is a keyphrase generation model that can be built without using human-labeled data and can …...
White-Box Multi-Objective Adversarial Attack on Dialogue Generation
AbstractPre-trained transformers are popular in state-of-the-art dialogue generation (DG) systems. Such language models are, however, vulnerable to various adversarial samples as studied in traditional tasks such as text classification, which …...