Datasets
Related Papers
Chinese Segmentation and New Word Detection using Conditional Random Fields
Chinese word segmentation is a difficult, im- portant and widely-studied sequence modeling problem. This paper demonstrates the abil- ity of linear-chain conditional random fields (CRFs) to perform robust and accurate …...
Bootstrapping Path-Based Pronoun Resolution
We present an approach to pronoun reso- lution based on syntactic paths. Through a simple bootstrapping procedure, we learn the likelihood of coreference between a pronoun and a candidate noun …...
Language Model Information Retrieval with Document Expansion
Language model information retrieval de- pends on accurate estimation of document models. In this paper, we propose a docu- ment expansion technique to deal with the problem of insufficient sampling …...
A Study of Information Retrieval Weighting Schemes for Sentiment Analysis
Most sentiment analysis approaches use as baseline a support vector machines (SVM) classifier with binary unigram weights. In this paper, we explore whether more sophisticated feature weighting schemes from Information …...
Automatic Keyphrase Extraction via Topic Decomposition
Existing graph-based ranking methods for keyphrase extraction compute a single impor- tance score for each word via a single ran- dom walk. Motivated by the fact that both documents and …...
Evaluating Multilingual Question Answering Systems at CLEF
AbstractThe paper offers an overview of the key issues raised during the seven years activity of the Multilingual Question Answering Track at the Cross Language Evaluation Forum (CLEF). The general …...
Letter-Phoneme Alignment: An Exploration
Letter-phoneme alignment is usually gen- erated by a straightforward application of the EM algorithm. We explore several al- ternative alignment methods that employ phonetics, integer programming, and sets of constraints, …...
SemEval-2010 Task 18: Disambiguating Sentiment Ambiguous Adjectives
Sentiment ambiguous adjectives cause major difficulties for existing algorithms of sentiment analysis. We present an evaluation task designed to provide a framework for comparing different approaches in this problem. We …...
The Effect of Ambiguity on the Automated Acquisition of WSD Examples
Several methods for automatically gen- erating labeled examples that can be used as training data for WSD systems have been proposed, including a semi- supervised approach based on relevance feedback …...
*SEM 2012 Shared Task: Resolving the Scope and Focus of Negation
The Joint Conference on Lexical and Compu- tational Semantics (*SEM) each year hosts a shared task on semantic related topics. In its first edition held in 2012, the shared task …...
Large-Margin Learning of Submodular Summarization Models
In this paper, we present a supervised learning approach to training submodu- lar scoring functions for extractive multi- document summarization. By taking a structured prediction approach, we pro- vide a …...
Semeval-2012 Task 8: Cross-lingual Textual Entailment for Content Synchronization
This paper presents the first round of the task on Cross-lingual Textual Entailment for Content Synchronization, organized within SemEval-2012. The task was designed to pro- mote research on semantic inference …...
SPEDE: Probabilistic Edit Distance Metrics for MT Evaluation
This paper describes Stanford University’s sub- mission to the Shared Evaluation Task of WMT 2012. Our proposed metric (SPEDE) com- putes probabilistic edit distance as predictions of translation quality. We …...
Combining Intra- and Multi-sentential Rhetorical Parsing for Document-level Discourse Analysis
We propose a novel approach for develop- ing a two-stage document-level discourse parser. Our parser builds a discourse tree by applying an optimal parsing algorithm to probabilities inferred from two …...
Detection of Product Comparisons - How Far Does an Out-of-the-Box Semantic Role Labeling System Take You?
This short paper presents a pilot study in- vestigating the training of a standard Seman- tic Role Labeling (SRL) system on product reviews for the new task of detecting com- …...
Training Deterministic Parsers with Non-Deterministic Oracles
AbstractGreedy transition-based parsers are very fast but tend to suffer from error propagation. This problem is aggravated by the fact that they are normally trained using oracles that are deterministic …...
A Large Scale Evaluation of Distributional Semantic Models: Parameters, Interactions and Model Selection
AbstractThis paper presents the results of a large-scale evaluation study of window-based Distributional Semantic Models on a wide variety of tasks. Our study combines a broad coverage of model parameters …...
Automatic Annotation of Machine Translation Datasets with Binary Quality Judgements
AbstractThe automatic estimation of machine translation (MT) output quality is an active research area due to its many potential applications (e.g. aiding human translation and post-editing, re-ranking MT hypotheses, MT …...
Entity Linking meets Word Sense Disambiguation: a Unified Approach
AbstractEntity Linking (EL) and Word Sense Disambiguation (WSD) both address the lexical ambiguity of language. But while the two tasks are pretty similar, they differ in a fundamental respect: in …...
Fourteen Light Tasks for comparing Analogical and Phrase-based Machine Translation
In this study we compare two machine translation devices on twelve machine translation medical- domain specific tasks, and two transliteration tasks, altogether involving twelve language pairs, including English-Chinese and English-Russian, …...
High Performance Word Sense Alignment by Joint Modeling of Sense Distance and Gloss Similarity
In this paper, we present a machine learning approach for word sense alignment (WSA) which combines distances between senses in the graph representations of lexical-semantic resources with gloss similarities. In …...
Robust Entity Clustering via Phylogenetic Inference
Entity clustering must determine when two named-entity mentions refer to the same entity. Typical approaches use a pipeline ar- chitecture that clusters the mentions using fixed or learned measures of …...
An empirical study of segment prioritization for incrementally retrained post-editing-based SMT
Post-editing the output of a statistical machine translation (SMT) system to obtain high-quality translation has become an increasingly common application of SMT, which henceforth we re- fer to as post-editing-based …...
Joint Generation of Transliterations from Multiple Representations
Machine transliteration is often referred to as phonetic translation. We show that transliterations incorporate information from both spelling and pronunciation, and pro- pose an effective model for joint transliter- ation …...
Name List Only? Target Entity Disambiguation in Short Texts
Target entity disambiguation (TED), the task of identifying target entities of the same domain, has been recognized as a critical step in various important applica- tions. In this paper, we …...
SGRank: Combining Statistical and Graphical Methods to Improve the State of the Art in Unsupervised Keyphrase Extraction
Keyphrase extraction is a fundamental technique in natural language processing. It enables documents to be mapped to a concise set of phrases that can be used for indexing, clustering, ontology …...
TSDPMM: Incorporating Prior Topic Knowledge into Dirichlet Process Mixture Models for Text Clustering
Dirichlet process mixture model (DPM- M) has great potential for detecting the underlying structure of data. Extensive studies have applied it for text cluster- ing in terms of topics. However, …...
UDLAP: Sentiment Analysis Using a Graph-Based Representation
We present an approach for tackling the Sen- timent Analysis problem in SemEval 2015. The approach is based on the use of a co- occurrence graph to represent existing rela- …...
Weakly Supervised Definition Extraction
Definition Extraction (DE) is the task to ex- tract textual definitions from naturally occur- ring text. It is gaining popularity as a prior step for constructing taxonomies, ontologies, auto- matic …...
Cached Long Short-Term Memory Neural Networks for Document-Level Sentiment Classification
Recently, neural networks have achieved great success on sentiment classification due to their ability to alleviate feature engineering. How- ever, one of the remaining challenges is to model long texts …...
Encoding Prior Knowledge with Eigenword Embeddings
AbstractCanonical correlation analysis (CCA) is a method for reducing the dimension of data represented using two views. It has been previously used to derive word embeddings, where one view indicates …...
Language to Logical Form with Neural Attention
Semantic parsing aims at mapping nat- ural language to machine interpretable meaning representations. Traditional ap- proaches rely on high-quality lexicons, manually-built templates, and linguis- tic features which are either domain- …...
Leveraging Cognitive Features for Sentiment Analysis
Sentiments expressed in user-generated short text and sentences are nuanced by subtleties at lexical, syntactic, semantic and pragmatic levels. To address this, we propose to augment traditional features used for …...
Relations such as Hypernymy: Identifying and Exploiting Hearst Patterns in Distributional Vectors for Lexical Entailment
We consider the task of predicting lexical entailment using distributional vectors. We perform a novel qualitative analysis of one existing model which was previously shown to only measure the prototypicality …...
Set-Theoretic Alignment for Comparable Corpora
We describe and evaluate a simple method to extract parallel sentences from com- parable corpora. The approach, termed STACC, is based on expanded lexical sets and the Jaccard similarity coefficient. …...
Siamese CBOW: Optimizing Word Embeddings for Sentence Representations
We present the Siamese Continuous Bag of Words (Siamese CBOW) model, a neural network for efficient estimation of high- quality sentence embeddings. Averaging the embeddings of words in a sentence …...
The dialogue breakdown detection challenge: Task description, datasets, and evaluation metrics
AbstractDialogue breakdown detection is a promising technique in dialogue systems. To promote the research and development of such a technique, we organized a dialogue breakdown detection challenge where the task …...
Word Embeddings and Convolutional Neural Network for Arabic Sentiment Classification
AbstractWith the development and the advancement of social networks, forums, blogs and online sales, a growing number of Arabs are expressing their opinions on the web. In this paper, a …...
Anchored Correlation Explanation: Topic Modeling with Minimal Domain Knowledge
AbstractWhile generative models such as Latent Dirichlet Allocation (LDA) have proven fruitful in topic modeling, they often require detailed assumptions and careful specification of hyperparameters. Such model complexity issues only …...
Automatic Threshold Detection for Data Selection in Machine Translation
We present in this paper the participation of the University of Hamburg in the Biomedical Translation Task of the Sec- ond Conference on Machine Translation (WMT 2017). Our contribution lies …...
Getting the Most out of AMR Parsing
AbstractThis paper proposes to tackle the AMR parsing bottleneck by improving two components of an AMR parser: concept identification and alignment. We first build a Bidirectional LSTM based concept identifier …...
LanideNN: Multilingual Language Identification on Character Window
AbstractIn language identification, a common first step in natural language processing, we want to automatically determine the language of some input text. Monolingual language identification assumes that the given document …...
Neural Belief Tracker: Data-Driven Dialogue State Tracking
AbstractOne of the core components of modern spoken dialogue systems is the belief tracker, which estimates the user’s goal at every step of the dialogue. However, most current approaches have …...
Neural Discontinuous Constituency Parsing
AbstractOne of the most pressing issues in discontinuous constituency transition-based parsing is that the relevant information for parsing decisions could be located in any part of the stack or the …...
PositionRank: An Unsupervised Approach to Keyphrase Extraction from Scholarly Documents
AbstractThe large and growing amounts of online scholarly data present both challenges and opportunities to enhance knowledge discovery. One such challenge is to automatically extract a small set of keyphrases …...
Sentence Simplification with Deep Reinforcement Learning
AbstractSentence simplification aims to make sentences easier to read and understand. Most recent approaches draw on insights from machine translation to learn simplification rewrites from monolingual corpora of complex and …...
Shortest-Path Graph Kernels for Document Similarity
AbstractIn this paper, we present a novel document similarity measure based on the definition of a graph kernel between pairs of documents. The proposed measure takes into account both the …...
Task-Oriented Query Reformulation with Reinforcement Learning
AbstractSearch engines play an important role in our everyday lives by assisting us in finding the information we need. When we input a complex query, however, results are often far …...
What is the Essence of a Claim? Cross-Domain Claim Identification
AbstractArgument mining has become a popular research area in NLP. It typically includes the identification of argumentative components, e.g. claims, as the central component of an argument. We perform a …...
Bringing replication and reproduction together with generalisability in NLP: Three reproduction studies for Target Dependent Sentiment Analysis
AbstractLack of repeatability and generalisability are two significant threats to continuing scientific development in Natural Language Processing. Language models and learning methods are so complex that scientific conference papers no …...
Dense Information Flow for Neural Machine Translation
AbstractRecently, neural machine translation has achieved remarkable progress by introducing well-designed deep neural networks into its encoder-decoder framework. From the optimization perspective, residual connections are adopted to improve learning performance …...
Modeling Semantics with Gated Graph Neural Networks for Knowledge Base Question Answering
AbstractThe most approaches to Knowledge Base Question Answering are based on semantic parsing. In this paper, we address the problem of learning vector representations for complex semantic parses that consist …...
Neural Collective Entity Linking
AbstractEntity Linking aims to link entity mentions in texts to knowledge bases, and neural models have achieved recent success in this task. However, most existing methods rely on local contexts …...
Refining Source Representations with Relation Networks for Neural Machine Translation
AbstractAlthough neural machine translation with the encoder-decoder framework has achieved great success recently, it still suffers drawbacks of forgetting distant information, which is an inherent disadvantage of recurrent neural network …...
A Deep Neural Information Fusion Architecture for Textual Network Embeddings
AbstractTextual network embeddings aim to learn a low-dimensional representation for every node in the network so that both the structural and textual information from the networks can be well preserved …...
A Large-Scale Comparison of Historical Text Normalization Systems
AbstractThere is no consensus on the state-of-the-art approach to historical text normalization. Many techniques have been proposed, including rule-based methods, distance metrics, character-based statistical machine translation, and neural encoder–decoder models, …...
A Neural Multi-digraph Model for Chinese NER with Gazetteers
AbstractGazetteers were shown to be useful resources for named entity recognition (NER). Many existing approaches to incorporating gazetteers into machine learning based NER systems rely on manually defined selection strategies …...
Automatic Evaluation of Local Topic Quality
AbstractTopic models are typically evaluated with respect to the global topic distributions that they generate, using metrics such as coherence, but without regard to local (token-level) topic assignments. Token-level assignments …...
Categorical Metadata Representation for Customized Text Classification
AbstractThe performance of text classification has improved tremendously using intelligently engineered neural-based models, especially those injecting categorical metadata as additional information, e.g., using user/product information for sentiment classification. This information …...
EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Tasks
AbstractWe present EDA: easy data augmentation techniques for boosting performance on text classification tasks. EDA consists of four simple but powerful operations: synonym replacement, random insertion, random swap, and random …...
Evidence-based Trustworthiness
AbstractThe information revolution brought with it information pollution. Information retrieval and extraction help us cope with abundant information from diverse sources. But some sources are of anonymous authorship, and some …...
ExCL: Extractive Clip Localization Using Natural Language Descriptions
AbstractThe task of retrieving clips within videos based on a given natural language query requires cross-modal reasoning over multiple frames. Prior approaches such as sliding window classifiers are inefficient, while …...
Knowledge-aware Pronoun Coreference Resolution
AbstractResolving pronoun coreference requires knowledge support, especially for particular domains (e.g., medicine). In this paper, we explore how to leverage different types of knowledge to better resolve pronoun coreference with …...
Polly Want a Cracker: Analyzing Performance of Parroting on Paraphrase Generation Datasets
AbstractParaphrase generation is an interesting and challenging NLP task which has numerous practical applications. In this paper, we analyze datasets commonly used for paraphrase generation research, and show that simply …...
Rumor Detection by Exploiting User Credibility Information, Attention and Multi-task Learning
AbstractIn this study, we propose a new multi-task learning approach for rumor detection and stance classification tasks. This neural network model has a shared layer and two task specific layers. …...
Saliency Learning: Teaching the Model Where to Pay Attention
AbstractDeep learning has emerged as a compelling solution to many NLP tasks with remarkable performances. However, due to their opacity, such models are hard to interpret and trust. Recent work …...
Star-Transformer
AbstractAlthough Transformer has achieved great successes on many NLP tasks, its heavy structure with fully-connected attention connections leads to dependencies on large training data. In this paper, we present Star-Transformer, …...
Text Summarization with Pretrained Encoders
AbstractBidirectional Encoder Representations from Transformers (BERT) represents the latest incarnation of pretrained language models which have recently advanced a wide range of natural language processing tasks. In this paper, we …...
Unsupervised Information Extraction: Regularizing Discriminative Approaches with Relation Distribution Losses
AbstractUnsupervised relation extraction aims at extracting relations between entities in text. Previous unsupervised approaches are either generative or discriminative. In a supervised setting, discriminative approaches, such as deep neural network …...
CIRCE at SemEval-2020 Task 1: Ensembling Context-Free and Context-Dependent Word Representations
AbstractThis paper describes the winning contribution to SemEval-2020 Task 1: Unsupervised Lexical Semantic Change Detection (Subtask 2) handed in by team UG Student Intern. We present an ensemble model that …...
Connecting the Dots: A Knowledgeable Path Generator for Commonsense Question Answering
AbstractCommonsense question answering (QA) requires background knowledge which is not explicitly stated in a given context. Prior works use commonsense knowledge graphs (KGs) to obtain this knowledge for reasoning. However, …...
Continual Lifelong Learning in Natural Language Processing: A Survey
AbstractContinual learning (CL) aims to enable information systems to learn from a continuous data stream across time. However, it is difficult for existing deep learning architectures to learn a new …...
Document-level Relation Extraction with Dual-tier Heterogeneous Graph
AbstractDocument-level relation extraction (RE) poses new challenges over its sentence-level counterpart since it requires an adequate comprehension of the whole document and the multi-hop reasoning ability across multiple sentences to …...
Dynamic Classification in Web Archiving Collections
AbstractThe Web archived data usually contains high-quality documents that are very useful for creating specialized collections of documents. To create such collections, there is a substantial need for automatic approaches …...
Evaluation of Off-the-shelf Speech Recognizers Across Diverse Dialogue Domains
AbstractWe evaluate several publicly available off-the-shelf (commercial and research) automatic speech recognition (ASR) systems across diverse dialogue domains (in US-English). Our evaluation is aimed at non-experts with limited experience in …...
ExpanRL: Hierarchical Reinforcement Learning for Course Concept Expansion in MOOCs
AbstractWithin the prosperity of Massive Open Online Courses (MOOCs), the education applications that automatically provide extracurricular knowledge for MOOC users become rising research topics. However, MOOC courses’ diversity and rapid …...
Explainable Automated Fact-Checking: A Survey
AbstractA number of exciting advances have been made in automated fact-checking thanks to increasingly larger datasets and more powerful systems, leading to improvements in the complexity of claims which can …...
Graph Attention Network with Memory Fusion for Aspect-level Sentiment Analysis
AbstractAspect-level sentiment analysis(ASC) predicts each specific aspect term’s sentiment polarity in a given text or review. Recent studies used attention-based methods that can effectively improve the performance of aspect-level sentiment …...
Joint Modelling of Emotion and Abusive Language Detection
AbstractThe rise of online communication platforms has been accompanied by some undesirable effects, such as the proliferation of aggressive and abusive behaviour online. Aiming to tackle this problem, the natural …...
Learning and Evaluating Emotion Lexicons for 91 Languages
AbstractEmotion lexicons describe the affective meaning of words and thus constitute a centerpiece for advanced sentiment and emotion analysis. Yet, manually curated lexicons are only available for a handful of …...
Reconstructing Event Regions for Event Extraction via Graph Attention Networks
AbstractEvent information is usually scattered across multiple sentences within a document. The local sentence-level event extractors often yield many noisy event role filler extractions in the absence of a broader …...
Semantic Label Smoothing for Sequence to Sequence Problems
AbstractLabel smoothing has been shown to be an effective regularization strategy in classification, that prevents overfitting and helps in label de-noising. However, extending such methods directly to seq2seq settings, such …...
SemEval-2020 Task 1: Unsupervised Lexical Semantic Change Detection
AbstractLexical Semantic Change detection, i.e., the task of identifying words that change meaning over time, is a very active research area, with applications in NLP, lexicography, and linguistics. Evaluation is …...
TopicBERT for Energy Efficient Document Classification
AbstractPrior research notes that BERT’s computational cost grows quadratically with sequence length thus leading to longer training times, higher GPU memory constraints and carbon emissions. While recent work seeks to …...
Topological Sort for Sentence Ordering
AbstractSentence ordering is the task of arranging the sentences of a given text in the correct order. Recent work using deep neural networks for this task has framed it as …...
Towards Topic-Guided Conversational Recommender System
AbstractConversational recommender systems (CRS) aim to recommend high-quality items to users through interactive conversations. To develop an effective CRS, the support of high-quality datasets is essential. Existing CRS datasets mainly …...
Transformer Semantic Parsing
AbstractIn neural semantic parsing, sentences are mapped to meaning representations using encoder-decoder frameworks. In this paper, we propose to apply the Transformer architecture, instead of recurrent neural networks, to this …...
TSDG: Content-aware Neural Response Generation with Two-stage Decoding Process
AbstractNeural response generative models have achieved remarkable progress in recent years but tend to yield irrelevant and uninformative responses. One of the reasons is that encoder-decoder based models always use …...
A Mixed-Method Design Approach for Empirically Based Selection of Unbiased Data Annotators
This paper presents a comparison of unsuper- vised methods of hypernymy prediction (i.e., to predict which word in a pair of words such as fish–cod is the hypernym and which …...
A Syntax-Aware Edit-based System for Text Simplification
AbstractEdit-based text simplification systems have attained much attention in recent years due to their ability to produce simplification solutions that are interpretable, as well as requiring less training examples compared …...
Achieving Model Robustness through Discrete Adversarial Training
AbstractDiscrete adversarial attacks are symbolic perturbations to a language input that preserve the output label but lead to a prediction error. While such attacks have been extensively explored for the …...
Active Learning by Acquiring Contrastive Examples
AbstractCommon acquisition functions for active learning use either uncertainty or diversity sampling, aiming to select difficult and diverse data points from the pool of unlabeled data, respectively. In this work, …...
Adversarial Scrubbing of Demographic Information for Text Classification
AbstractContextual representations learned by language models can often encode undesirable attributes, like demographic associations of the users, while being trained for an unrelated target task. We aim to scrub such …...
Are Pretrained Convolutions Better than Pretrained Transformers?
AbstractIn the era of pre-trained language models, Transformers are the de facto choice of model architectures. While recent research has shown promise in entirely convolutional, or CNN, architectures, they have …...
Awakening Latent Grounding from Pretrained Language Models for Semantic Parsing
Recent years pretrained language models (PLMs) hit a success on several downstream tasks, showing their power on modeling lan- guage. To better understand and leverage what PLMs have learned, several …...
Content-based Models of Quotation
AbstractWe explore the task of quotability identification, in which, given a document, we aim to identify which of its passages are the most quotable, i.e. the most likely to be …...
ConvoSumm: Conversation Summarization Benchmark and Improved Abstractive Summarization with Argument Mining
AbstractWhile online conversations can cover a vast amount of information in many different formats, abstractive text summarization has primarily focused on modeling solely news articles. This research gap is due, …...
Data Augmentation for Text Generation Without Any Augmented Data
AbstractData augmentation is an effective way to improve the performance of many neural text generation models. However, current data augmentation methods need to define or choose proper data mapping functions …...
Detecting Bot-Generated Text by Characterizing Linguistic Accommodation in Human-Bot Interactions
Language generation models’ democratiza- tion benefits many domains, from answer- ing health-related questions to enhancing ed- ucation by providing AI-driven tutoring ser- vices. However, language generation mod- els’ democratization also …...
Detecting Domain Polarity-Changes of Words in a Sentiment Lexicon
Sentiment lexicons are instrumental for senti- ment analysis. One can use a set of sentiment words provided in a sentiment lexicon and a lexicon-based classifier to perform sentiment analysis. One …...
DyLex: Incorporating Dynamic Lexicons into BERT for Sequence Labeling
AbstractIncorporating lexical knowledge into deep learning models has been proved to be very effective for sequence labeling tasks. However, previous works commonly have difficulty dealing with large-scale dynamic lexicons which …...
Enjoy the Salience: Towards Better Transformer-based Faithful Explanations with Word Salience
AbstractPretrained transformer-based models such as BERT have demonstrated state-of-the-art predictive performance when adapted into a range of natural language processing tasks. An open problem is how to improve the faithfulness …...
Evaluation Datasets for Cross-lingual Semantic Textual Similarity
AbstractSemantic textual similarity (STS) systems estimate the degree of the meaning similarity between two sentences. Cross-lingual STS systems estimate the degree of the meaning similarity between two sentences, each in …...
Few-Shot Charge Prediction with Multi-Grained Features and MutualInformation
AbstractCharge prediction aims to predict the final charge for a case according to its fact descriptionand plays an important role in legal assistance systems. With deep learning based methods prediction …...
GMH: A General Multi-hop Reasoning Model for KG Completion
AbstractKnowledge graphs are essential for numerous downstream natural language processing applications, but are typically incomplete with many facts missing. This results in research efforts on multi-hop reasoning task, which can …...
Highly Efficient Knowledge Graph Embedding Learning with Orthogonal Procrustes Analysis
AbstractKnowledge Graph Embeddings (KGEs) have been intensively explored in recent years due to their promise for a wide range of applications. However, existing studies focus on improving the final model …...
How well do you know your summarization datasets?
State-of-the-art summarization systems are trained and evaluated on massive datasets scraped from the web. Despite their preva- lence, we know very little about the underly- ing characteristics (data noise, summarization …...
Is Everything in Order? A Simple Way to Order Sentences
AbstractThe task of organizing a shuffled set of sentences into a coherent text has been used to evaluate a machine’s understanding of causal and temporal relations. We formulate the sentence …...
Larger-Context Tagging: When and Why Does It Work?
AbstractThe development of neural networks and pretraining techniques has spawned many sentence-level tagging systems that achieved superior performance on typical benchmarks. However, a relatively less discussed topic is what if …...
Learning Syntactic Dense Embedding with Correlation Graph for Automatic Readability Assessment
AbstractDeep learning models for automatic readability assessment generally discard linguistic features traditionally used in machine learning models for the task. We propose to incorporate linguistic features into neural network models …...
Modeling Transitions of Focal Entities for Conversational Knowledge Base Question Answering
AbstractConversational KBQA is about answering a sequence of questions related to a KB. Follow-up questions in conversational KBQA often have missing information referring to entities from the conversation history. In …...
Multimodal Sentiment Detection Based on Multi-channel Graph Neural Networks
AbstractWith the popularity of smartphones, we have witnessed the rapid proliferation of multimodal posts on various social media platforms. We observe that the multimodal sentiment expression has specific global characteristics, …...
Neural Sequence Segmentation as Determining the Leftmost Segments
AbstractPrior methods to text segmentation are mostly at token level. Despite the adequacy, this nature limits their full potential to capture the long-term dependencies among segments. In this work, we …...
Not Far Away, Not So Close: Sample Efficient Nearest Neighbour Data Augmentation via MiniMax
ive Multi-Document Summarization Hao Zhou1 , Weidong Ren1 , Gongshen Liu1∗, Bo Su1 , Wei Lu2 1 School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University 2 StatNLP …...
ntust-nlp-2 at ROCLING-2021 Shared Task: BERT-based semantic analyzer with word-level information
AbstractIn this paper, we proposed a BERT-based dimensional semantic analyzer, which is designed by incorporating with word-level information. Our model achieved three of the best results in four metrics on …...
Partially Supervised Named Entity Recognition via the Expected Entity Ratio Loss
AbstractWe study learning named entity recognizers in the presence of missing entity annotations. We approach this setting as tagging with latent variables and propose a novel loss, the Expected Entity …...
Preventing Author Profiling through Zero-Shot Multilingual Back-Translation
AbstractDocuments as short as a single sentence may inadvertently reveal sensitive information about their authors, including e.g. their gender or ethnicity. Style transfer is an effective way of transforming texts …...
Risk Minimization for Zero-shot Sequence Labeling
AbstractZero-shot sequence labeling aims to build a sequence labeler without human-annotated datasets. One straightforward approach is utilizing existing systems (source models) to generate pseudo-labeled datasets and train a target sequence …...
Search from History and Reason for Future: Two-stage Reasoning on Temporal Knowledge Graphs
AbstractTemporal Knowledge Graphs (TKGs) have been developed and used in many different areas. Reasoning on TKGs that predicts potential facts (events) in the future brings great challenges to existing models. …...
STaCK: Sentence Ordering with Temporal Commonsense Knowledge
AbstractSentence order prediction is the task of finding the correct order of sentences in a randomly ordered document. Correctly ordering the sentences requires an understanding of coherence with respect to …...
Structured Refinement for Sequential Labeling
Filtering target-irrelevant information through hierarchically refining hidden states has been demonstrated to be effective for obtaining in- formative representations. However, previous work simply relies on locally normalized at- tention without …...
Structured Sentiment Analysis as Dependency Graph Parsing
AbstractStructured sentiment analysis attempts to extract full opinion tuples from a text, but over time this task has been subdivided into smaller and smaller sub-tasks, e.g., target extraction or targeted …...
Towards Label-Agnostic Emotion Embeddings
AbstractResearch in emotion analysis is scattered across different label formats (e.g., polarity types, basic emotion categories, and affective dimensions), linguistic levels (word vs. sentence vs. discourse), and, of course, (few …...
Universal Simultaneous Machine Translation with Mixture-of-Experts Wait-k Policy
AbstractSimultaneous machine translation (SiMT) generates translation before reading the entire source sentence and hence it has to trade off between translation quality and latency. To fulfill the requirements of different …...
Unsupervised Out-of-Domain Detection via Pre-trained Transformers
AbstractDeployed real-world machine learning applications are often subject to uncontrolled and even potentially malicious inputs. Those out-of-domain inputs can lead to unpredictable outputs and sometimes catastrophic safety issues. Prior studies …...
VeeAlign: Multifaceted Context Representation Using Dual Attention for Ontology Alignment
AbstractOntology Alignment is an important research problem applied to various fields such as data integration, data transfer, data preparation, etc. State-of-the-art (SOTA) Ontology Alignment systems typically use naive domain-dependent approaches …...
“That Is a Suspicious Reaction!”: Interpreting Logits Variation to Detect NLP Adversarial Attacks
AbstractAdversarial attacks are a major challenge faced by current machine learning research. These purposely crafted inputs fool even the most advanced models, precluding their deployment in safety-critical applications. Extensive research …...
“Will You Find These Shortcuts?” A Protocol for Evaluating the Faithfulness of Input Salience Methods for Text Classification
AbstractFeature attribution a.k.a. input salience methods which assign an importance score to a feature are abundant but may produce surprisingly different results for the same model on the same input. …...
A Survey on Cross-Lingual Summarization
AbstractCross-lingual summarization is the task of generating a summary in one language (e.g., English) for the given document(s) in a different language (e.g., Chinese). Under the globalization background, this task …...
Affective Knowledge Enhanced Multiple-Graph Fusion Networks for Aspect-based Sentiment Analysis
AbstractAspect-based sentiment analysis aims to identify sentiment polarity of social media users toward different aspects. Most recent methods adopt the aspect-centric latent tree to connect aspects and their corresponding opinion …...
AGRank: Augmented Graph-based Unsupervised Keyphrase Extraction
AbstractKeywords or keyphrases are often used to highlight a document’s domains or main topics. Unsupervised keyphrase extraction (UKE) has always been highly anticipated because no labeled data is needed to …...
An Information-theoretic Approach to Prompt Engineering Without Ground Truth Labels
AbstractPre-trained language models derive substantial linguistic and factual knowledge from the massive corpora on which they are trained, and prompt engineering seeks to align these models to specific tasks. Unfortunately, …...
Are All the Datasets in Benchmark Necessary? A Pilot Study of Dataset Evaluation for Text Classification
AbstractIn this paper, we ask the research question of whether all the datasets in the benchmark are necessary. We approach this by first characterizing the distinguishability of datasets when comparing …...
Attribute Injection for Pretrained Language Models: A New Benchmark and an Efficient Method
AbstractMetadata attributes (e.g., user and product IDs from reviews) can be incorporated as additional inputs to neural-based NLP models, by expanding the architecture of the models to improve performance. However, …...
Batch-Softmax Contrastive Loss for Pairwise Sentence Scoring Tasks
AbstractThe use of contrastive loss for representation learning has become prominent in computer vision, and it is now getting attention in Natural Language Processing (NLP).Here, we explore the idea of …...
Building Sentiment Lexicons for Mainland Scandinavian Languages Using Machine Translation and Sentence Embeddings
AbstractThis paper presents a simple but effective method to build sentiment lexicons for the three Mainland Scandinavian languages: Danish, Norwegian and Swedish. This method benefits from the English Sentiwordnet and …...
Chart-to-Text: A Large-Scale Benchmark for Chart Summarization
AbstractCharts are commonly used for exploring data and communicating insights. Generating natural language summaries from charts can be very helpful for people in inferring key insights that would otherwise require …...
Cluster & Tune: Boost Cold Start Performance in Text Classification
AbstractIn real-world scenarios, a text classification task often begins with a cold start, when labeled data is scarce. In such cases, the common practice of fine-tuning pre-trained models, such as …...
ConfliBERT: A Pre-trained Language Model for Political Conflict and Violence
AbstractAnalyzing conflicts and political violence around the world is a persistent challenge in the political science and policy communities due in large part to the vast volumes of specialized text …...
Deep Learning for Text Style Transfer: A Survey
AbstractText style transfer is an important task in natural language generation, which aims to control certain attributes in the generated text, such as politeness, emotion, humor, and many others. It …...
Efficient, Uncertainty-based Moderation of Neural Networks Text Classifiers
AbstractTo maximize the accuracy and increase the overall acceptance of text classifiers, we propose a framework for the efficient, in-operation moderation of classifiers’ output. Our framework focuses on use cases …...
Entailer: Answering Questions with Faithful and Truthful Chains of Reasoning
AbstractOur goal is a question-answering (QA) system that can show how its answers are implied by its own internal beliefs via a systematic chain of reasoning. Such a capability would …...
Faithful or Extractive? On Mitigating the Faithfulness-Abstractiveness Trade-off in Abstractive Summarization
AbstractDespite recent progress in abstractive summarization, systems still suffer from faithfulness errors. While prior work has proposed models that improve faithfulness, it is unclear whether the improvement comes from an …...
Falsesum: Generating Document-level NLI Examples for Recognizing Factual Inconsistency in Summarization
AbstractNeural abstractive summarization models are prone to generate summaries that are factually inconsistent with their source documents. Previous work has introduced the task of recognizing such factual inconsistency as a …...
FORTAP: Using Formulas for Numerical-Reasoning-Aware Table Pretraining
AbstractTables store rich numerical data, but numerical reasoning over tables is still a challenge. In this paper, we find that the spreadsheet formula, a commonly used language to perform computations …...
Hierarchical Recurrent Aggregative Generation for Few-Shot NLG
AbstractLarge pretrained models enable transfer learning to low-resource domains for language generation tasks. However, previous end-to-end approaches do not account for the fact that some generation sub-tasks, specifically aggregation and …...
Increasing Visual Awareness in Multimodal Neural Machine Translation from an Information Theoretic Perspective
AbstractMultimodal machine translation (MMT) aims to improve translation quality by equipping the source sentence with its corresponding image. Despite the promising performance, MMT models still suffer the problem of input …...
Investigating Selective Prediction Approaches Across Several Tasks in IID, OOD, and Adversarial Settings
AbstractIn order to equip NLP systems with ‘selective prediction’ capability, several task-specific approaches have been proposed. However, which approaches work best across tasks or even if they consistently outperform the …...
Metaphor Detection via Linguistics Enhanced Siamese Network
AbstractIn this paper we present MisNet, a novel model for word level metaphor detection. MisNet converts two linguistic rules, i.e., Metaphor Identification Procedure (MIP) and Selectional Preference Violation (SPV) into …...
MetaPrompting: Learning to Learn Better Prompts
AbstractPrompting method is regarded as one of the crucial progress for few-shot nature language processing. Recent research on prompting moves from discrete tokens based “hard prompts” to continuous “soft prompts”, …...
MetaTKG: Learning Evolutionary Meta-Knowledge for Temporal Knowledge Graph Reasoning
AbstractReasoning over Temporal Knowledge Graphs (TKGs) aims to predict future facts based on given history. One of the key challenges for prediction is to learn the evolution of facts. Most …...
MuCDN: Mutual Conversational Detachment Network for Emotion Recognition in Multi-Party Conversations
AbstractAs an emerging research topic in natural language processing community, emotion recognition in multi-party conversations has attained increasing interest. Previous approaches that focus either on dyadic or multi-party scenarios exert …...
Multi-task Learning for Paraphrase Generation With Keyword and Part-of-Speech Reconstruction
AbstractParaphrase generation using deep learning has been a research hotspot of natural language processing in the past few years. While previous studies tackle the problem from different aspects, the essence …...
On the Robustness of Question Rewriting Systems to Questions of Varying Hardness
AbstractIn conversational question answering (CQA), the task of question rewriting (QR) in context aims to rewrite a context-dependent question into an equivalent self-contained question that gives the same answer. In …...
Recent Advances in Text-to-SQL: A Survey of What We Have and What We Expect
AbstractText-to-SQL has attracted attention from both the natural language processing and database communities because of its ability to convert the semantics in natural language into SQL queries and its practical …...
Semantic-aware Contrastive Learning for More Accurate Semantic Parsing
AbstractSince the meaning representations are detailed and accurate annotations which express fine-grained sequence-level semtantics, it is usually hard to train discriminative semantic parsers via Maximum Likelihood Estimation (MLE) in an …...
SemEval-2022 Task 2: Multilingual Idiomaticity Detection and Sentence Embedding
AbstractThis paper presents the shared task on Multilingual Idiomaticity Detection and Sentence Embedding, which consists of two subtasks: (a) a binary classification task aimed at identifying whether a sentence contains …...
SenPoi at SemEval-2022 Task 10: Point me to your Opinion, SenPoi
AbstractStructured Sentiment Analysis is the task of extracting sentiment tuples in a graph structure commonly from review texts. We adapt the Aspect-Based Sentiment Analysis pointer network BARTABSA to model this …...
SyMCoM - Syntactic Measure of Code Mixing A Study Of English-Hindi Code-Mixing
AbstractCode mixing is the linguistic phenomenon where bilingual speakers tend to switch between two or more languages in conversations. Recent work on code-mixing in computational settings has leveraged social media …...
Toward Unifying Text Segmentation and Long Document Summarization
AbstractText segmentation is important for signaling a document’s structure. Without segmenting a long document into topically coherent sections, it is difficult for readers to comprehend the text, let alone find …...
Towards Better Document-level Relation Extraction via Iterative Inference
AbstractDocument-level relation extraction (RE) aims to extract the relations between entities from the input document that usually containing many difficultly-predicted entity pairs whose relations can only be predicted through relational …...
Twitter Topic Classification
AbstractSocial media platforms host discussions about a wide variety of topics that arise everyday. Making sense of all the content and organising it into categories is an arduous task. A …...
UniRel: Unified Representation and Interaction for Joint Relational Triple Extraction
AbstractRelational triple extraction is challenging for its difficulty in capturing rich correlations between entities and relations. Existing works suffer from 1) heterogeneous representations of entities and relations, and 2) heterogeneous …...
Unsupervised Reinforcement Adaptation for Class-Imbalanced Text Classification
AbstractClass imbalance naturally exists when label distributions are not aligned across source and target domains. However, existing state-of-the-art UDA models learn domain-invariant representations across domains and evaluate primarily on class-balanced …...
UoR-NCL at SemEval-2022 Task 3: Fine-Tuning the BERT-Based Models for Validating Taxonomic Relations
AbstractIn human languages, there are many presuppositional constructions that impose a constrain on the taxonomic relations between two nouns depending on their order. These constructions create a challenge in validating …...
A Survey on Recent Advances in Keyphrase Extraction from Pre-trained Language Models
AbstractKeyphrase Extraction (KE) is a critical component in Natural Language Processing (NLP) systems for selecting a set of phrases from the document that could summarize the important information discussed in …...
Adversarial Network with External Knowledge for Zero-Shot Stance Detection
Abstract“Zero-shot stance detection intends to detect previously unseen targets’ stances in the testingphase. However, achieving this goal can be difficult, as it requires minimizing the domain trans-fer between different targets, …...
Are Human Explanations Always Helpful? Towards Objective Evaluation of Human Natural Language Explanations
AbstractHuman-annotated labels and explanations are critical for training explainable NLP models. However, unlike human-annotated labels whose quality is easier to calibrate (e.g., with a majority vote), human-crafted free-form explanations can …...
Bridging Argument Quality and Deliberative Quality Annotations with Adapters
AbstractAssessing the quality of an argument is a complex, highly subjective task, influenced by heterogeneous factors (e.g., prior beliefs of the annotators, topic, domain, and application), and crucial for its …...
CLAPSpeech: Learning Prosody from Text Context with Contrastive Language-Audio Pre-Training
AbstractImproving text representation has attracted much attention to achieve expressive text-to-speech (TTS). However, existing works only implicitly learn the prosody with masked token reconstruction tasks, which leads to low training …...
CLCL: Non-compositional Expression Detection with Contrastive Learning and Curriculum Learning
AbstractNon-compositional expressions present a substantial challenge for natural language processing (NLP) systems, necessitating more intricate processing compared to general language tasks, even with large pre-trained language models. Their non-compositional nature …...
CoAD: Automatic Diagnosis through Symptom and Disease Collaborative Generation
AbstractAutomatic diagnosis (AD), a critical application of AI in healthcare, employs machine learning techniques to assist doctors in gathering patient symptom information for precise disease diagnosis. The Transformer-based method utilizes …...
Contextual Knowledge Learning for Dialogue Generation
AbstractIncorporating conversational context and knowledge into dialogue generation models has been essential for improving the quality of the generated responses. The context, comprising utterances from previous dialogue exchanges, is used …...
Distinguishability Calibration to In-Context Learning
AbstractRecent years have witnessed increasing interests in prompt-based learning in which models can be trained on only a few annotated instances, making them suitable in low-resource settings. It is even …...
DualGATs: Dual Graph Attention Networks for Emotion Recognition in Conversations
AbstractCapturing complex contextual dependencies plays a vital role in Emotion Recognition in Conversations (ERC). Previous studies have predominantly focused on speaker-aware context modeling, overlooking the discourse structure of the conversation. …...
f-Divergence Minimization for Sequence-Level Knowledge Distillation
AbstractKnowledge distillation (KD) is the process of transferring knowledge from a large model to a small one. It has gained increasing attention in the natural language processing community, driven by …...
GLADIS: A General and Large Acronym Disambiguation Benchmark
AbstractAcronym Disambiguation (AD) is crucial for natural language understanding on various sources, including biomedical reports, scientific papers, and search engine queries. However, existing acronym disambiguationbenchmarks and tools are limited to …...
It Takes Two Flints to Make a Fire: Multitask Learning of Neural Relation and Explanation Classifiers
AbstractWe propose an explainable approach for relation extraction that mitigates the tension between generalization and explainability by jointly training for the two goals. Our approach uses a multi-task learning architecture, …...
Lexical Complexity Prediction using Word Embeddings
Lexical complexity is crucial for reading comprehension. In the past, research work of lexical complexity prediction mainly focuses on differentiating the complexity difference between two words. Moreover, most of the …...
LLM-RM at SemEval-2023 Task 2: Multilingual Complex NER Using XLM-RoBERTa
AbstractNamed Entity Recognition(NER) is a task ofrecognizing entities at a token level in a sen-tence. This paper focuses on solving NER tasksin a multilingual setting for complex named en-tities. Our …...
Multi-target Backdoor Attacks for Code Pre-trained Models
AbstractBackdoor attacks for neural code models have gained considerable attention due to the advancement of code intelligence. However, most existing works insert triggers into task-specific data for code-related downstream tasks, …...
Patton: Language Model Pretraining on Text-Rich Networks
AbstractA real-world text corpus sometimes comprises not only text documents, but also semantic links between them (e.g., academic papers in a bibliographic network are linked by citations and co-authorships).Text documents …...
Product Question Answering in E-Commerce: A Survey
AbstractProduct question answering (PQA), aiming to automatically provide instant responses to customer’s questions in E-Commerce platforms, has drawn increasing attention in recent years. Compared with typical QA problems, PQA exhibits …...
RADE: Reference-Assisted Dialogue Evaluation for Open-Domain Dialogue
AbstractEvaluating open-domain dialogue systems is challenging for reasons such as the one-to-many problem, i.e., many appropriate responses other than just the golden response. As of now, automatic evaluation methods need …...
Robust Multi-bit Natural Language Watermarking through Invariant Features
AbstractRecent years have witnessed a proliferation of valuable original natural language contents found in subscription-based media outlets, web novel platforms, and outputs of large language models. However, these contents are …...
Searching for Better Database Queries in the Outputs of Semantic Parsers
AbstractThe task of generating a database query from a question in natural language suffers from ambiguity and insufficiently precise description of the goal. The problem is amplified when the system …...
Synthesizing Human Gaze Feedback for Improved NLP Performance
AbstractIntegrating human feedback in models can improve the performance of natural language processing (NLP) models. Feedback can be either explicit (e.g. ranking used in training language models) or implicit (e.g. …...
The NLP Task Effectiveness of Long-Range Transformers
AbstractTransformer models cannot easily scale to long sequences due to their O(Nˆ2) time and space complexity. This has led to Transformer variants seeking to lower computational complexity, such as Longformer …...