Қоғамдық деректер жиынтығы
Related Papers
Joint Processing and Discriminative Training for Letter-to-Phoneme Conversion
We present a discriminative structure- prediction model for the letter-to-phoneme task, a crucial step in text-to-speech process- ing. Our method encompasses three tasks that have been previously handled separately: input …...
Efficient Collective Entity Linking with Stacking
Entity disambiguation works by linking am- biguous mentions in text to their correspond- ing real-world entities in knowledge base. Re- cent collective disambiguation methods en- force coherence among contextual decisions …...
AFET: Automatic Fine-Grained Entity Typing by Hierarchical Partial-Label Embedding
Distant supervision has been widely used in current systems of fine-grained entity typ- ing to automatically assign categories (en- tity types) to entity mentions. However, the types so obtained from …...
Adversarial Multi-task Learning for Text Classification
AbstractNeural network models have shown their promising opportunities for multi-task learning, which focus on learning the shared layers to extract the common and task-invariant features. However, in most existing approaches, …...
Sequential Matching Network: A New Architecture for Multi-turn Response Selection in Retrieval-Based Chatbots
AbstractWe study response selection for multi-turn conversation in retrieval based chatbots. Existing work either concatenates utterances in context or matches a response with a highly abstract context vector finally, which …...
Using Global Constraints and Reranking to Improve Cognates Detection
AbstractGlobal constraints and reranking have not been used in cognates detection research to date. We propose methods for using global constraints by performing rescoring of the score matrices produced by …...
A Dual-Attention Hierarchical Recurrent Neural Network for Dialogue Act Classification
AbstractRecognising dialogue acts (DA) is important for many natural language processing tasks such as dialogue generation and intention recognition. In this paper, we propose a dual-attention hierarchical recurrent neural network …...
A Sequential Matching Framework for Multi-Turn Response Selection in Retrieval-Based Chatbots
AbstractWe study the problem of response selection for multi-turn conversation in retrieval-based chatbots. The task involves matching a response candidate with a conversation context, the challenges for which include how …...
An End-to-End Generative Architecture for Paraphrase Generation
AbstractGenerating high-quality paraphrases is a fundamental yet challenging natural language processing task. Despite the effectiveness of previous work based on generative models, there remain problems with exposure bias in recurrent …...
CAN: Constrained Attention Networks for Multi-Aspect Sentiment Analysis
AbstractAspect level sentiment classification is a fine-grained sentiment analysis task. To detect the sentiment towards a particular aspect in a sentence, previous studies have developed various attention-based methods for generating …...
Dialog Intent Induction with Deep Multi-View Clustering
AbstractWe introduce the dialog intent induction task and present a novel deep multi-view clustering approach to tackle the problem. Dialog intent induction aims at discovering user intents from user query …...
EigenSent: Spectral sentence embeddings using higher-order Dynamic Mode Decomposition
AbstractDistributed representation of words, or word embeddings, have motivated methods for calculating semantic representations of word sequences such as phrases, sentences and paragraphs. Most of the existing methods to do …...
End-to-End Sequential Metaphor Identification Inspired by Linguistic Theories
AbstractEnd-to-end training with Deep Neural Networks (DNN) is a currently popular method for metaphor identification. However, standard sequence tagging models do not explicitly take advantage of linguistic theories of metaphor …...
Fine-Grained Entity Typing via Hierarchical Multi Graph Convolutional Networks
AbstractThis paper addresses the problem of inferring the fine-grained type of an entity from a knowledge base. We convert this problem into the task of graph-based semi-supervised classification, and propose …...
Learning a Matching Model with Co-teaching for Multi-turn Response Selection in Retrieval-based Dialogue Systems
AbstractWe study learning of a matching model for response selection in retrieval-based dialogue systems. The problem is equally important with designing the architecture of a model, but is less explored …...
Multi-Channel Graph Neural Network for Entity Alignment
AbstractEntity alignment typically suffers from the issues of structural heterogeneity and limited seed alignments. In this paper, we propose a novel Multi-channel Graph Neural Network model (MuGNN) to learn alignment-oriented …...
Read, Attend and Comment: A Deep Architecture for Automatic News Comment Generation
AbstractAutomatic news comment generation is beneficial for real applications but has not attracted enough attention from the research community. In this paper, we propose a “read-attend-comment” procedure for news comment …...
Self-Discriminative Learning for Unsupervised Document Embedding
AbstractUnsupervised document representation learning is an important task providing pre-trained features for NLP applications. Unlike most previous work which learn the embedding based on self-prediction of the surface of text, …...
Accurate Word Alignment Induction from Neural Machine Translation
AbstractDespite its original goal to jointly learn to align and translate, prior researches suggest that Transformer captures poor word alignments through its attention mechanism. In this paper, we show that …...
Adaptive Attentional Network for Few-Shot Knowledge Graph Completion
AbstractFew-shot Knowledge Graph (KG) completion is a focus of current research, where each task aims at querying unseen facts of a relation given its few-shot reference entity pairs. Recent attempts …...
Diversify Question Generation with Continuous Content Selectors and Question Type Modeling
AbstractGenerating questions based on answers and relevant contexts is a challenging task. Recent work mainly pays attention to the quality of a single generated question. However, question generation is actually …...
Fact-based Text Editing
AbstractWe propose a novel text editing task, referred to as fact-based text editing, in which the goal is to revise a given document to better describe the facts in a …...
Learning Interpretable Relationships between Entities, Relations and Concepts via Bayesian Structure Learning on Open Domain Facts
AbstractConcept graphs are created as universal taxonomies for text understanding in the open-domain knowledge. The nodes in concept graphs include both entities and concepts. The edges are from entities to …...
Multi-Instance Multi-Label Learning Networks for Aspect-Category Sentiment Analysis
AbstractAspect-category sentiment analysis (ACSA) aims to predict sentiment polarities of sentences with respect to given aspect categories. To detect the sentiment toward a particular aspect category in a sentence, most …...
MZET: Memory Augmented Zero-Shot Fine-grained Named Entity Typing
AbstractNamed entity typing (NET) is a classification task of assigning an entity mention in the context with given semantic types. However, with the growing size and granularity of the entity …...
Pointing to Select: A Fast Pointer-LSTM for Long Text Classification
AbstractRecurrent neural networks (RNNs) suffer from well-known limitations and complications which include slow inference and vanishing gradients when processing long sequences in text classification. Recent studies have attempted to accelerate …...
Toxic, Hateful, Offensive or Abusive? What Are We Really Classifying? An Empirical Analysis of Hate Speech Datasets
AbstractThe field of the automatic detection of hate speech and related concepts has raised a lot of interest in the last years. Different datasets were annotated and classified by means …...
TPLinker: Single-stage Joint Extraction of Entities and Relations Through Token Pair Linking
AbstractExtracting entities and relations from unstructured text has attracted increasing attention in recent years but remains challenging, due to the intrinsic difficulty in identifying overlapping relations with shared entities. Prior …...
A Neural Transition-based Model for Argumentation Mining
AbstractThe goal of argumentation mining is to automatically extract argumentation structures from argumentative texts. Most existing methods determine argumentative relations by exhaustively enumerating all possible pairs of argument components, which …...
Dual Graph Convolutional Networks for Aspect-based Sentiment Analysis
AbstractAspect-based sentiment analysis is a fine-grained sentiment classification task. Recently, graph neural networks over dependency trees have been explored to explicitly model connections between aspects and opinion words. However, the …...
End-to-End Entity Resolution and Question Answering Using Differentiable Knowledge Graphs
AbstractRecently, end-to-end (E2E) trained models for question answering over knowledge graphs (KGQA) have delivered promising results using only a weakly supervised dataset. However, these models are trained and evaluated in …...
GL-GIN: Fast and Accurate Non-Autoregressive Model for Joint Multiple Intent Detection and Slot Filling
AbstractMulti-intent SLU can handle multiple intents in an utterance, which has attracted increasing attention. However, the state-of-the-art joint models heavily rely on autoregressive approaches, resulting in two issues: slow inference …...
Gradient Imitation Reinforcement Learning for Low Resource Relation Extraction
AbstractLow-resource Relation Extraction (LRE) aims to extract relation facts from limited labeled corpora when human annotation is scarce. Existing works either utilize self-training scheme to generate pseudo labels that will …...
Hate Speech Detection Based on Sentiment Knowledge Sharing
AbstractThe wanton spread of hate speech on the internet brings great harm to society and families. It is urgent to establish and improve automatic detection and active avoidance mechanisms for …...
Interpretable and Low-Resource Entity Matching via Decoupling Feature Learning from Decision Making
AbstractEntity Matching (EM) aims at recognizing entity records that denote the same real-world object. Neural EM models learn vector representation of entity descriptions and match entities end-to-end. Though robust, these …...
Memorization vs. Generalization : Quantifying Data Leakage in NLP Performance Evaluation
AbstractPublic datasets are often used to evaluate the efficacy and generalizability of state-of-the-art methods for many tasks in natural language processing (NLP). However, the presence of overlap between the train …...
RealTranS: End-to-End Simultaneous Speech Translation with Convolutional Weighted-Shrinking Transformer
End-to-end simultaneous speech translation (SST), which directly translates speech in one language into text in another language in real- time, is useful in many scenarios but has not been fully …...
SIRE: Separate Intra- and Inter-sentential Reasoning for Document-level Relation Extraction
Document-level relation extraction has at- tracted much attention in recent years. It is usu- ally formulated as a classification problem that predicts relations for all entity pairs in the doc- …...
Uncovering Main Causalities for Long-tailed Information Extraction
AbstractInformation Extraction (IE) aims to extract structural information from unstructured texts. In practice, long-tailed distributions caused by the selection bias of a dataset may lead to incorrect correlations, also known …...
Augmenting Legal Judgment Prediction with Contrastive Case Relations
AbstractExisting legal judgment prediction methods usually only consider one single case fact description as input, which may not fully utilize the information in the data such as case relations and …...
Divide and Denoise: Learning from Noisy Labels in Fine-Grained Entity Typing with Cluster-Wise Loss Correction
AbstractFine-grained Entity Typing (FET) has made great progress based on distant supervision but still suffers from label noise. Existing FET noise learning methods rely on prediction distributions in an instance-independent …...
Fine-grained Category Discovery under Coarse-grained supervision with Hierarchical Weighted Self-contrastive Learning
AbstractNovel category discovery aims at adapting models trained on known categories to novel categories. Previous works only focus on the scenario where known and novel categories are of the same …...
Graph-based Model Generation for Few-Shot Relation Extraction
AbstractFew-shot relation extraction (FSRE) has been a challenging problem since it only has a handful of training instances. Existing models follow a ‘one-for-all’ scheme where one general large model performs …...
Improving Continual Relation Extraction through Prototypical Contrastive Learning
AbstractContinual relation extraction (CRE) aims to extract relations towards the continuous and iterative arrival of new data, of which the major challenge is the catastrophic forgetting of old tasks. In …...
Intent Detection and Discovery from User Logs via Deep Semi-Supervised Contrastive Clustering
AbstractIntent Detection is a crucial component of Dialogue Systems wherein the objective is to classify a user utterance into one of multiple pre-defined intents. A pre-requisite for developing an effective …...
KNN-Contrastive Learning for Out-of-Domain Intent Classification
AbstractThe Out-of-Domain (OOD) intent classification is a basic and challenging task for dialogue systems. Previous methods commonly restrict the region (in feature space) of In-domain (IND) intent features to be …...
Learning Inter-Entity-Interaction for Few-Shot Knowledge Graph Completion
AbstractFew-shot knowledge graph completion (FKGC) aims to infer unknown fact triples of a relation using its few-shot reference entity pairs. Recent FKGC studies focus on learning semantic representations of entity …...
Leveraging Key Information Modeling to Improve Less-Data Constrained News Headline Generation via Duality Fine-Tuning
AbstractRecent language generative models are mostly trained on large-scale datasets, while in some real scenarios, the training datasets are often expensive to obtain and would be small-scale. In this paper …...
LightEA: A Scalable, Robust, and Interpretable Entity Alignment Framework via Three-view Label Propagation
AbstractEntity Alignment (EA) aims to find equivalent entity pairs between KGs, which is the core step to bridging and integrating multi-source KGs. In this paper, we argue that existing complex …...
Mining Clues from Incomplete Utterance: A Query-enhanced Network for Incomplete Utterance Rewriting
AbstractIncomplete utterance rewriting has recently raised wide attention. However, previous works do not consider the semantic structural information between incomplete utterance and rewritten utterance or model the semantic structure implicitly …...
RAPO: An Adaptive Ranking Paradigm for Bilingual Lexicon Induction
AbstractBilingual lexicon induction induces the word translations by aligning independently trained word embeddings in two languages. Existing approaches generally focus on minimizing the distances between words in the aligned pairs, …...
SHIELD: Defending Textual Neural Networks against Multiple Black-Box Adversarial Attacks with Stochastic Multi-Expert Patcher
AbstractEven though several methods have proposed to defend textual neural network (NN) models against black-box adversarial attacks, they often defend against a specific text perturbation strategy and/or require re-training the …...
SPACL: Shared-Private Architecture based on Contrastive Learning for Multi-domain Text Classification
Abstract“With the development of deep learning in recent years, text classification research has achieved remarkable results. However, text classification task often requires a large amount of annotated data, and data …...
Where to Attack: A Dynamic Locator Model for Backdoor Attack in Text Classifications
AbstractNowadays, deep-learning based NLP models are usually trained with large-scale third-party data which can be easily injected with malicious backdoors. Thus, BackDoor Attack (BDA) study has become a trending research …...
Word Segmentation by Separation Inference for East Asian Languages
AbstractChinese Word Segmentation (CWS) intends to divide a raw sentence into words through sequence labeling. Thinking in reverse, CWS can also be viewed as a process of grouping a sequence …...
AMR-based Network for Aspect-based Sentiment Analysis
AbstractAspect-based sentiment analysis (ABSA) is a fine-grained sentiment classification task. Many recent works have used dependency trees to extract the relation between aspects and contexts and have achieved significant improvements. …...
Dialog-Post: Multi-Level Self-Supervised Objectives and Hierarchical Model for Dialogue Post-Training
AbstractDialogue representation and understanding aim to convert conversational inputs into embeddings and fulfill discriminative tasks. Compared with free-form text, dialogue has two important characteristics, hierarchical semantic structure and multi-facet attributes. …...
Learnable Conjunction Enhanced Model for Chinese Sentiment Analysis
Abstract“Sentiment analysis is a crucial text classification task that aims to extract, process, and analyzeopinions, sentiments, and subjectivity within texts. In current research on Chinese text, sentenceand aspect-based sentiment analysis …...
Model-Based Simulation for Optimising Smart Reply
AbstractSmart Reply (SR) systems present a user with a set of replies, of which one can be selected in place of having to type out a response. To perform well …...
Multiview Identifiers Enhanced Generative Retrieval
AbstractInstead of simply matching a query to pre-existing passages, generative retrieval generates identifier strings of passages as the retrieval target. At a cost, the identifier must be distinctive enough to …...
Prompt Tuning with Contradictory Intentions for Sarcasm Recognition
AbstractRecently, prompt tuning has achieved promising results in a variety of natural language processing (NLP) tasks. The typical approach is to insert text pieces (i.e. templates) into the input and …...