МоделиПоследовательностьВПоследовательность
Related Papers
Sequence to Backward and Forward Sequences: A Content-Introducing Approach to Generative Short-Text Conversation
AbstractUsing neural networks to generate replies in human-computer dialogue systems is attracting increasing attention over the past few years. However, the performance is not satisfactory: the neural network tends to …...
Neural AMR: Sequence-to-Sequence Models for Parsing and Generation
AbstractSequence-to-sequence models have shown strong performance across a broad range of applications. However, their application to parsing and generating text using Abstract Meaning Representation (AMR) has been limited, due to …...
Reinforced Video Captioning with Entailment Rewards
AbstractSequence-to-sequence models have shown promising improvements on the temporal task of video captioning, but they optimize word-level cross-entropy loss during training. First, using policy gradient and mixed-loss methods for reinforcement …...
A Detailed Evaluation of Neural Sequence-to-Sequence Models for In-domain and Cross-domain Text Simplification
We present a detailed evaluation and analysis of neural sequence-to-sequence models for text simplification on two distinct datasets: Wikipedia and Newsela. We employ both human and automatic evaluation to investigate …...
Deconvolution-Based Global Decoding for Neural Machine Translation
AbstractA great proportion of sequence-to-sequence (Seq2Seq) models for Neural Machine Translation (NMT) adopt Recurrent Neural Network (RNN) to generate translation word by word following a sequential order. As the studies …...
Learning to Decipher Hate Symbols
AbstractExisting computational models to understand hate speech typically frame the problem as a simple classification task, bypassing the understanding of hate symbols (e.g., 14 words, kigy) and their secret connotations. …...
Linguistically-Informed Specificity and Semantic Plausibility for Dialogue Generation
AbstractSequence-to-sequence models for open-domain dialogue generation tend to favor generic, uninformative responses. Past work has focused on word frequency-based approaches to improving specificity, such as penalizing responses with only common …...
Sparse Sequence-to-Sequence Models
AbstractSequence-to-sequence models are a powerful workhorse of NLP. Most variants employ a softmax transformation in both their attention mechanism and output layer, leading to dense alignments and strictly positive output …...
Keyphrase Generation for Scientific Document Retrieval
AbstractSequence-to-sequence models have lead to significant progress in keyphrase generation, but it remains unknown whether they are reliable enough to be beneficial for document retrieval. This study provides empirical evidence …...
Continuous Language Generative Flow
AbstractRecent years have witnessed various types of generative models for natural language generation (NLG), especially RNNs or transformer based sequence-to-sequence models, as well as variational autoencoder (VAE) and generative adversarial …...
Do RNN States Encode Abstract Phonological Alternations?
AbstractSequence-to-sequence models have delivered impressive results in word formation tasks such as morphological inflection, often learning to model subtle morphophonological details with limited training data. Despite the performance, the opacity …...
Effective Sequence-to-Sequence Dialogue State Tracking
AbstractSequence-to-sequence models have been applied to a wide variety of NLP tasks, but how to properly use them for dialogue state tracking has not been systematically investigated. In this paper, …...
Expanding, Retrieving and Infilling: Diversifying Cross-Domain Question Generation with Flexible Templates
AbstractSequence-to-sequence based models have recently shown promising results in generating high-quality questions. However, these models are also known to have main drawbacks such as lack of diversity and bad sentence …...
Grammar-Based Patches Generation for Automated Program Repair
Automated program repair (APR) aims to find an automatic solution to program lan- guage bugs without human intervention, and it can potentially reduce debugging costs and improve software quality. Conven- …...
Automatic Label Sequence Generation for Prompting Sequence-to-sequence Models
AbstractPrompting, which casts downstream applications as language modeling tasks, has shown to be sample efficient compared to standard fine-tuning with pre-trained models. However, one pitfall of prompting is the need …...
Generate-and-Retrieve: Use Your Predictions to Improve Retrieval for Semantic Parsing
AbstractA common recent approach to semantic parsing augments sequence-to-sequence models by retrieving and appending a set of training samples, called exemplars. The effectiveness of this recipe is limited by the …...
Injecting knowledge into language generation: a case study in auto-charting after-visit care instructions from medical dialogue
AbstractFactual correctness is often the limiting factor in practical applications of natural language generation in high-stakes domains such as healthcare. An essential requirement for maintaining factuality is the ability to …...
Prompt-Based Approach for Czech Sentiment Analysis
AbstractThis paper introduces the first prompt-based methods for aspect-based sentiment analysis and sentiment classification in Czech. We employ the sequence-to-sequence models to solve the aspect-based tasks simultaneously and demonstrate the …...