Encoder-Decoder Models
Related Papers
Are we there yet? Encoder-decoder neural networks as cognitive models of English past tense inflection
AbstractThe cognitive mechanisms needed to account for the English past tense have long been a subject of debate in linguistics and cognitive science. Neural network models were proposed early on, …...
Generic Mechanism for Reducing Repetitions in Encoder-Decoder Models
AbstractEncoder-decoder models have been commonly used for many tasks such as machine translation and response generation. As previous research reported, these models suffer from generating redundant repetition. In this research, …...
Evaluating the Impact of Model Scale for Compositional Generalization in Semantic Parsing
AbstractDespite their strong performance on many tasks, pre-trained language models have been shown to struggle on out-of-distribution compositional generalization. Meanwhile, recent work has shown considerable improvements on many NLP tasks …...
Fine-grained Contrastive Learning for Definition Generation
AbstractRecently, pre-trained transformer-based models have achieved great success in the task of definition generation (DG). However, previous encoder-decoder models lack effective representation learning to contain full semantic components of the …...