Recurrent Models
Related Papers
Character-level Chinese-English Translation through ASCII Encoding
AbstractCharacter-level Neural Machine Translation (NMT) models have recently achieved impressive results on many language pairs. They mainly do well for Indo-European language pairs, where the languages share the same writing …...
Limitations in learning an interpreted language with recurrent models
AbstractIn this submission I report work in progress on learning simplified interpreted languages by means of recurrent models. The data is constructed to reflect core properties of natural language as …...
On the Practical Ability of Recurrent Neural Networks to Recognize Hierarchical Languages
AbstractWhile recurrent models have been effective in NLP tasks, their performance on context-free languages (CFLs) has been found to be quite weak. Given that CFLs are believed to capture important …...
Simplicity Bias in Transformers and their Ability to Learn Sparse Boolean Functions
AbstractDespite the widespread success of Transformers on NLP tasks, recent works have found that they struggle to model several formal languages when compared to recurrent models. This raises the question …...