Generalization Accuracy
Related Papers
Do Not Forget: Full Memory in Memory-Based Learning of Word Pronunciation
Memory-based learning, keeping full memory ofleaxning material, appeaxs a viable approach to learning N-~ tasks, and is often superior in genera~sation accuracy to eager learning approaches that abstract from learning …...
Finding Representations for Memory-Based Language Learning
Constructive induction transforms the representation of instances in order to produce a more accurate model of the concept to be learned. For this purpose, a vari- ety of operators has …...
COGS: A Compositional Generalization Challenge Based on Semantic Interpretation
AbstractNatural language is characterized by compositionality: the meaning of a complex expression is constructed from the meanings of its constituent parts. To facilitate the evaluation of the compositional abilities of …...
Towards Interpreting and Mitigating Shortcut Learning Behavior of NLU models
AbstractRecent studies indicate that NLU models are prone to rely on shortcut features for prediction, without achieving true language understanding. As a result, these models fail to generalize to real-world …...
Simplicity Bias in Transformers and their Ability to Learn Sparse Boolean Functions
AbstractDespite the widespread success of Transformers on NLP tasks, recent works have found that they struggle to model several formal languages when compared to recurrent models. This raises the question …...