Simplicity Bias in Transformers and their Ability to Learn Sparse Boolean Functions

38544

Knowledge Triples

Source Entity	Relationship	Target Entity
LSTM Method	achieves	Generalization Accuracy Metric
LSTM Method	trainedOn	Boolean Functions Task
Transformers Method	achieves	Generalization Accuracy Metric
Transformers Method	comparesWith	Recurrent Models Method
Transformers Method	trainedOn	Boolean Functions Task