Position Aware Context Dependence
otherentity
ID: positionawarecontextdependence
Related Papers
Pretraining with Artificial Language: Studying Transferable Knowledge in Language Models
AbstractWe investigate what kind of structural knowledge learned in neural network encoders is transferable to processing natural language. We design artificial languages with structural properties that mimic natural language, pretrain …...