BERTology
otherentity
ID: bertology
Related Papers
From BERT‘s Point of View: Revealing the Prevailing Contextual Differences
AbstractThough successfully applied in research and industry large pretrained language models of the BERT family are not yet fully understood. While much research in the field of BERTology has tested …...
Towards Understanding Large-Scale Discourse Structures in Pre-Trained and Fine-Tuned Language Models
AbstractIn this paper, we extend the line of BERTology work by focusing on the important, yet less explored, alignment of pre-trained and fine-tuned PLMs with large-scale discourse structures. We propose …...