Roles and Utilization of Attention Heads in Transformer-based Neural Language Models
37830Related Entities
BERT
Method
ELECTRA
Method
GPT
Method
GPT-2
Material
Многоголовое внимание
Method
Задачи зондирования
Task
Кодировщики предложений
Method
Архитектура Transformer
Method