Saturated Attention
method
ID: saturatedattention
Entity Details
Basic Information
Entity ID
saturatedattention
Entity Type
Method
English Label
Saturated Attention
Russian Label
Насыщенное внимание
Kazakh Label
Қаныққан назар
Frequency
1
Description
English Description
A generalization of hard attention that captures the attention patterns learnable in practical transformers.
Russian Description
-
Kazakh Description
-