Fixed Attentive Patterns

Back to List
method ID: fixedattentivepatterns

Entity Details

Basic Information

Entity ID

fixedattentivepatterns

Entity Type

Method

English Label

Fixed Attentive Patterns

Russian Label

Фиксированные внимательные паттерны

Kazakh Label

Тұрақты назар үлгілері

Frequency

1

Description

English Description

Non-learnable attention patterns based solely on positional information, proposed to replace redundant attention heads in the Transformer.

Russian Description

-

Kazakh Description

-