Attention Head Masking

method ID: attentionheadmasking

Entity Details

Basic Information

Entity ID

attentionheadmasking

Entity Type

Method

English Label

Attention Head Masking

Russian Label

Маскирование головок внимания

Kazakh Label

Назар аудару басын маскалау

Frequency

1

Description

English Description

A technique applied on encoder decoder attentions to pinpoint salient content at inference time.

Russian Description

-

Kazakh Description

-