Adaptive Gradient Gating
method
ID: adaptivegradientgating
Entity Details
Basic Information
Entity ID
adaptivegradientgating
Entity Type
Method
English Label
Adaptive Gradient Gating
Russian Label
Адаптивное градиентное управление
Kazakh Label
Адаптивті градиентті басқару
Frequency
1
Description
English Description
A novel method that addresses the degeneration problem by gating the specific part of the gradient for rare token embeddings.
Russian Description
-
Kazakh Description
-