Layer Permutation Language Modeling
method
ID: layerpermutationlanguagemodeling
Entity Details
Basic Information
Entity ID
layerpermutationlanguagemodeling
Entity Type
Method
English Label
Layer Permutation Language Modeling
Russian Label
Моделирование языка с перестановкой слоев
Kazakh Label
Қабаттың реттілігін өзгертетін тіл моделін жасау
Frequency
1
Description
English Description
A novel pre-training objective that permutes the exit layer for each token in sequences during the training of ELMER.
Russian Description
-
Kazakh Description
-