Self Contrastive Learning

method ID: selfcontrastivelearning

Entity Details

Basic Information

Entity ID

selfcontrastivelearning

Entity Type

Method

English Label

Self Contrastive Learning

Russian Label

Самоконтрастное обучение

Kazakh Label

Өзіндік контрастты оқыту

Frequency

1

Description

English Description

A simple method that alleviates the over smoothing problem by sampling negatives from pre trained language models intermediate layers, improving the quality of sentence representation.

Russian Description

-

Kazakh Description

-