Contrastive Distillation

Back to List
method ID: contrastivedistillation

Entity Details

Basic Information

Entity ID

contrastivedistillation

Entity Type

Method

English Label

Contrastive Distillation

Russian Label

Контрастная дистилляция

Kazakh Label

Контрастты дистилляция

Frequency

1

Description

English Description

A knowledge distillation framework where the student is trained to distill knowledge through intermediate layers of the teacher via a contrastive objective.

Russian Description

-

Kazakh Description

-