KnowledgeDistillation

Back to List
method ID: knowledgedistillation

Outgoing Relationships

Relationship Target Entity Type Actions
creates Student Model material View
trainedOn Soft Labels otherentity View
reduces Target Token Dependency otherentity View
isBasedOn Deep Learning method View
addresses Model Compression task View
addresses Exposure Bias metric View
addresses Large Scale Pre Trained Language Models material View
partOf Triple stage training framework method View
partOf Synthetic Data Generation method View
partOf Quantifiable Dialogue Coherence Evaluation method View