Distilled/Synthesised Bi-Text

AbstractKnowledge distillation has recently been successfully applied to neural machine translation. It allows for building shrunk networks while the resulting systems retain most of the quality of the original model. …...