Lifelong Language Knowledge Distillation

AbstractIt is challenging to perform lifelong language learning (LLL) on a stream of different tasks without any performance degradation comparing to the multi-task counterparts. To address this issue, we present …...