Гомоморфтық Проективті Дистилляция

AbstractHow to learn highly compact yet effective sentence representation? Pre-trained language models have been effective in many NLP tasks. However, these models are often huge and produce large sentence embeddings. …...