Авторегрессионное предобучение вперед-назад
method
ID: autoregressiveforwardbackwardpretraining
Related Papers
DePA: Improving Non-autoregressive Translation with Dependency-Aware Decoder
AbstractNon-autoregressive machine translation (NAT) models have lower translation quality than autoregressive translation (AT) models because NAT decoders do not depend on previous target tokens in the decoder input. We propose …...