PoDA

Back to List
method ID: poda

Related Papers

Denoising based Sequence-to-Sequence Pre-training for Text Generation

Authors: nan

Publication: TIPSTER (2019)

DOI: nan

AbstractThis paper presents a new sequence-to-sequence (seq2seq) pre-training method PoDA (Pre-training of Denoising Autoencoders), which learns representations suitable for text generation tasks. Unlike encoder-only (e.g., BERT) or decoder-only (e.g., OpenAI …...

9102