Pre-training Techniques

AbstractDeep learning has led to significant improvement in text summarization with various methods investigated and improved ROUGE scores reported over the years. However, gaps still exist between summaries produced by …...

Table-to-text generation is a subtask of data- to-text generation which aims to generate nal- tural language text based on input table. Pre- training techniques have achieved great suc- cess on …...

AbstractWith the rapid development of deep learning, Seq2Seq paradigm has become prevalent for end-to-end data-to-text generation, and the BLEU scores have been increasing in recent years. However, it is widely …...