Text Generation Tasks

AbstractDespite the success of generative pre-trained language models on a series of text generation tasks, they still suffer in cases where reasoning over underlying commonsense knowledge is required during generation. …...

AbstractData augmentation is an effective way to improve the performance of many neural text generation models. However, current data augmentation methods need to define or choose proper data mapping functions …...

The attention-based encoder-decoder frame- work is widely used in many natural lan- guage generation tasks. The attention mecha- nism builds alignments between target words and source items that facilitate text …...

AbstractThough model robustness has been extensively studied in language understanding, the robustness of Seq2Seq generation remains understudied. In this paper, we conduct the first quantitative analysis on the robustness of …...

AbstractAutomatic evaluations for natural language generation (NLG) conventionally rely on token-level or embedding-level comparisons with text references. This differs from human language processing, for which visual imagination often improves comprehension. …...