T0 Eval
material
ID: t0eval
Related Papers
Model-Generated Pretraining Signals Improves Zero-Shot Generalization of Text-to-Text Transformers
AbstractThis paper explores the effectiveness of model-generated signals in improving zero-shot generalization of text-to-text Transformers such as T5. We study various designs to pretrain T5 using an auxiliary model to …...