Текстовый кодировщик
Related Papers
CLEVE: Contrastive Pre-training for Event Extraction
AbstractEvent extraction (EE) has considerably benefited from pre-trained language models (PLMs) by fine-tuning. However, existing pre-training methods have not involved modeling event characteristics, resulting in the developed EE models cannot …...
Debiasing Pretrained Text Encoders by Paying Attention to Paying Attention
AbstractNatural Language Processing (NLP) models are found to exhibit discriminatory stereotypes across many social constructs, e.g. gender and race. In comparison to the progress made in reducing bias from static …...
Incorporating Hierarchy into Text Encoder: a Contrastive Learning Approach for Hierarchical Text Classification
AbstractHierarchical text classification is a challenging subtask of multi-label classification due to its complex label hierarchy. Existing methods encode text and label hierarchy separately and mix their representations for classification, …...
CLAPSpeech: Learning Prosody from Text Context with Contrastive Language-Audio Pre-Training
AbstractImproving text representation has attracted much attention to achieve expressive text-to-speech (TTS). However, existing works only implicitly learn the prosody with masked token reconstruction tasks, which leads to low training …...