Тонкая настройка с малым количеством примеров
Related Papers
What to Pre-Train on? Efficient Intermediate Task Selection
AbstractIntermediate task fine-tuning has been shown to culminate in large transfer gains across many NLP tasks. With an abundance of candidate datasets as well as pre-trained language models, it has …...
Prompt-free and Efficient Few-shot Learning with Language Models
AbstractCurrent methods for few-shot fine-tuning of pretrained masked language models (PLMs) require carefully engineered prompts and verbalizers for each new task to convert examples into a cloze-format that the PLM …...
That’s the Wrong Lung! Evaluating and Improving the Interpretability of Unsupervised Multimodal Encoders for Medical Data
AbstractPretraining multimodal models on Electronic Health Records (EHRs) provides a means of learning representations that can transfer to downstream tasks with minimal supervision. Recent multimodal models induce soft local alignments …...
Combining Parameter-efficient Modules for Task-level Generalisation
AbstractA modular design encourages neural models to disentangle and recombine different facets of knowledge to generalise more systematically to new tasks. In this work, we assume that each task is …...