Transformer Modules
otherentity
ID: transformermodules
Related Papers
An Empirical Study on the Transferability of Transformer Modules in Parameter-efficient Fine-tuning
AbstractParameter-efficient fine-tuning has garnered lots of attention in recent studies. On this subject, we investigate the capability of different transformer modules in transferring knowledge from a pre-trained model to a …...