Tiny Attention
method
ID: tinyattention
Related Papers
Tiny-Attention Adapter: Contexts Are More Important Than the Number of Parameters
AbstractAdapter-tuning is a paradigm that transfers a pretrained language model to downstream tasks by adding and tuning a small number of new parameters. Previously proposed adapter architectures are all feed-forward …...