Small Pre-trained Language Models Can be Fine-tuned as Large Models via Over-Parameterization
38644Knowledge Triples
| Source Entity | Relationship | Target Entity |
|---|---|---|
|
Overparameterization
OtherEntity |
includes |
Dynamic Strategies
Method |
|
Overparameterization
OtherEntity |
includes |
Static Strategies
Method |
|
Overparameterization
OtherEntity |
uses |
Matrix Product Operator
Method |
|
Small Pre-trained Language Models
Material |
employs |
Overparameterization
OtherEntity |