Domain Adaptive Pretraining
method
ID: domainadaptivepretraining
Outgoing Relationships
| Relationship | Target Entity | Type | Actions |
|---|---|---|---|
| leadsTo | Catastrophic Forgetting | otherentity | View |
| isBasedOn | Transformer-Based Models | method | View |
| includes | Soft Masking | method | View |
| includes | Contrastive Learning | method | View |
| incorporates | Mask Language Model | method | View |
| incorporates | Biaffine Attention | method | View |
| evaluatedIn | New Dataset | material | View |
| appliesTo | Reviews | material | View |
| appliesTo | News | material | View |
| appliesTo | Computer Science Publications | material | View |