Трансформердің негізгі моделі
method
ID: transformerbaseline
Related Papers
LICHEE: Improving Language Model Pre-training with Multi-grained Tokenization
Fully non-autoregressive neural machine trans- lation (NAT) simultaneously predicts tokens with single forward of neural networks, which significantly reduces the inference latency at the expense of quality drop compared to …...
Conditional Bilingual Mutual Information Based Adaptive Training for Neural Machine Translation
AbstractToken-level adaptive training approaches can alleviate the token imbalance problem and thus improve neural machine translation, through re-weighting the losses of different target tokens based on specific statistical metrics (e.g., …...