Трансформердің негізгі моделі

method ID: transformerbaseline

Related Papers

LICHEE: Improving Language Model Pre-training with Multi-grained Tokenization

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

Fully non-autoregressive neural machine trans- lation (NAT) simultaneously predicts tokens with single forward of neural networks, which significantly reduces the inference latency at the expense of quality drop compared to …...

34064

Conditional Bilingual Mutual Information Based Adaptive Training for Neural Machine Translation

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractToken-level adaptive training approaches can alleviate the token imbalance problem and thus improve neural machine translation, through re-weighting the losses of different target tokens based on specific statistical metrics (e.g., …...

39215