Совместный декодер

Tree-based translation models, which ex- ploit the linguistic syntax of source lan- guage, usually separate decoding into two steps: parsing and translation. Although this separation makes tree-based decoding simple and …...

As tokenization is usually ambiguous for many natural languages such as Chinese and Korean, tokenization errors might po- tentially introduce translation mistakes for translation systems that rely on 1-best to- …...