Vocabulary Sizes

Neural networks have become the state- of-the-art approach for machine transla- tion (MT) in many languages. While linguistically-motivated tokenization tech- niques were shown to have significant ef- fects on the …...