Rectified Linear Units

We explore the application of neural language models to machine translation. We develop a new model that combines the neural proba- bilistic language model of Bengio et al., rec- tified …...