Minibatch

AbstractWe examine the effects of particular orderings of sentence pairs on the on-line training of neural machine translation (NMT). We focus on two types of such orderings: (1) ensuring that …...

Usually, we train a neural system on a se- quence of mini-batches of labeled instances. Each mini-batch is composed of k samples, and each sample will learn a representation vector. …...