Overcoming the Curse of Sentence Length for Neural Machine Translation using Automatic Segmentation
Table 1: BLEU score computed on news-test2014 for two control experiments. Random segmentation refers to randomly segmenting a sentence so that the mean and variance of the segment lengths corresponded to the ones our best segmentation method. Random confidence score refers to segmenting a sentence with randomly generated confidence score for each segment.
['Model', 'Test set']
One interesting phenomenon is that any random segmentation was better than the direct translation without any segmentation.