Sequence-to-Sequence Learning as Beam-Search Optimization
Table 1: Word ordering. BLEU Scores of seq2seq, BSO, constrained BSO, and a vanilla LSTM language model (from Schmaltz et al, 2016). All experiments above have Ktr=6.
['[EMPTY]', 'Word Ordering (BLEU)  [ITALIC] Kte = 1', 'Word Ordering (BLEU)  [ITALIC] Kte = 5', 'Word Ordering (BLEU)  [ITALIC] Kte = 10']
We see that on this task there is a large improvement at each beam size from switching to BSO, and a further improvement from using the constrained model.