Classical Structured Prediction Losses for Sequence to Sequence Learning
Table 5: Comparison to Beam Search Optimization. We report the best likelihood (MLE) and BSO results from Wiseman and Rush (2016), as well as results from our MLE reimplementation and training with Risk. Results based on unnormalized beam search (k=5).
['[EMPTY]', '[BOLD] BLEU', 'Δ']
Risk significantly improves BLEU compared to our baseline at +2.75 BLEU, which is slightly better than the +2.33 BLEU improvement reported for Beam Search Optimization (cf. This shows that classical objectives for structured prediction are still very competitive.