Noisy Parallel Approximate Decoding for Conditional Recurrent Language Model
Table 4: NPAD vs. diverse decoding. The hyperparameter η0 was selected based on the BLEU on the validation set. (⋆) σ0 if NPAD, and η if Diverse.
['Strategy', 'Beam Width', '⋆', '# Chains', 'Valid NLL↓', 'Valid BLEU↑', 'Test-1 NLL↓', 'Test-1 BLEU↑']
, we present the result using the diverse decoding. As those additional models are trained and selected for a specific application of machine translation, we find the proposed NPAD to be more generally applicable than the diverse decoding is. It is however worthwhile to note that the diverse decoding may also benefit from having the NPAD as an outer loop.