Noisy Parallel Approximate Decoding for Conditional Recurrent Language Model
Table 2: Effect of the number of parallel decoding processes. For NPAD, σ0=0.3.
['Strategy', '# Parallels', 'Valid NLL↓', 'Valid BLEU↑', 'Test-1 NLL↓', 'Test-1 BLEU↑']
Next, we see the effect of having more parallel decoding processes of the proposed NPAD. We observed this trend for all the other noise levels. This is an important observation, as it implies that the performance of decoding can easily be improved without sacrificing the delay between receiving the input and returning the result by simply adding in more cores/machines.