Steering Output Style and Topic in Neural Response Generation
Table 2: Ranking the true target answer among random answers on Yahoo! Answers test set.
['[BOLD] Ranking Methods', '[BOLD] MRR', '[BOLD] P@1']
This implies that a naive beam search over only the forward model may generate irrelevant outputs. One hypothesis was that P(T|S) is biased toward P(T), and performance indeed improves after normalizing by P(T). However, it is difficult to directly decode with objective P(T|S)/P(T|∅), because this objective removes the influence of the target-side language model.