The Dialogue Dodecathlon: Open-Domain Knowledge and Image Grounded Conversational Agents
Table 14: Human evaluations on Wizard of Wikipedia (unseen) test set, comparing various decoding schemes for our Image+Seq2Seq model trained on all tasks MT, as well as comparisons with human outputs, using ACUTE-Eval. All scores are statistically significant (binomial test, p
['Lose Percentage', '[EMPTY]', 'Win Percentage dinan2018wizard', 'Win Percentage Image+Seq2Seq', 'Win Percentage Image+Seq2Seq', 'Win Percentage Human']
As with our experiments regarding automatic metrics, we additionally explored nucleus sampling, with parameter p=0.7, and compared to both the baseline models as well as human outputs. The findings are similar to the pairwise ACUTE-Eval results in the main paper.