The Dialogue Dodecathlon: Open-Domain Knowledge and Image Grounded Conversational Agents
Table 7: Test performance for various metrics on the dodecaDialogue tasks comparing our multi-task and multi-task + fine-tuned methods to existing approaches (cited). Dashes mean metric was not provided. ∗ was reported on validation only. Score is defined on a per-task basis in the metric column.
['[EMPTY]', 'Existing Approaches (independent) Approach', 'Existing Approaches (independent) PPL', 'Existing Approaches (independent) Score', 'Existing Approaches (independent) (Metric)', 'MT + FT PPL', 'MT + FT Score', 'All Tasks MT PPL', 'All Tasks MT Score']
Here, for the multi-task model we have fine-tuned the decoding hyperparameters per task. We generally find across all metrics a similar story as before when comparing the fine-tuning with multi-tasking: multi-tasking is successful, but the challenge is still to do better.