Sort Story: Sorting Jumbled Images and Captions into Stories
Table 1: Performance of our different models and features at the sequencing task.
['[BOLD] Method', '[BOLD] Features', '[BOLD] Sp.', '[BOLD] Pairw.', '[BOLD] Dist.']
Pairwise Models vs Unary Models However, the Pairwise Order Model performs worse than the unary Skip-Thought model, suggesting that the Skip-Thought features, which encode context of a sentence, also provide a crucial signal for temporal ordering of story sentences. For comparison to existing related work, we tried to duplicate the pipelined approach of \newcitemodiCONLL2014. However, this step succeeds for only 60% of our test data.