The Effect of Different Writing Tasks on Linguistic Style:A Case Study of the ROC Story Cloze Task
Table 3: Results on the test set of the story cloze task. The middle block are our results. cogcomp results and human judgement scores are taken from Mostafazadeh et al. (2017). Methods marked with (†) do not use the story context in order to make a prediction.
['[BOLD] Model', '[BOLD] Acc.']
Our classifier obtains 72.4% accuracy, only 2.3% lower than state of the art results. our classifier does not require the story corpus training data, and in fact doesn’t even consider the first four sentences of the story in question. These numbers further support the claim that the styles of right and wrong endings are indeed very different. On its own, our neural language model performs moderately well on the story cloze test. Selecting endings based on pθ(ending∣story)