Generating Diverse Story Continuations with Controllable Semantics
Table 8: Automatic metrics for baseline system and when using oracle values for control attributes. For the gold standard continuation, we report only the story scorer results because they do not require a gold standard (unlike the other metrics).
['[EMPTY]', 'PPL (↓)', 'ROUGE ROUGE-1 (↑)', 'ROUGE ROUGE-L (↑)', 'BLEU (↑)', 'Story Scorer O (↑)', 'Story Scorer R (↑)', 'Story Scorer I (↑)']
Unsurprisingly, compared with the seq2seq baseline, the perplexity decreases and the ROUGE and BLEU scores increase with oracle attributes. We also find that the scores from the story scorer, which does not use the gold standard while scoring, also show improvements over the baseline. We note that frame semantics form one of the most useful control attributes, aside from those that use words directly.