Plan, Write, and Revise: an Interactive System for Open-Domain Story Generation
Table 1: User self-reported scores, from 1-5. E: Entertainment value, Q: Quality of Story, S: Satisfaction with Story. Note that the final column Use Again is based on converting “no” to 0, “conditional” to 1, and “yes” to 2.
['[BOLD] Experiment', '[BOLD] E', '[BOLD] Q', '[BOLD] S', '[BOLD] Use Again']
The lower scores in the Diversity only and Storyline only experiments are elucidated by qualitative comments from users of frustration at the inability to sufficiently control the generations with influence over only those tools. Storyline only is lowest for Use Again, which can be explained by the model behavior when dealing with unlikely storyline phrases. Usually, the most probable generated story will contain all storyline phrases (exact or similar embeddings) in order, but there is no mechanism that strictly enforces this. When a storyline phrase is uncommon, the story model will often ignore it. Many users expressed frustration at the irregularity of their ability to guide the model when collaborating on the storyline, for this reason.