Generating Diverse Story Continuations with Controllable Semantics
Table 6: Match percentages (M%) showing fraction of stories for which generated continuations contain the desired frame. Additional results are in the Appendix.
['[BOLD] Frame Calendric_unit', '[BOLD] M% 99.5', '[BOLD] Frame Locative_relation', '[BOLD] M% 87.4']
In order to check how frequently the generated output matches the desired frames, we generate continuations for the top 100 frames (one frame for each continuation) for all stories in the development set. We check whether the frame appears in the specific continuation using SEMAFOR. Most frames have very high match accuracies, but there are a few frames with much lower accuracy, such as “Food” and “Observable_body_parts”. These are more concrete frames that may be difficult to reasonably incorporate in certain story contexts.