PlotMachines: Outline-Conditioned Generation with Dynamic Plot State Tracking
Table 4: Human evaluations of paragraph excerpts from GPT, Grover and PlotMachines (PM) outputs.
['Model', 'Narrative Flow Rep(↓)', 'Narrative Flow Tran(↑)', 'Narrative Flow Rel(↑)', 'Order Acc(↑)']
Base GPT is the least repetitive between paragraphs (however, this may be caused by generating unrelated content from one paragraph to the next, as corroborated by the low subscores of the transitions and relevance). The model rated most repetitive is Grover. The transitions between two paragraphs are rated similarly highly between Grover and PlotMachines models. However, PlotMachines tends to achieve highest relevancy within paragraphs.