Using Sentence-Level LSTM Language Models for Script Inference
Table 3: Varying the amount of context in text-level models. “Num Prev Sents” is the number of previous sentences supplied during encoding.
['[BOLD] Num Prev Sents', '[BOLD] bleu', '[BOLD] bleu-bp', '[BOLD] 1G P']
As can be seen, in the training setup we investigate, more additional context sentences have a mixed effect, depending on the metric. This is perhaps due in part to the fact that we kept hyperparameters fixed between experiments, and a different hyperparameter regime would benefit predictions from longer input sequences. More investigation could prove fruitful.