Detecting Everyday Scenarios in Narrative Texts
Table 6: Results for the scenario detection task
['[BOLD] Model', '[BOLD] Precision', '[BOLD] Recall', '[BOLD] F1-score']
The sent_maj baseline achieves a F1-score of only 6%, as the majority class forms only a small part of the dataset (4.7%). Our TT model with tf.idf features surpasses both baselines that perform segmentation only naively (26% F1) or randomly (37% F1). This result shows that scenario detection works best when using predicted segments that are informative and topically consistent.