Detecting Everyday Scenarios in Narrative Texts
Table 5: Datasets (number of documents) used in the experiments
['[BOLD] Dataset', '[BOLD] # train', '[BOLD] # dev', '[BOLD] # test']
We train the scenario classification model on the scenario labels provided in MCScript (one per text). Since we train separate classifiers for each scenario (one-vs-all classifiers), we get a probability distribution of how likely a sentence refers to a scenario. We use entropy to measure the degree of scenario content in the sentences. Sentences with entropy values higher than the threshold are considered as not referencing any scenario (None cases), while sentences with lower entropy values reference some scenario.