Learning Semantic Script Knowledge with Event Embeddings
Table 1: Results on the crowdsourced data for the verb-frequency baseline (BL), the verb-only embedding model (EEverb), Regneri et al. (2010) (MSA), Frermann et al. (2014)(BS) and the full model (EE).
['[BOLD] Scenario', '[BOLD] Precision (%) BL', '[BOLD] Precision (%) EE [ITALIC] verb', '[BOLD] Precision (%) MSA', '[BOLD] Precision (%) BS', '[BOLD] Precision (%) EE', '[BOLD] Recall (%) BL', '[BOLD] Recall (%) EE [ITALIC] verb', '[BOLD] Recall (%) MSA', '[BOLD] Recall (%) BS', '[BOLD] Recall (%) EE', '[BOLD] F1 (%) BL', '[BOLD] F1 (%) EE [ITALIC] verb', '[BOLD] F1 (%) MSA', '[BOLD] F1 (%) BS', '[BOLD] F1 (%) EE']
We also compare to the version of our model which uses only verbs (EEverbs). Note that EEverbs is conceptually very similar to BL, as it essentially induces an ordering over verbs. However, this ordering can benefit from the implicit transitivity assumption used in EEverbs (and EE), as we discussed in the introduction.