Aligning Script Events with Narrative Texts
Table 3: Full text-to-script mapping results.
['[EMPTY]', '[BOLD]  P', '[BOLD]  R', '[BOLD]  F1']
Results. On the full text-to-script mapping task, our combined identification and CRF model achieves a precision and recall of 0.458 and 0.505, resp. (cf. This reflects an absolute improvement over the baselines of 0.036 and 0.052 in terms of F1-score. The results reflect the general difficulty of this task but are promising overall. As reported by \newciteModi2016, even human annotators only achieve an agreement of 0.64 in terms of Fleiss’ Kappa (1971).