IEST: WASSA-2018 Implicit Emotions Shared Task
Table 9: Confusion Matrix Sample Annotated by Humans in Crowdsourcing
['[EMPTY]', '[EMPTY]', 'Predicted Labels A', 'Predicted Labels D', 'Predicted Labels F', 'Predicted Labels J', 'Predicted Labels Sa', 'Predicted Labels Su']
There are differences in the difficulty of the task for different emotions: The accuracy (F1) by emotion is 57 % (46 %) for anger, 15 % (21 %) for disgust, 42 % (51 %) for fear, 77 % (58 %) for joy, 59 % (52 %) for sadness and 34 % (39 %) for surprise. Disgust is often confused with anger, followed by fear being confused with sadness. Surprise is often confused with anger and joy.