1 Introduction
Table 1: Pearson correlation for inter-annotator agreement on the SemEval-2007 Affective Text Corpus (Strapparava and Mihalcea, 2007).
['anger', 'disgust', 'fear', 'joy', 'sadness', 'surprise']
None of the systems participating to SemEval-2007 reached an accuracy similar to that of sentiment analysis methods. This is possibly the reason why it is hard to find literature about alternative approaches to those used in the Affective Text task, and why a similar task was not proposed in successive editions of SemEval. If trained annotators agree with a simple average r of 53.67 (the frequency-based average r is 43), it is plausible that untrained respondents would show an even lower level of agreement.