DISCO PAL: Diachronic Spanish Sonnet Corpus with Psychological and Affective Labels
Table 5: Comparison between annotators 2 and 3.
['[BOLD] Variable Anxisety', '[BOLD] K-alpha 0.3884', '[BOLD] Variable context availability', '[BOLD] K-alpha 0.0257']
There is a slight coincidence (0>K<0.21) for the other variables considering the annotations of the 3 experts. In some cases the K is high (close to 0.21 although somewhat lower), something that occurs especially in psychological terms. The greatest discrepancies are seen in the variables: arousal 0.0912, happiness 0.0279, valence 0.0051. which pair of annotators are compared. Again, the validation of variables is done for those with k-alpha greater than 0.21. For annotators 2 and 3 the following variables are validated, representing 77.42% of the total variables (that includes all psychological variables): ’Anxiety’, ’Aversion’, ’Compulsion’, ’Depression ’, ’Disappointment’, ’Dramatización’, ’Daydream’, ’Grandeur’, ’Idealization’, ’Illusion’, ’Helplessness’, ’Inestability’, ’Insecurity’, ’Anger’, ’Irritability’, ’Obsesión’, ’Pride’, ’Prejudice’, ’Solitude’, ’Temor’, ’Vulnerability’, ’anger’, ’disgust’, ’fear’. For annotators 2 and 3 the k-alpha is higher for most of the variables comparing it with the previous analysis (including for all the psychological terms). However, it is especially low (including one negative value) for the following variables: ‘happiness’, ‘valence’. The biggest discrepancies are with the annotator 1, especially between 1 and 3 where only one variable has k-alpha greater than 0.21: ‘Illusion’.