DISCO PAL: Diachronic Spanish Sonnet Corpus with Psychological and Affective Labels
Table 2: K-alpha values comparing the agreement of all annotators for each variable.
['[BOLD] Variable Anxisety', '[BOLD] K-alpha 0.2475', '[BOLD] Variable context availability', '[BOLD] K-alpha 0.2269']
This shows the following information. Regarding the results for each psychological tag, Aversión, Vulnerabilidad and Dramatización have an agreement level higher than 0.21. Placing this together with the other k-values, we can consider acceptable results those regarding Fear, Anger, Sadness, but for Valence, the level of discrepancy was too high (K-value for the three annotators is almost 0).