DISCO PAL: Diachronic Spanish Sonnet Corpus with Psychological and Affective Labels
Table 3: Comparison between annotators 1 and 2.
['[BOLD] Variable Anxisety', '[BOLD] K-alpha 0.2363', '[BOLD] Variable context availability', '[BOLD] K-alpha 0.1779']
There is a slight coincidence (0>K<0.21) for the other variables considering the annotations of the 3 experts. In some cases the K is high (close to 0.21 although somewhat lower), something that occurs especially in psychological terms. The greatest discrepancies are seen in the variables: arousal 0.0912, happiness 0.0279, valence 0.0051. which pair of annotators are compared. Again, the validation of variables is done for those with k-alpha greater than 0.21. In particular, the following is checked: