Identifying Purpose Behind Electoral Tweets
Table 6: Percentage of tweets having majority class size (MCS) of 1, 2, and 3. Q is short for question.
['[EMPTY]', '[BOLD] MCS-1', '[BOLD] MCS-2', '[BOLD] MCS-3']
Higher numbers for the larger class sizes indicate higher agreement. For example, for 22.4% of the tweets all three annotators gave the same answer for question 1 (Q1). The agreement is much higher if one only considers the coarse categories of ‘oppose’, ‘favour’, and ‘other’—these numbers are shown in the row marked Q1’. The agreement for question 2 was substantially high. This was expected as it is a relatively straightforward question. The numbers in the table are calculated from tweets with exactly three annotations.