SemEval-2016 Task 4: Sentiment Analysis in Twitter
Table 8: Results for Subtask A “Message Polarity Classification” on the Tweet 2016 dataset. The systems are ordered by their FPN1 score. In each column the rankings according to the corresponding measure are indicated with a subscript. Teams marked as “(*)” are late submitters, i.e., their original submission was deemed irregular by the organizers, and a revised submission was entered after the deadline.
['[BOLD] #', '[BOLD] System', '[ITALIC] FPN1', '[ITALIC] ρPN', '[ITALIC] Acc']
We further show the result for two other measures, ρPN ( the measure that we adopted for Subtask B) and accuracy (Acc= TP+TNTP+TN+FP+FN). We also report the result for a baseline classifier that assigns to each tweet the Positive class. For Subtask A evaluated using FPN1, this is the equivalent of the majority class classifier for (binary or SLMC) classification evaluated via vanilla accuracy , i.e., this is the “smartest” among the trivial policies that attempt to maximize FPN1.