Estimating predictive uncertainty for rumour verification models
Table 3: Per-class f1-scores of branch-LSTM model on each of the datasets.
['[EMPTY]', 'True', 'False', 'Unverified', 'Non-Rumour']
Is higher uncertainty associated with a particular class label? In all datasets the True class has significantly lower levels of uncertainty (using Kruskal and Wallis The difference between False and Unverified is not statistically significant in any cases. Aleatoric uncertainty shows a similar pattern for the class labels. In Twitter 15,16 the Non-Rumour class has the highest uncertainty (and relatively lower f1 score).