Hunting for Troll Comments in News Community Forums
Table 4: Paid troll vs. non-troll comments. Ablation excluding feature groups.
['[BOLD] Features', '[BOLD] F', '[BOLD] Acc']
There are several interesting observations we can make. First, we can see that the overall accuracy for finding paid trolls is slightly higher, namely 81.02, vs. 79.24 for mentioned trolls. The most helpful feature again is metadata, but this time it is less helpful (excluding it yields a drop of 5 points vs. 8 points before). The least helpful feature again are character n-grams. The remaining features fall in between, and most of them yield better performance when excluded, which suggests that there is a lot of redundancy in the features.