Birds of a Feather Flock Together: Satirical News Detection via Language Model Differentiation
Table 2: Performance results with increasing number of feature/feature-pairs. 1: Mean, 2: Mean + Median, 3: Mean + Median + Sample Variance, 4: Mean + Median + Sample Variance + Range, 5: Mean + Median + Sample Variance + Range + Sample Size.
['Validation 1', 'Acc 96.35', 'Pre 92.01', 'Rec 82.83', 'F1 86.74', 'Test 1', 'Acc 94.82', 'Pre 90.51', 'Rec 77.37', 'F1 82.35']
The statistics calculated from the score sequences depict the different behavior on different LMs from a higher perspective. Meanwhile, it also reflects the feature importance when controlling different selection of features. Here we report the experimental results on both validation dataset and test dataset, in order to present the upper bound as well as the generalization performance of this method. The results shows a coherent behavior on both dataset as the number of feature/feature-pairs increments. The features generated using this method can reflect some statistical differences between two kinds of news data. Visible difference on these two series of data could be found from the histogram plot.