Birds of a Feather Flock Together: Satirical News Detection via Language Model Differentiation
Table 3: Experimental result comparison of four different methods on satirical news detection task in Accuracy, Precision, Recall, and F1 Score. Results being compared are originally listed in the work by Yang et al. [16] and De Sarkar et al. [3].
['Method', 'Validation Acc', 'Validation Pre', 'Validation Rec', 'Validation F1', 'Test Acc', 'Test Pre', 'Test Rec', 'Test F1']
Upon further investigation of the corpora we use, we found that one of the satirical news source proposed by Yang et al. This website is a blog of Irreverence, Irony, Insouciance & Iconoclasm as mentioned on their headline instead of news. Although it truly focuses on irony and publishes some satire content and fake news, a considerable number of blog posts such as ironic film reviews are neither satire nor in the form of news. Therefore, it is likely some of this irrelevance in data results in a negative impact on the performance of our method.