Automatic Detection of Fake News
Table 8: Performance of two annotators (A1, A2) and the developed automatic system (Sys) on the fake news datasets
['[EMPTY]', 'FakeNewsAMT', 'Celebrity']
In addition, we evaluate the performance of the automatic fake news classifiers against the human capability to spot fake news. Thus, we compare the accuracy of our system to that of human annotators. Results confirm that humans are better at detecting fake content in the Celebrity domain. Notably, our system outperforms humans while detecting fake news in more serious and diverse news sources.