Citation Needed: A Taxonomy and Algorithmic Assessment of Wikipedia’s Verifiability
Table 5. Citation reason prediction based on a pre-trained RNN+Sa model on the FA dataset, and a RNN+Sa which we train only on the Citation Reason dataset.
['[EMPTY]', '[ITALIC] pre-trained P', '[ITALIC] pre-trained R', '[ITALIC] pre-trained F1', '[ITALIC] no pre-training P', '[ITALIC] no pre-training R', '[ITALIC] no pre-training F1']
The pre-trained model has a better performance for nearly all citation reasons. It is important to note that due to the small number of statements in the Citation Reason dataset and additionally the number of classes, the prediction outcomes are not optimal. Our goal here is to show that the citation reason can be detected and we leave for future work a large scale evaluation.