Reasoning Over Semantic-Level Graph for Fact Checking
Table 4: Results of evidence selection models.
['Model', 'Dev. Set Acc.', 'Dev. Set Rec.', 'Dev. Set F1', 'Test Set Acc.', 'Test Set Rec.', 'Test Set F1']
In this part, we present the performance of the sentence-level evidence selection module that we develop with different backbone. We take the concatenation of claim and each evidence as input, and take the last hidden vector to calculate the score for evidence ranking. In our experiments, we try both RoBERTa and XLNet. When we submit our system on the leaderboard, we use RoBERTa as the evidence selection model.