A Dataset of Peer Reviews (PeerRead): Collection, Insights and NLP Applications
Table 5: Test accuracies (%) for acceptance classification. Our best model outperforms the majority classifiers in all cases.
['[EMPTY]', '[BOLD] ICLR', '[BOLD] cs.cl', '[BOLD] cs.lg', '[BOLD] cs.ai']
Our best model outperforms the majority classifier in all cases, with up to 22% error reduction. Since our models lack the sophistication to assess the quality of the work discussed in the given paper, this might indicate that some of the features we define are correlated with strong papers, or bias reviewers’ judgments.