Learning Invariant Representations of Social Media Users
Table 3: Validation and test accuracy for the Wikipedia sockpuppet task. Best results in bold.
['[EMPTY]', '[BOLD] Validation', '[BOLD] Test']
Results. The best validation performance is obtained by the cased BERT model. However, both BERT models appear to overfit the training data as test performance is significantly lower. Regarding the proposed IUR model, we see that its performance on validation data is comparable to BERT while generalizing better to held-out test data. For reference, \newcitesolorio2013case report accuracy of 68.83 using the same data using a SVM with hand-crafted features; however, neither their experimental splits nor their model are available for purposes of a direct comparison.