Abductive Reasoning as Self-Supervision for Common Sense Question Answering
Table 3: Generalization from SWAG to new domains and vocabulary introduced in HellaSWAG
['[BOLD] Number of Samples', '[BOLD] Approach', '[BOLD] Accuracy']
However, given their ability to be rapid surface learners (CITE HellaSWAG), we evaluate the ability to generalize to new domains by evaluating the models on the HellaSWAG validation data while training on the SWAg data. We need at least 10,000 training examples on SWAG for it to outperform our model on HellaSWAG, although both datasets are derived from the same source.