Abductive Reasoning as Self-Supervision for Common Sense Question Answering
Table 2: Performance on HellaSWAG data set
['[BOLD] Supervision', '[BOLD] Approach', '[BOLD] Val.', '[BOLD] Test']
We also evaluate our approach on the tougher HellaSWAG dataset. The adversarial filtering technique on this dataset has been improved to increase the perplexity of BERT-like models on this task. Again, we compare against the same baselines as in SWAG and find that our approach offers competitive performance to the fully supervised baselines. We find that using our abductive reasoning approach on BERT allows the model to retain up to 59% of its performance as compared to a model trained directly on the annotations.