WinoGrande: An Adversarial Winograd Schema Challenge at Scale
Table 4: Performance of RoBERTa with different training sizes.
['Training size', 'dev acc. (%)', 'test acc.(%)']
RoBERTa ’s performance ranges from 59% to 79% when the size of training data is varied from 800 (2% of the training data) to 41K (100% of the training data) instances. To achieve human-level performance, current state-of-the-art models would need over 118K training instances.