TTTTTackling WinoGrande Schemas
Table 2: Main results on the WinoGrande development set. Condition #2 is our current submission.
['Condition', 'Condition Answer token', 'Condition logit', 'Training size Zero-Shot', 'Training size XS', 'Training size S', 'Training size M', 'Training size L', 'Training size XL']
Note that we fine-tune the model for each training data size separately. A ✓under the “logit” column indicates that we used the softmax over the target tokens as described above. Without this technique, given the original two-choice question, if T5 outputs the same tokens for the two processed inputs, we simply assign Option1 as the answer. The table also reports “zero-shot” performance, i.e., performing inference on the development set without any model fine tuning. Condition #2 represents our submission to the official leaderboard, which achieves 0.7673 AUC on the held-out test set.