I suspect chatGPT is just Davinci 2 or 3 with some extras like keeping track of context, and I suspect it wont do better on the full dataset. The examples from the paper were mostly (if not all, I should check) done well by Davinci 2 a