In order to test ChatGPT, you need something that (1) you know it can do but that it won't do reliably and then (2) that if you perform Y that it can then do that X it wouldn't before. But lately it seems like it's taking on savant mode and doing more on its own. Very curious.