The claim isnt that we cant prompt it to (in fact its pretty easy to if you ask ChatGPT to pretend it is a smart person). The point is that over stronger upstream pref GPT wont be better at solving it using non-