I have been seeing takes claiming that ChatGPT "totally fails the cognitive reflection test" such as the "ball and bat problem". Tldr: I tried and it gets it right on the first pass, no cherry picking. You just need to tell it to think about it step by step