This suggests two ways to fix ChatGPT: 1. Make use of programming to verify answers. 2. Make it less stubborn. That is, make it actively doubt its own answers when challenged, rather than coming up with increasingly implausible explanations for why it was initially correct.