Super interesting analysis by Yao Fu on ChatGPT, GPT3, and many other related models inspired by GPT3 and their tradeoffs. In particular, "The ability of complex reasoning with chain-of-thought is likely to be a magical side product of training on code"