2. Models like davinci-003 aren't great at some precise reasoning tasks but CoT+self-consistency leads to substantial improvements. Labs are trying to bake CoT into the finetune but this is only a partial success. ChatGPT isnt peak of LM reasoning ability