The result are definitely more raw than ChatGPT, but I think people would surprised how far your can go with just a language model. Thanks to the additional fine-tuning, the RLHF and the PPO RL, ChatGPT is like a well trained dog. /4