Some folks are critiquing ChatGPT as "just another LLM predicting the next token in a string". But that is not correct; it's built using prediction of the next token PLUS prediction of human answers and then RL on human ranking of 'good' answers.