Yes, chatGPT is unambiguously different, for reasons OpenAI isnt explaining (RLHF doesnt seem like an adequate explanation; theres probably some secret sauce they arent talking about (and Id guess its conventional code)). Id