..which makes me wonder if the whole "ChatGPT improved from GPT3 mainly because of RLHF" narrative is a head fake designed to make the competitive moat appear deeper than it really is.. (..seems to be working though--even Karpathy makes that out to be the big secret..)