This is not mentioned much, but ChatGPT seems to be based on the same approach proposed a bit earlier by instructGPT. Check out their blog post on it. It has a bunch of info (and a paper has been published)! I'll cover this in the