*InstructGPT was those things And thats all we have a paper on at this point. Plus OpenAI have told us that ChatGPT was trained using the same RLHF approach. Its probably a larger model, but from the previous results + Chinchilla we know