I agree with your overall point. But ChatGPT is essentially InstructGPT and the methods to train it has been reported in March paper ( I also expect companies like HuggingFace will follow up with more op