Yeah the InstructGPT paper discussed how they were able to get good results even from a 1.3B parameter model. Although they did train InstructGPTs variants up to 175B. Don't think the parameter count of ChatGPT is public