There is something to be said about the fact that GPT3 was impressive but not really usable that the prime reason why ChatGPT works as well as it does is the injection of a layer of human feedback on top of it. See for an opensource option to this methodology