The two big things with ChatGPT imo are the RLHF implementation and the training data. Creating an open source dataset for text/chats similar to how LAION5B allowed for Stable Diffusion would be beneficial.