The inputs you use dont affect the training. You can train GPT2 yourself and thats community driven, there are also community trained GPT models, like GPTJ. There are also community GPT chat models. Those