Thats where fine-tuning the model comes in. So you take an already pretrained model and then train it on the data you care about for a downstream task. I know OpenAI allows finetuning on their usual GPT3 model, not sure about their ChatGP