ChatGPT is optimised for dialogues. I think a totally new model will need to be RLHFed on a dataset optimised for these tasks. For example RLHFing on Salesforce's Codegen is the best possibility of achieving what you said. If we can combine 2