By default ChatGPT won't roll a dnd party but if you sit down with it and teach it some basic rules it can do a really good job. I have it to the point I can say generate a party, and it will be a balanced party. Example in thread