ChatGPT is a transformer-based model that is fine-tuned for conversational text. It is trained on a diverse dataset of over 8 million conversations and can understand and respond to a wide variety of topics.