ChatGPT is a pre-trained transformer-based neural network that can generate human-like text. It can be fine-tuned for a variety of natural language processing tasks such as language translation, question answering, and text summarization.