ChatGPT is based on the transformer architecture, which is a type of neural network designed for natural language processing tasks. The model is trained on a large corpus of text data, where it learns the patterns and relationships between words and phrases in the language.