A ChatGPT context of tokens could mean one of two things: 1) The architecture is different: A larger context size than GPT-3.5 means they have larger Q, K, and V matrices in the self-attention mechanism. However, we know that ChatGPT is a fine-tuned version of the GPT-3-5.