IMO, a context of 8000 could mean one of two things: 1) The architecture is different: A larger context size than GPT-3 DaVinci means they have larger Q, K, and V matrices in the self-attention mechanism. However, we know that ChatGPT is a