I think ChatGPT (and the flop of the Galactica release) shows that how the model is trained is as important as the number of parameters (GPT-3.5 still seems to use the same number of parameters as GPT-3 released in 2020).