It turns out ChatGPT based on an older, smaller model with 1.3B parameters. It just makes better connections through RLHF (Reinforcement Learning with Human Feedback), out performs the larger models. Bigger is not necessarily better.