Looking into these models for the next post! The next generations of LLMs uses an extra training/fine-tuning stage to make the LLM better at particular things (like following instructions in the ChatGPT case).