How did the initial GPT3 evolve to today's ChatGPT ? Where do the amazing abilities of GPT3.5 come from? What is enabled by RLHF ? In this article with , we trace the emergent abilities of LLM to their sources from first principles