I think the technique applied here is the real breakthrough and interesting thing. It took just 1.3B parameters (on the smaller side of LLMs) and was fine-tuned with just 40 human lablers and RL. For chatGPT to get these results with