This is the Instruct paradigm - a super effective way to do alignment, as evident in ChatGPTs mindblowing demos. The RL part also reminds me of the famous P=NP (or ) problem: it tends to be much easier to verify a solution than actually solving the problem from scratch. 11/