...the gap was that single token prediction was not sufficient for getting a result directed precisely to what was wanted. RL provided the solution to provide long-range feedback over a SET of output tokens.