You mean, the policy is optimized with respect just to the current reward (one-step return), rather than with respect to the cumulative reward = episodic return, right? That makes sense. After all, ChatGPT isn't the kind of chatbot that tries to