My feed is filled with amazing things ChatGPT can do intermixed with very easy things it blatantly fails to do. Both are great feedback signals for a next round of RL fine-tuning. Would the extremal (v. good v. bad) nature actually make the RL step more data efficient?