I'm guessing (fwiw) that it's been trained specifically to reject "colorless green idea" because someone played that trick during the RLHF data collection. I suspect (but haven't tried) that if you substituted a similar nonsense phrase th