RLHF/Instruct vs. non-RLHF models what's the difference? Here's a simple example of the power that's uncovered once you train LLMs (like ChatGPT or Anthropic's Claude) using reinforcement learning with human feedback. The original, pre-RLHF GPT-3 can't even solve 2 + 2!