Isnt chatGPT=LLM+RLHF 1.3B instructGPT is also better than 175B GPT3? Our labelers prefer outputs from our 1.3B InstructGPT model over outputs from a 175B GPT-3 model, despite having more than 100x fewer parameters.