But chatGPT didnt get its prowess from pure scaling. GPT3, in its purest form, i.e., non-InstructGPT, was not as impressive. The question remain: will RLHF with smaller scale of transformer still work? Starting w/ 40 AI trainers wouldnt pro