chatgpt in 3 steps 1/ humans gives questions and desired answers. gpt is finetuned w. the examples 2/ humans rate samples from the finetuned gpt to create an auxiliary reward reinforcementlearning model 3/ humans prompt gpt and the auxiliary