(4/6) OpenAI researchers altered the auto regressive optimization method for the goal of "helpfully and securely following the user's directions." They employ Reinforcement Learning from Human Feedback to do this ( RLHF ).