14/ GPT-4 will be fine-tuned on all the feedback data from ChatGPT, and that will be the key to a significant improvement. With a million prompts a day from ChatGPT, we expect compute used in PPO to go up a lot in GPT-4.