Essentially what they used to further train GPT-3 after self-supervised pretraining and finetuning it on a small supervised dataset when they created ChatGPT. The InstructGPT paper is a good reference: