OA experimented w/ RLHF as early as 2017, and applied it to summarization in 2020, then released their first instruct model in summer 2021. SFT is essential for RLHF, and it's unclear how performance saturates w/ SFT. You can tra