Thanks for the screenshot. I read the blog as well but didnt notice this sentence. Strongly suspect that RLHF can reduce the transformer size underneath. Does this mean that we can basically use open sourced GPT2+ RLHF to cr