Correctness, hyperparams, quality+quantity of feedback for rewards and policies is where the magic is. RLHF is hard to reproduce even with these. ChatGPT has 1 mil users, open source isn't anywhere close. Eg word "equivalent" is very inaccurate here