This paper is absolutely fascinating, thanks so much for sharing. This appears to point to the cause of a lot of the issues I've found with ChatGPT and suggests it is caused by poorly implemented RLHF. Maybe outsourcing that wor