ChatGPT uses a relatively simple but well executed extension of Reinforcement Learning from Human Feedback. Given the proliferation of recent models trained this way wouldnt be surprised if GPT-4 exposed this functionally but would that be safe?