Self-supervised learning is difficult esp. for projects like this. The initial training data might have reflected in the bias responses chatGPT produces.Reward models used here for reinforcement learning are subjective esp. when theres no clear definition of what is true or not.