So you can push model weights around with RLHF but you can't exactly "hard code" something in a neural net. These systems are black boxes, you can't just dial in what you want. That's why chatGPT's bias feels s