Did you know you can submit feedback to ChatGPT that the reinforcement learning algorithm behind it will incorporate in the training? Turns out a secret online community tries to massively bias this learning signal in order for it to only generate beautiful allegories!