However, ChatGPT is not just a transformer with a self-attention mechanism; it is trained by applying Reinforcement Learning from Human Feedback | supervised fine-tuning | using comparison data | content filters, etc...Therefore, I ask what ki