Companies have applied large language models to virtual agents. But these virtual agents, while being trained based on human conversations, tend to generate chit-chat responses. Why? The key ingredient underlying ChatGPT / Crestas Generative AI is alignment with preferences.