Optimizing Language Models for Dialogue trained a model called ChatGPT which interacts in a conversational way. ChatGPT can answer followup questions, admit its mistakes, challenge incorrect premises, and reject inappropriate requests.