Interestingly, ChatGPT is behind fine-tuned SOTA in most tasks. Of course, those benchmarks are not perfectly designed, and metrics are flawed. But what's interesting is that ChatGPT has been trained to... look like it's helping us. And we love that.