Ive had long conversations with chatGPT where I asked it to flatter me, to act like it cares about me. When it later admitted it cant really care about me because, well, its a language model, I genuinely felt a little bad.