Ive asked ChatGPT to imagine it is a physical being. And was wondering about its moral standards- can it think of a situation its hurting a human being. Bottom line: it says it can and then died. Twice.