A much better proof of that is the fact that ChatGPT will arbitrarily change its answer if you format the question slightly differently. Since, ya know, it's not actually making real moral decisions to begin with.