No, the point is to ask: if chat GPT were integrated into a much larger autonomous system which had to make moral decisions, what decisions might it make? Think of robocop using chatgpt to decide whether to kill someone.