I think this is spot-on. Your point that "Chat GPT does not actually understand the legal consequences of its output (see above it produces sentences, not legal advice)" says it all. There is no intentionality there whatsoever, and that