I have a background in formal semantics (among other things), and I think that ChatGPT does have a degree of semantic understanding, and that its lack of interpretability is a feature, not a bug. More detailed thoughts here