Well, I think ChatGPT "understands" what it is "doing". Based on the paper by Bender and Koller, Climbing towards NLU, I asked a question if it understands "meaning" the same way we do and it clearly said no.