ChatGPT is an example of a Chinese Room (this is a machine postulated by John Searle that answers questions without understanding them) TLDR; it doesnt understand what its saying, and you cant trust it in an application.