You need to prime it with some instructions (and ChatGPT can get really annoying, as it keeps trying to "please" and "lecture" us). But with some patience we can get it to perform some of the symbolic manipulations correctly.