Investigating the mathematical capabilities of ChatGPT, introduce a new dataset GHOSTS, and benchmark ChatGPT against fine-grained criteria. Concluding that ChatGPT's mathematical abilities are significantly below those of an average mathematics graduate student. [2/3]