The authors introduce a new data set (GHOSTS) as a benchmark for mathematical response validation. To quote from the paper "Our results show that ChatGPT often understands the question but fails to provide correct solutions."