Playing chess with ChatGPT is super interesting. It clearly "understands the rules", yet occasionally makes invalid moves or forgets the positions of certain pieces. Then you correct it and it is able to continue. Can probably somehow finesse the format so it remembers.