ChatGPT cannot keep track of a ball underneath three cups when giving the moves explicitly, unless you explain the rules of the game, which are intuitive to a human. ChatGPT is good at bullshitting and pattern matching, but very bad at logical deduction.