I asked ChatGPT to give me map directions. It included streets that would be reasonable to have in the route but made a bunch of expected mistakes for a language model. More interestingly though, it seemed to get stuck in a loop of making turns on the same few streets.