When I tried this with less tokens, ChatGPT was able to remember the word from the start of the conversation OK. This seems to suggest a 4096 token window maybe? Can someone with more insight chime in perhaps?