Challenge - Memory: ChatGPT has some sense of memory within a chat. It is limited to about 3,000 words (4,000 tokens). The memory may also use search functions and something called embeddings to maintain coherence over a long conversation.