ChatGPT will will happily ingest 25,000 tokens but basic comprehension and recall seems poor as you approach 4k (GPT3 token input limit is ~4k). This question fails at 3600 token input but works at 600 Interested in how they're synthesizing and storing data for future requests