To test the limit of ChatGPT, I came up with a hypothesis. If the model can return a secret word I provide at the end of the text, then I know the model has read that many tokens. I tried this by providing longer texts to see if the model can still return the secret word.