This is the most interesting part of ChatGPT, it does impressive memory tricks that I cant really explain. I only have a pretty normal understanding of the state of the art when it comes to tokenizers, but it still fascinates.