Hmm. A way to optimize ChatGPT is to have it cache the most popular requests and only do it's LLM magic on the unique parts. Or train the supporting LLM which would try to guess human input live and give hints to GPT for an instantaneous hit.