ChatGPT and likes won't scale well at all anyway. Google processes 99K requests per second. There are not enough NVIDIA GPUs on the planet to sustain that inference rate with LLM, not even mentioning the cost of inferring at that scale. Even 1% of