The most mind-boggling part of chatGPT is how on earth OpenAI is serving a model with multi-billion parameters to live traffic for free. Have they figured out some holy grail of model partitioning for serving? spill some beans :P