In case it's not clear why running the model locally on the appliance would be silly--I'm assuming a chatbot like ChatGPT. You currently need a huge cluster GPUs to run ChatGPT. Even if this weren't the case its far more efficient to centralize c