Behind the scenes: "An A100 GPU can run a 3-billion parameter model in 6ms. A single A100 takes 350ms per word on ChatGPT. ChatGPTs latest version has over 175 billion parameters, to get an output for a single query, it needs a server with at least 8 A100 GPUs." 3/6