even if you were streaming parameters right off the fastest pcie4 SSDs you can buy right now (somewhere around 7GB/s) to your GPU without touching the CPU, it would still take almost two minutes to run inference once for a chatgpt sized LLM.