It takes about eight A100 gpus per ChatGPT instance. Each A100 has 80gbs of VRAM. Where as a diffusion model can be comfortably run on commercial hardware. This is in part why the diffusion work is progressing so quickly. Its just way ch