ChatGPT - 175 billion parameters requiring around 3600 petaFLOPS-days to train, i.e. 10^15 floating point operations per second for 3600 days. This is around 32 years of training on a single NVIDIA A100 GPU.