ChatGPT has 175 billion ML parameters. It was trained on NVIDIA V100, but researchers have calculated that using A100s would have taken 1,024 GPUs, 34 days and to train the model. While energy usage has not been disclosed, its estimated that GPT-3 consumed 936 MWh