2/ If you've used ChatGPT, you know firsthand the impressive capabilities of GPT3. But did you know that it was originally trained on NVIDIA V100 GPUs? Researchers estimate it would have taken 1,024 A100 GPUs, 34 days, and million to train the model.