ChatGPT (GPT-3) was trained using 1024 GPUs in 34 days for It has 175B parameters. GPT-4: a properly fit model with 100T parameters with a dataset of ~700T tokens given 1M GPUs, it would take ~ 2650 years to train! Sorry, GPT-4 is no GAI More likely a 10X GPT-3