Training a model like ChatGPT can cost tens to hundreds of millions of dollars. Ray Kurzweil said that current doubling rate of the number of trained parameters in neural networks is six months (original Moores law is 18-24 months doubling).