I think its trained on the whole internet, all data available, books etc. But if we dont contribute to a new data set to train it on then future will not be possible. I can see large value in stackoverflow using chat gpt to ins