Why? Right now we can afford to mostly ignore language grounding to get something like ChatGPT. But it is kind of luck that we happened to have so much data to easily scrape. Without it, we would've had to be more data efficient and human-like perhaps