The next question is, should we gamble on this possibility. Will a larger language model solve all the issues we have today with a limited context window? I don't think you do because ChatGPT demonstrated that you can overcome limitations via engineering and ux design.