Looks like we are still in dire need of Online Language Models after trying out ChatGPT! Hopefully our project will lead to insights about how we can update even the largest of models, like this one, effectively and efficiently with new information.