If it can learn from other sensory data of will not be LLM anymore. Currently we don't have techniques that can learn a world model from multimodal data. There are multimodal models but not as good as chatGPT