Yeah, our model of the world is more sophisticated as it includes other forms of information, but you could conceivably build a model of the world with language alone. It would be limited, but that doesn't mean it's not a mod