This is what ChatGPT had to say: Yes, it is true that the softmax function has the limitation of collapsing the vector values into a narrow range of probable candidates, which can lead to the need for multiple attention heads in some models.