From a science point of view it isn't actually super interesting, basically Viswani et al from 2017. The engineering to scale it to its size and load data is cool, but also the model has been out since 2020. The chat app